-- Logs begin at Tue 2022-05-10 18:29:37 UTC, end at Tue 2022-05-10 19:37:26 UTC. -- May 10 19:06:02.080882 dv-cinder-784815-13-iscsi systemd[1]: Starting Devstack devstack@keystone.service... May 10 19:06:02.090748 dv-cinder-784815-13-iscsi devstack@keystone.service[79980]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 10 19:06:02.093453 dv-cinder-784815-13-iscsi devstack@keystone.service[79980]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue May 10 19:06:02 2022] *** May 10 19:06:02.093585 dv-cinder-784815-13-iscsi devstack@keystone.service[79980]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 10 19:06:02.093702 dv-cinder-784815-13-iscsi devstack@keystone.service[79980]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 10 19:06:02.093798 dv-cinder-784815-13-iscsi devstack@keystone.service[79980]: nodename: dv-cinder-784815-13-iscsi May 10 19:06:02.093888 dv-cinder-784815-13-iscsi devstack@keystone.service[79980]: machine: x86_64 May 10 19:06:02.093991 dv-cinder-784815-13-iscsi devstack@keystone.service[79980]: clock source: unix May 10 19:06:02.094083 dv-cinder-784815-13-iscsi devstack@keystone.service[79980]: pcre jit disabled May 10 19:06:02.094161 dv-cinder-784815-13-iscsi devstack@keystone.service[79980]: detected number of CPU cores: 4 May 10 19:06:02.094260 dv-cinder-784815-13-iscsi devstack@keystone.service[79980]: current working directory: / May 10 19:06:02.094363 dv-cinder-784815-13-iscsi devstack@keystone.service[79980]: detected binary path: /usr/bin/uwsgi-core May 10 19:06:02.094470 dv-cinder-784815-13-iscsi devstack@keystone.service[79980]: your processes number limit is 47680 May 10 19:06:02.094573 dv-cinder-784815-13-iscsi devstack@keystone.service[79980]: your memory page size is 4096 bytes May 10 19:06:02.094674 dv-cinder-784815-13-iscsi devstack@keystone.service[79980]: detected max file descriptor number: 2048 May 10 19:06:02.094783 dv-cinder-784815-13-iscsi devstack@keystone.service[79980]: lock engine: pthread robust mutexes May 10 19:06:02.095041 dv-cinder-784815-13-iscsi devstack@keystone.service[79980]: thunder lock: enabled May 10 19:06:02.095334 dv-cinder-784815-13-iscsi devstack@keystone.service[79980]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 10 19:06:02.095527 dv-cinder-784815-13-iscsi devstack@keystone.service[79980]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 10 19:06:02.139996 dv-cinder-784815-13-iscsi devstack@keystone.service[79980]: Python main interpreter initialized at 0x5570110c89c0 May 10 19:06:02.139996 dv-cinder-784815-13-iscsi devstack@keystone.service[79980]: python threads support enabled May 10 19:06:02.139996 dv-cinder-784815-13-iscsi devstack@keystone.service[79980]: your server socket listen backlog is limited to 100 connections May 10 19:06:02.139996 dv-cinder-784815-13-iscsi devstack@keystone.service[79980]: your mercy for graceful operations on workers is 90 seconds May 10 19:06:02.140338 dv-cinder-784815-13-iscsi devstack@keystone.service[79980]: mapped 403077 bytes (393 KB) for 2 cores May 10 19:06:02.140439 dv-cinder-784815-13-iscsi devstack@keystone.service[79980]: *** Operational MODE: preforking *** May 10 19:06:02.140703 dv-cinder-784815-13-iscsi devstack@keystone.service[79980]: *** uWSGI is running in multiple interpreter mode *** May 10 19:06:02.140703 dv-cinder-784815-13-iscsi devstack@keystone.service[79980]: spawned uWSGI master process (pid: 79980) May 10 19:06:02.140904 dv-cinder-784815-13-iscsi systemd[1]: Started Devstack devstack@keystone.service. May 10 19:06:02.144459 dv-cinder-784815-13-iscsi devstack@keystone.service[79980]: spawned uWSGI worker 1 (pid: 79993, cores: 1) May 10 19:06:02.144459 dv-cinder-784815-13-iscsi devstack@keystone.service[79980]: spawned uWSGI worker 2 (pid: 79994, cores: 1) May 10 19:06:02.144459 dv-cinder-784815-13-iscsi devstack@keystone.service[79980]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 10 19:06:07.873540 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 19:06:07.873540 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: from cryptography.utils import int_from_bytes May 10 19:06:07.874862 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 19:06:07.874862 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: from cryptography.utils import int_from_bytes May 10 19:06:07.876674 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 19:06:07.876674 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: from cryptography.utils import int_from_bytes May 10 19:06:07.878023 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 19:06:07.878023 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: from cryptography.utils import int_from_bytes May 10 19:06:07.923686 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 10 19:06:07.923867 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 10 19:06:07.924047 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] command line args: [] {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 10 19:06:07.924313 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 10 19:06:07.924518 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] ================================================================================ {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 10 19:06:07.924664 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 10 19:06:07.924755 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] admin_token = **** {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:06:07.924866 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 10 19:06:07.925002 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] config_dir = [] {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:06:07.925081 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] command line args: [] {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 10 19:06:07.925189 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:06:07.925315 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 10 19:06:07.925403 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] config_source = [] {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:06:07.925481 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] ================================================================================ {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 10 19:06:07.925559 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] debug = True {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:06:07.925720 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:06:07.925979 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] admin_token = **** {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:06:07.925979 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] config_dir = [] {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:06:07.926100 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:06:07.926158 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:06:07.926290 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:06:07.926390 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] config_source = [] {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:06:07.926497 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] debug = True {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:06:07.926603 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:06:07.926703 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:06:07.926829 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:06:07.926932 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:06:07.927039 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] list_limit = None {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:06:07.927136 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:06:07.927237 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] log_config_append = None {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:06:07.927337 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:06:07.927432 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:06:07.927532 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] log_dir = None {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:06:07.927638 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:06:07.927741 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] log_file = None {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:06:07.927836 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] list_limit = None {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:06:07.927943 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:06:07.928060 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] log_config_append = None {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:06:07.928136 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:06:07.928259 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:06:07.928259 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] log_dir = None {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:06:07.928482 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:06:07.928600 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] log_file = None {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:06:07.928683 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:06:07.928763 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:06:07.928888 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:06:07.928888 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:06:07.929079 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:06:07.929155 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:06:07.929269 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:06:07.929344 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:06:07.929471 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:06:07.929822 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:06:07.929906 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:06:07.929984 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:06:07.930110 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:06:07.930194 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:06:07.930267 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:06:07.930382 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:06:07.930464 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:06:07.930542 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:06:07.930658 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:06:07.930741 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:06:07.930814 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:06:07.930935 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:06:07.931030 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:06:07.931104 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:06:07.931307 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:06:07.931426 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.70/identity {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:06:07.931535 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:06:07.931618 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] publish_errors = False {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:06:07.931813 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:06:07.931904 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:06:07.932038 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:06:07.932215 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:06:07.932290 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.70/identity {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:06:07.932483 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:06:07.932577 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] publish_errors = False {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:06:07.932718 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:06:07.932795 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:06:07.932948 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] standard_threads = False {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:06:07.933097 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:06:07.933181 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:06:07.933252 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:06:07.933355 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:06:07.933434 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:06:07.933563 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:06:07.933647 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:06:07.933739 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] use_journal = False {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:06:07.933817 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] standard_threads = False {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:06:07.933914 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] use_json = False {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:06:07.934025 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:06:07.934103 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] use_stderr = False {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:06:07.934247 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] use_syslog = False {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:06:07.934324 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:06:07.934434 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:06:07.934516 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:06:07.934599 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] use_journal = False {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:06:07.934713 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.934799 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] use_json = False {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:06:07.934933 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] use_stderr = False {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:06:07.935014 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.935107 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] use_syslog = False {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:06:07.935190 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.935339 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:06:07.935423 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.935593 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.935671 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.935831 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.935908 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.936089 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.936169 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.936321 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.936403 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.936590 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.936670 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.936815 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.936895 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.937061 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.937140 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.937291 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.937373 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.937535 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.937613 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.937768 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.937844 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.938012 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.938088 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.938248 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.938337 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.938482 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.938558 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.938720 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.938839 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.938968 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.939068 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.939207 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.939290 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.939441 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.939523 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.939690 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.939769 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.939942 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.940019 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.940188 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.940265 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.940463 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.940547 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.940669 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.940747 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.940897 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.940975 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.941124 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.941203 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.941356 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.941433 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.941601 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.941677 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.941849 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.941937 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.942080 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.942168 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.942306 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.942387 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.942555 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.942632 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.942803 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.942883 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.943029 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.943120 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.943262 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.943342 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.943491 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.943571 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.943725 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.943818 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.943959 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.944046 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.944187 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.944268 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.944441 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.945057 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.945190 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.945269 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.945424 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.945504 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.945653 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.945742 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.945889 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.945970 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.946114 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.946193 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.947350 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.947491 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.947491 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.947711 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.947810 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.947912 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.948011 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.948117 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.948249 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.948347 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.948457 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.948554 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.948677 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.948791 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.948894 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.949052 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.949162 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.949260 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.949363 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.949500 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.949603 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.949708 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.949805 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.949930 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.950035 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.950140 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.950240 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.950336 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.950432 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.950563 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.950660 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.950773 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.950906 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.951017 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.951123 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.951222 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.951347 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.951446 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.951550 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.951655 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.951853 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.952118 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.952181 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.952239 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.953451 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.953531 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.953591 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.953649 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.953706 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.953769 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.953840 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.953900 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.953958 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.954014 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.954076 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.954140 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.954140 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.954253 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.954309 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.954371 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.954428 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.954485 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.954548 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.954607 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.954663 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.954999 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.955075 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.955135 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.955266 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.955329 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.955386 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.955443 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.955500 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.955565 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.955624 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.955681 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.955738 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.955794 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.955856 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.955921 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.955980 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.956037 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.956037 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.956139 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.956195 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.956259 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.956324 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.956382 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.956472 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.956533 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.956590 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.956719 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.956832 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.956959 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.957043 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.957197 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.957290 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.957433 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.957515 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.957664 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.957753 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.957897 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.957975 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.958365 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.958444 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.958605 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.958686 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.958838 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.958917 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.959078 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.959158 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.959314 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.959395 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.959558 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] auth.external = None {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.959639 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.959786 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.959864 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.960043 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.960183 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.960874 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.960951 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.961088 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] auth.password = None {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.961182 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.961319 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] auth.token = None {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.961408 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] auth.external = None {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.961550 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.961636 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.961781 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.961904 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.962029 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.962122 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.962258 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.962338 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] auth.password = None {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.962503 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.962591 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] auth.token = None {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.962741 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.962827 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.962968 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.963046 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.963202 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] credential.caching = True {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.963281 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.963433 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.963519 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.963682 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.963763 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.963925 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.964004 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.964153 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.964243 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.964390 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] credential.caching = True {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.964502 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.964644 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.964723 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.964906 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.964996 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.965155 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.965234 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.965386 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.965464 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.965628 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.965715 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.965861 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.965941 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.966128 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.966214 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.966383 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.966470 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.966620 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.966699 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.966872 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.966950 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.967104 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] federation.caching = True {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.967195 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.967342 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.967422 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.967589 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.967677 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.967836 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.967923 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.968065 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.968144 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.968313 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.968393 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] federation.caching = True {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.968575 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.968738 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.968837 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.968918 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.969073 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.969152 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.969304 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.969391 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.969551 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.969636 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.969786 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.969864 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.970018 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] identity.caching = True {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.970105 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.970265 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.970345 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.970512 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.970591 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.970745 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.970832 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.970978 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.971056 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.971220 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] identity.caching = True {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.971299 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.971449 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.971537 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.971686 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.971766 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.971931 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.972013 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.972167 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.972255 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.972396 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.972544 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.972630 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.972704 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.972864 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.972946 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.973105 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.973185 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.973351 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.973430 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.973582 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.973662 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.973815 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.973897 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.974045 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.974125 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.974290 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.974371 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.974539 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.974618 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.974772 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.974850 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.975002 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.975084 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.975237 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.975316 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.975466 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.975545 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.975700 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.975781 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.975971 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.976057 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.976210 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.976289 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.976498 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.976582 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.976693 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.976773 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.976930 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.977010 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.977171 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.977253 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.977403 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.977481 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.977648 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.977727 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.977876 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.977962 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.978109 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.978195 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.978343 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.978423 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.978571 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.978651 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.978810 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.978889 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.979042 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.979122 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.979271 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.979350 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.979501 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.979580 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.979727 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.979805 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.979963 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.980044 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.980198 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.980459 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.980540 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.980699 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.980792 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.980935 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.981014 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.981186 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.981265 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.981432 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.981519 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.981666 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.981745 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.981902 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.981981 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.982138 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.982226 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.982369 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] ldap.user = None {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.982448 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.982610 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.982688 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.982844 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.982930 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.983081 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.983161 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.983312 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] ldap.user = None {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.983391 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.983551 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.983639 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.983797 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.983876 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.984028 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.984107 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.984255 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.984342 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.984512 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.984596 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.984748 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.984828 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.984984 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.985065 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.985210 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.985288 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.985445 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.985526 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.985682 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.985763 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.985918 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.985996 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.986147 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.986230 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.986393 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.986473 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.986621 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.986700 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.986866 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.986946 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.987102 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.987184 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.987336 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.987415 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.987564 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.987643 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.987793 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.987873 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.988037 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.988116 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.988270 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.988348 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.988526 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.988609 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.988760 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.988829 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.989002 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.989081 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.989245 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.989326 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.989479 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.989559 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.989713 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.989791 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.989947 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.990028 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.990193 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.990272 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.990427 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.990505 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.990652 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.990732 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.990884 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.990963 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.991121 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] resource.caching = True {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.991200 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.991347 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.991424 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.991612 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.991692 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.991850 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.992089 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.992177 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] resource.caching = True {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.992388 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.992570 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.992650 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.992888 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.993006 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.993140 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.993392 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.993471 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.993629 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.993853 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.993933 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.994102 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.994292 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.994372 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.994573 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] role.caching = True {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.994732 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.994812 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] role.driver = sql {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.995044 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.995164 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] role.caching = True {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.995295 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.995545 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.995623 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] role.driver = sql {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.995796 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.996020 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.996115 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.996275 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.996519 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.996607 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.996923 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.997016 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.997375 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.997455 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.997645 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.997806 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.997892 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.998148 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.998263 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.998402 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.998639 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.998719 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.998888 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.998968 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.999140 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.999218 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.999392 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.999584 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.999738 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.999871 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:07.999999 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:08.000132 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:08.000306 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:08.000513 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:08.000668 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:08.000806 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:08.000949 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:08.001083 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:08.001083 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:08.001244 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:08.001329 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:08.001403 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:08.001517 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:08.001599 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:08.001753 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:08.002001 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:08.002090 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:08.002252 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:08.002442 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:08.002523 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:08.002710 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:08.002863 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:08.002951 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:08.003155 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:08.003307 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:08.003408 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:08.003665 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:08.003791 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:08.003911 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:08.004150 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:08.004228 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:08.004385 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:08.004487 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:08.004638 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:08.004732 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:08.004873 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] token.caching = True {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:08.004959 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:08.005109 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:08.005189 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:08.005356 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:08.005518 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] token.caching = True {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:08.005598 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:08.005834 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:08.005976 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:08.006111 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:08.006256 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:08.006390 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:08.006518 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:08.006652 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:08.006785 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:08.006920 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:08.007547 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:08.007684 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:08.007818 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:08.007954 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:08.008089 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:08.008221 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:08.008221 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:08.008526 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:08.008662 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:08.008797 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:08.008797 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:08.008993 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:08.008993 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:08.009261 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:08.009340 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:08.009414 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:08.009414 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:08.009546 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:08.009627 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:08.009702 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] database.connection = **** {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:08.009815 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:08.009905 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:08.010060 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:08.010141 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:08.010349 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:08.010428 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:08.010591 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:08.010672 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] database.connection = **** {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:08.010827 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:08.010917 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:08.011062 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:08.011143 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:08.011298 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:08.011390 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:08.011534 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:08.011615 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:08.011773 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:08.011852 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:08.012004 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:08.012091 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:08.012240 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:08.012319 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:08.012503 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:08.012651 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:08.012752 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:08.012975 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:08.013058 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:08.013221 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:08.013418 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:08.013499 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:08.013739 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:08.013898 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:08.013976 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:08.014208 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:08.014287 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:08.014439 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:08.014681 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:08.014768 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:08.014917 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:08.015089 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 10 19:06:08.015168 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:06:08.015447 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 10 19:06:08.047784 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79993) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 19:06:08.047995 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79993) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 19:06:08.048223 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79993) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 19:06:08.048598 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79994) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 19:06:08.048835 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79994) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 19:06:08.049064 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79994) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 19:06:08.057083 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79993) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 19:06:08.057879 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79994) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 19:06:08.087416 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79994) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 19:06:08.087643 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79994) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 19:06:08.093409 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79993) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 19:06:08.093646 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79993) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 19:06:08.141560 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79993) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 19:06:08.142469 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79994) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 19:06:08.192094 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79993) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 19:06:08.192324 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79993) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 19:06:08.193302 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79994) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 19:06:08.193542 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79994) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 19:06:08.258588 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79993) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 19:06:08.258819 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79993) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 19:06:08.259045 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79993) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 19:06:08.259269 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79993) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 19:06:08.259416 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79994) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 19:06:08.259498 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79993) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 19:06:08.259574 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79994) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 19:06:08.259686 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79993) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 19:06:08.259771 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79994) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 19:06:08.260000 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79994) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 19:06:08.260244 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79994) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 19:06:08.260457 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79994) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 19:06:08.283230 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79993) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 19:06:08.283463 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79993) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 19:06:08.283653 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79994) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 19:06:08.283808 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79993) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 19:06:08.283954 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79994) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 19:06:08.284097 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79993) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 19:06:08.284241 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79994) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 19:06:08.284383 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79993) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 19:06:08.284569 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79994) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 19:06:08.284714 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79993) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 19:06:08.284864 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79994) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 19:06:08.285022 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79993) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 19:06:08.285164 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79994) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 19:06:08.285164 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79994) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 19:06:08.295801 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79993) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 19:06:08.296370 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79994) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 19:06:08.310977 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79993) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 19:06:08.311227 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79994) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 19:06:08.311401 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79993) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 19:06:08.311548 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79994) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 19:06:08.311691 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79993) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 19:06:08.311833 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79994) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 19:06:08.311988 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79993) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 19:06:08.312138 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79994) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 19:06:08.312281 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79993) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 19:06:08.312459 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79994) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 19:06:08.312610 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79993) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 19:06:08.312751 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79994) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 19:06:08.312892 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79993) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 19:06:08.313159 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79994) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 19:06:08.330020 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79993) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:06:08.330247 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79993) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 10 19:06:08.330528 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79994) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:06:08.330700 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79993) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:06:08.330864 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79993) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 10 19:06:08.331009 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79994) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 10 19:06:08.331152 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79993) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:06:08.331294 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79994) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:06:08.331437 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79993) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:06:08.331578 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79994) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 10 19:06:08.331730 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79993) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:06:08.331873 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79994) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:06:08.332015 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79993) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:06:08.332156 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79994) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:06:08.332156 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79994) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:06:08.332485 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79994) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:06:08.342991 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79993) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:06:08.343266 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79993) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:06:08.343534 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79993) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:06:08.343685 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79994) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:06:08.343827 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79993) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:06:08.343982 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79994) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:06:08.344126 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79994) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:06:08.344392 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79994) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:06:08.352230 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79993) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 19:06:08.352637 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79994) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 19:06:08.355522 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79993) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 19:06:08.355798 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79993) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:06:08.356001 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79994) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 19:06:08.356159 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79993) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:06:08.356300 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79994) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:06:08.356477 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79993) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:06:08.356629 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79994) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:06:08.356770 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79993) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:06:08.356945 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79994) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:06:08.357087 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79993) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:06:08.357241 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79994) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:06:08.357392 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79993) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:06:08.357534 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79994) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:06:08.357675 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79994) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:06:08.357815 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79993) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:06:08.357956 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79994) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:06:08.358154 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79993) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:06:08.358306 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79994) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:06:08.358448 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79993) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:06:08.358644 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79994) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:06:08.358805 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79993) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:06:08.358955 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79994) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:06:08.386211 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79993) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:06:08.386691 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79994) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:06:08.387823 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79993) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 19:06:08.388102 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79993) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:06:08.388341 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79994) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 19:06:08.388649 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79994) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:06:08.393435 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79993) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 19:06:08.393814 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79993) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:06:08.393949 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79993) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:06:08.394088 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79994) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 19:06:08.394278 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79994) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:06:08.394568 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79994) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:06:08.401235 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79993) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 19:06:08.401512 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79993) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:06:08.401995 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79994) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 19:06:08.402287 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79994) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:06:08.406118 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79993) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 19:06:08.406400 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79993) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:06:08.406674 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79993) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:06:08.406943 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79994) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 19:06:08.407097 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79993) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:06:08.407231 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79993) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:06:08.407362 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79994) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:06:08.407493 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79993) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:06:08.407625 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79994) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:06:08.407757 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79993) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:06:08.407896 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79994) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:06:08.408029 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79993) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:06:08.408161 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79994) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:06:08.408292 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79994) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:06:08.408552 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79994) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:06:08.408821 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79994) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:06:08.426718 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79993) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:06:08.426990 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79993) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:06:08.427522 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79994) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:06:08.427798 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79994) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:06:08.432112 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79993) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 19:06:08.432895 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79994) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 19:06:08.435754 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79993) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:06:08.436044 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79993) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:06:08.436530 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79994) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:06:08.436824 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79994) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:06:08.441103 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79993) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 19:06:08.441821 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79994) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 19:06:08.445289 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79993) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 19:06:08.445964 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79994) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 19:06:08.449062 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79993) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:06:08.449355 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79993) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:06:08.449634 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79993) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:06:08.449762 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79994) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:06:08.449928 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79993) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:06:08.450069 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79994) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:06:08.450282 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79993) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:06:08.450418 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79994) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:06:08.450551 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79993) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:06:08.450682 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79994) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:06:08.450812 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79994) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:06:08.451059 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79994) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:06:08.469698 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79993) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 19:06:08.470069 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79993) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:06:08.470335 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79993) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:06:08.470464 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79994) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 19:06:08.470604 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79993) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:06:08.470733 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79994) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:06:08.470985 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79994) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:06:08.471251 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79994) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:06:08.478516 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79993) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:06:08.479221 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79994) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:06:08.480228 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79993) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:06:08.480521 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79993) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:06:08.480967 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79994) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:06:08.481239 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79994) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:06:08.483556 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79993) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 19:06:08.483834 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79993) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:06:08.484110 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79993) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:06:08.484310 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79994) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 19:06:08.484472 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79993) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:06:08.484684 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79993) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:06:08.484824 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79994) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:06:08.485027 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79994) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:06:08.485318 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79994) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:06:08.485598 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79994) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:06:08.498626 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79993) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 19:06:08.498908 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79993) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:06:08.499185 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79993) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:06:08.499473 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79993) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:06:08.499602 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79994) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 19:06:08.499743 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79993) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:06:08.499884 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79994) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:06:08.500016 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79993) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:06:08.500147 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79994) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:06:08.500280 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79993) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:06:08.500412 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79994) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:06:08.500679 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79994) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:06:08.500962 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79994) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:06:08.501237 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79994) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:06:08.518847 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79993) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 19:06:08.519896 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79994) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 19:06:08.522156 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79993) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 19:06:08.523244 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79994) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 19:06:08.525510 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79993) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:06:08.526569 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79994) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:06:08.527106 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79993) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:06:08.528175 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79994) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:06:08.528762 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79993) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 19:06:08.529038 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79993) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:06:08.529322 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79993) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:06:08.529855 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79994) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 19:06:08.530132 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79994) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:06:08.530429 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79994) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:06:08.536838 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79993) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:06:08.537900 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79994) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:06:08.538458 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79993) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 19:06:08.539525 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79994) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 19:06:08.541714 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79993) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:06:08.542001 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79993) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:06:08.542281 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79993) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:06:08.542552 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79993) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:06:08.542788 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79994) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:06:08.543075 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79994) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:06:08.543361 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79994) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:06:08.543635 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79994) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:06:08.551799 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79993) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 19:06:08.552087 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79993) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:06:08.552364 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79993) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:06:08.552954 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79994) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 19:06:08.553246 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79994) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:06:08.553526 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79994) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:06:08.561009 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79993) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 19:06:08.561284 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79993) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:06:08.561560 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79993) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:06:08.561830 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79993) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:06:08.562099 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79993) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:06:08.562228 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79994) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 19:06:08.562381 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79993) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:06:08.562509 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79994) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:06:08.562655 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79993) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:06:08.562784 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79994) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:06:08.562911 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79993) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:06:08.563038 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79994) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:06:08.563167 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79993) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:06:08.563302 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79994) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:06:08.563429 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79993) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:06:08.563557 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79994) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:06:08.563692 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79993) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:06:08.563871 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79994) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:06:08.564020 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79993) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:06:08.564108 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79994) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:06:08.564235 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79993) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:06:08.564315 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79994) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:06:08.564401 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79993) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:06:08.564557 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79994) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:06:08.564836 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79994) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:06:08.565111 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79994) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:06:08.565374 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79994) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:06:08.565631 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79994) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:06:08.603764 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5570110c89c0 pid: 79993 (default app) May 10 19:06:08.605107 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5570110c89c0 pid: 79994 (default app) May 10 19:06:08.607071 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceb52b5-a02c-462b-930c-e0590438df37 None None] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:08.607373 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceb52b5-a02c-462b-930c-e0590438df37 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:08.607660 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceb52b5-a02c-462b-930c-e0590438df37 None None] PATH_INFO: `/v3` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:08.611810 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1/1] 10.222.0.70 () {50 vars in 791 bytes} [Tue May 10 19:06:08 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:06:16.446878 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1cb38a-f6e8-4321-9bd5-4bdc6915ca20 None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:16.447417 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1cb38a-f6e8-4321-9bd5-4bdc6915ca20 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:16.447506 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1cb38a-f6e8-4321-9bd5-4bdc6915ca20 None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:16.451783 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1/2] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:06:16 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:06:16.457059 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f361de-c5be-497e-9a98-fd847d372d17 None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:16.457490 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f361de-c5be-497e-9a98-fd847d372d17 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:16.457612 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f361de-c5be-497e-9a98-fd847d372d17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:16.488137 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG oslo_db.sqlalchemy.engines [None req-53f361de-c5be-497e-9a98-fd847d372d17 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79993) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 19:06:16.671074 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG passlib.handlers.bcrypt [None req-53f361de-c5be-497e-9a98-fd847d372d17 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=79993) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 10 19:06:16.671490 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG passlib.handlers.bcrypt [None req-53f361de-c5be-497e-9a98-fd847d372d17 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79993) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 10 19:06:16.728698 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-53f361de-c5be-497e-9a98-fd847d372d17 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:06:16.730228 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-53f361de-c5be-497e-9a98-fd847d372d17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:06:16.853110 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 2/3] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:06:16 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 397 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 10 19:06:16.977611 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1cb38a-f6e8-4321-9bd5-4bdc6915ca20 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:17.011443 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG oslo_db.sqlalchemy.engines [None req-da1cb38a-f6e8-4321-9bd5-4bdc6915ca20 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79994) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 19:06:17.136919 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1cb38a-f6e8-4321-9bd5-4bdc6915ca20 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:17.141169 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352df344-c230-4837-9fe7-455053179b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:17.141830 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352df344-c230-4837-9fe7-455053179b30 admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:17.142118 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352df344-c230-4837-9fe7-455053179b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:17.142399 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352df344-c230-4837-9fe7-455053179b30 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:17.150925 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352df344-c230-4837-9fe7-455053179b30 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:06:17.201595 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: WARNING keystone.common.rbac_enforcer.enforcer [None req-352df344-c230-4837-9fe7-455053179b30 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 10 19:06:17.201935 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352df344-c230-4837-9fe7-455053179b30 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:06:17.212464 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 2/4] 10.222.0.70 () {58 vars in 1324 bytes} [Tue May 10 19:06:16 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 10 19:06:17.218042 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f361de-c5be-497e-9a98-fd847d372d17 None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:17.231875 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f361de-c5be-497e-9a98-fd847d372d17 None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:17.236237 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77588752-2bd9-45da-b547-248922b86371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:17.237442 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77588752-2bd9-45da-b547-248922b86371 admin admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:17.237790 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77588752-2bd9-45da-b547-248922b86371 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:17.238135 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77588752-2bd9-45da-b547-248922b86371 admin admin] PATH_INFO: `/v3/projects/a7c5828bc7be44a6adb3e9898a8f18d8` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:17.239685 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77588752-2bd9-45da-b547-248922b86371 admin admin] RBAC: Authorizing `identity:get_project(project_id=a7c5828bc7be44a6adb3e9898a8f18d8)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:06:17.290135 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: WARNING keystone.common.rbac_enforcer.enforcer [None req-77588752-2bd9-45da-b547-248922b86371 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 10 19:06:17.290414 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77588752-2bd9-45da-b547-248922b86371 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:06:17.294909 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 3/5] 10.222.0.70 () {56 vars in 1207 bytes} [Tue May 10 19:06:17 2022] GET /identity/v3/projects/a7c5828bc7be44a6adb3e9898a8f18d8 => generated 344 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:06:19.505379 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaae899-aa50-4198-b15a-c766b21158a6 None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:19.505972 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaae899-aa50-4198-b15a-c766b21158a6 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:19.505972 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaae899-aa50-4198-b15a-c766b21158a6 None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:19.510643 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 3/6] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:06:19 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:06:19.516082 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830e0e93-7324-4e46-9338-9369d9b7ff7d None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:19.516513 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830e0e93-7324-4e46-9338-9369d9b7ff7d None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:19.516667 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830e0e93-7324-4e46-9338-9369d9b7ff7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:19.536928 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-830e0e93-7324-4e46-9338-9369d9b7ff7d None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:06:19.538462 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-830e0e93-7324-4e46-9338-9369d9b7ff7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:06:19.546353 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 4/7] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:06:19 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 10 19:06:19.569956 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaae899-aa50-4198-b15a-c766b21158a6 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:19.582162 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaae899-aa50-4198-b15a-c766b21158a6 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:19.586603 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0374cbb3-10d9-45cb-a588-c92c183af2fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:19.587239 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0374cbb3-10d9-45cb-a588-c92c183af2fa admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:19.587526 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0374cbb3-10d9-45cb-a588-c92c183af2fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:19.587806 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0374cbb3-10d9-45cb-a588-c92c183af2fa admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:19.595331 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0374cbb3-10d9-45cb-a588-c92c183af2fa admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:06:19.597147 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0374cbb3-10d9-45cb-a588-c92c183af2fa admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:06:19.605734 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 4/8] 10.222.0.70 () {58 vars in 1324 bytes} [Tue May 10 19:06:19 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 10 19:06:19.611443 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830e0e93-7324-4e46-9338-9369d9b7ff7d None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:19.620913 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830e0e93-7324-4e46-9338-9369d9b7ff7d None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:19.625433 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc69a736-a6b1-407c-9013-8e6ea896af81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:19.626296 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc69a736-a6b1-407c-9013-8e6ea896af81 admin admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:19.626581 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc69a736-a6b1-407c-9013-8e6ea896af81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:19.626858 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc69a736-a6b1-407c-9013-8e6ea896af81 admin admin] PATH_INFO: `/v3/users/4cc9b8973fb54520a299cde16c0ec076` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:19.628244 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc69a736-a6b1-407c-9013-8e6ea896af81 admin admin] RBAC: Authorizing `identity:get_user(user_id=4cc9b8973fb54520a299cde16c0ec076)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:06:19.630256 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc69a736-a6b1-407c-9013-8e6ea896af81 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:06:19.632727 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 5/9] 10.222.0.70 () {56 vars in 1198 bytes} [Tue May 10 19:06:19 2022] GET /identity/v3/users/4cc9b8973fb54520a299cde16c0ec076 => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:06:21.902044 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5cdc31-9520-45cc-b4c8-e1fd2daaf065 None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:21.902564 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5cdc31-9520-45cc-b4c8-e1fd2daaf065 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:21.902659 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5cdc31-9520-45cc-b4c8-e1fd2daaf065 None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:21.904103 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 5/10] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:06:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 19:06:21.909467 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1234312f-10df-4773-b070-4cc16eb22224 None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:21.909977 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1234312f-10df-4773-b070-4cc16eb22224 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:21.910156 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1234312f-10df-4773-b070-4cc16eb22224 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:22.002331 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88665925-6c42-484b-8f63-109f53594aab None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:22.002655 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88665925-6c42-484b-8f63-109f53594aab None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:22.002898 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88665925-6c42-484b-8f63-109f53594aab None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:22.004401 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 6/11] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:06:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 19:06:22.010430 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b526819-3d33-4694-aeab-bce643e93bb6 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:22.010736 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b526819-3d33-4694-aeab-bce643e93bb6 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:22.011130 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b526819-3d33-4694-aeab-bce643e93bb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:22.035109 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-1234312f-10df-4773-b070-4cc16eb22224 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:06:22.036288 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-1234312f-10df-4773-b070-4cc16eb22224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:06:22.051345 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG passlib.handlers.bcrypt [None req-3b526819-3d33-4694-aeab-bce643e93bb6 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=79994) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 10 19:06:22.051763 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG passlib.handlers.bcrypt [None req-3b526819-3d33-4694-aeab-bce643e93bb6 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79994) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 10 19:06:22.105836 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-3b526819-3d33-4694-aeab-bce643e93bb6 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:06:22.107444 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-3b526819-3d33-4694-aeab-bce643e93bb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:06:22.122525 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 6/12] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:06:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 19:06:22.144640 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1234312f-10df-4773-b070-4cc16eb22224 None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:22.205562 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 7/13] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:06:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 19:06:22.228174 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b526819-3d33-4694-aeab-bce643e93bb6 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:22.242727 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1234312f-10df-4773-b070-4cc16eb22224 None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:22.276158 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8b0822-4f0c-4c68-9a3b-18034e99616c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:22.276996 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8b0822-4f0c-4c68-9a3b-18034e99616c None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:22.277274 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8b0822-4f0c-4c68-9a3b-18034e99616c None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:22.277545 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8b0822-4f0c-4c68-9a3b-18034e99616c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:22.290373 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8b0822-4f0c-4c68-9a3b-18034e99616c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:06:22.301726 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application [None req-ea8b0822-4f0c-4c68-9a3b-18034e99616c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 19:06:22.301726 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:06:22.301726 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:06:22.301726 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:06:22.301726 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:06:22.301726 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:06:22.301726 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:06:22.301726 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:06:22.301726 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:06:22.301726 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:06:22.301726 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:06:22.301726 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:06:22.301726 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:06:22.301726 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:06:22.301726 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:06:22.301726 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:06:22.302708 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:06:22.302708 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:06:22.302708 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:06:22.302708 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:06:22.302708 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:06:22.302708 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:06:22.302708 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:06:22.302708 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:06:22.302708 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:06:22.302708 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:06:22.302708 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:06:22.302708 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application with Lock( May 10 19:06:22.302708 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:06:22.302708 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._enter() May 10 19:06:22.302708 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:06:22.302708 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:06:22.303625 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:06:22.303625 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.creator() May 10 19:06:22.303625 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:06:22.303625 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application created_value = creator( May 10 19:06:22.303625 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:06:22.303625 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:06:22.303625 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:06:22.303625 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:06:22.303625 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:06:22.303625 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:06:22.303625 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 19:06:22.303625 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application May 10 19:06:22.308861 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 7/14] 10.222.0.70 () {56 vars in 1096 bytes} [Tue May 10 19:06:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 19:06:22.309610 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8b0822-4f0c-4c68-9a3b-18034e99616c None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:22.330827 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b526819-3d33-4694-aeab-bce643e93bb6 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:22.365726 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d8ca25-bc07-44d4-9e38-0275c42a2c53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:22.367220 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d8ca25-bc07-44d4-9e38-0275c42a2c53 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:22.367515 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d8ca25-bc07-44d4-9e38-0275c42a2c53 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:22.367800 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d8ca25-bc07-44d4-9e38-0275c42a2c53 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:22.409696 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8b0822-4f0c-4c68-9a3b-18034e99616c None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:22.439731 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d8ca25-bc07-44d4-9e38-0275c42a2c53 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:06:22.441316 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d8ca25-bc07-44d4-9e38-0275c42a2c53 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:06:22.445698 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095edfe8-4210-42c7-bc3b-4e6dead8c39a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:22.446385 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095edfe8-4210-42c7-bc3b-4e6dead8c39a None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:22.446668 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095edfe8-4210-42c7-bc3b-4e6dead8c39a None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:22.446943 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095edfe8-4210-42c7-bc3b-4e6dead8c39a None admin] PATH_INFO: `/v3/roles` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:22.447704 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095edfe8-4210-42c7-bc3b-4e6dead8c39a None admin] RBAC: Adding query filter params (name=admin) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:06:22.448009 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095edfe8-4210-42c7-bc3b-4e6dead8c39a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:06:22.449496 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095edfe8-4210-42c7-bc3b-4e6dead8c39a None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:06:22.468335 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 8/15] 10.222.0.70 () {56 vars in 1099 bytes} [Tue May 10 19:06:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:06:22.469779 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095edfe8-4210-42c7-bc3b-4e6dead8c39a None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:22.552852 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 8/16] 10.222.0.70 () {58 vars in 1282 bytes} [Tue May 10 19:06:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 10 19:06:22.558248 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d8ca25-bc07-44d4-9e38-0275c42a2c53 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:22.570203 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095edfe8-4210-42c7-bc3b-4e6dead8c39a None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:22.610440 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e544b1f-5573-4143-ac2d-032adbc71ab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:22.611324 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e544b1f-5573-4143-ac2d-032adbc71ab4 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:22.611610 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e544b1f-5573-4143-ac2d-032adbc71ab4 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:22.611886 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e544b1f-5573-4143-ac2d-032adbc71ab4 None admin] PATH_INFO: `/v3/users/4cc9b8973fb54520a299cde16c0ec076` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:22.613075 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e544b1f-5573-4143-ac2d-032adbc71ab4 None admin] RBAC: Authorizing `identity:get_user(user_id=4cc9b8973fb54520a299cde16c0ec076)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:06:22.614520 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e544b1f-5573-4143-ac2d-032adbc71ab4 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:06:22.616335 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 9/17] 10.222.0.70 () {56 vars in 1177 bytes} [Tue May 10 19:06:22 2022] GET /identity/v3/users/4cc9b8973fb54520a299cde16c0ec076 => generated 247 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:06:22.621335 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e544b1f-5573-4143-ac2d-032adbc71ab4 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:22.656898 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d8ca25-bc07-44d4-9e38-0275c42a2c53 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:22.690035 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707e563a-83e3-40eb-a38b-e7d2e13fe0e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:22.690842 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707e563a-83e3-40eb-a38b-e7d2e13fe0e0 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:22.691120 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707e563a-83e3-40eb-a38b-e7d2e13fe0e0 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:22.691391 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707e563a-83e3-40eb-a38b-e7d2e13fe0e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:22.724071 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e544b1f-5573-4143-ac2d-032adbc71ab4 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:22.761033 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df08b74b-5eb5-4112-a0f6-560aafe24f2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:22.762215 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df08b74b-5eb5-4112-a0f6-560aafe24f2c None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:22.762679 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df08b74b-5eb5-4112-a0f6-560aafe24f2c None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:22.763160 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df08b74b-5eb5-4112-a0f6-560aafe24f2c None admin] PATH_INFO: `/v3/domains/default` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:22.764616 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df08b74b-5eb5-4112-a0f6-560aafe24f2c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:06:22.766285 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df08b74b-5eb5-4112-a0f6-560aafe24f2c None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:06:22.768713 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 10/18] 10.222.0.70 () {56 vars in 1108 bytes} [Tue May 10 19:06:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:06:22.775147 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df08b74b-5eb5-4112-a0f6-560aafe24f2c None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:22.822221 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707e563a-83e3-40eb-a38b-e7d2e13fe0e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:06:22.823713 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707e563a-83e3-40eb-a38b-e7d2e13fe0e0 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:06:22.846431 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-707e563a-83e3-40eb-a38b-e7d2e13fe0e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:06:22.846431 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:06:22.846431 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:06:22.846431 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:06:22.846431 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:06:22.846431 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:06:22.846431 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:06:22.846431 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:06:22.846431 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:06:22.846431 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:06:22.846431 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:06:22.846431 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:06:22.846431 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 19:06:22.846431 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 19:06:22.846431 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 19:06:22.847360 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 19:06:22.847360 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:06:22.847360 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:06:22.847360 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:06:22.847360 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:06:22.847360 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:06:22.847360 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:06:22.847360 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:06:22.847360 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( May 10 19:06:22.847360 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:06:22.847360 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() May 10 19:06:22.847360 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:06:22.847360 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:06:22.847360 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:06:22.847360 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() May 10 19:06:22.847360 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:06:22.847360 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( May 10 19:06:22.848162 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 19:06:22.848162 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 19:06:22.848162 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:06:22.848162 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:06:22.848162 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 9/19] 10.222.0.70 () {56 vars in 1108 bytes} [Tue May 10 19:06:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 19:06:22.855354 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707e563a-83e3-40eb-a38b-e7d2e13fe0e0 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:22.883108 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df08b74b-5eb5-4112-a0f6-560aafe24f2c None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:22.917165 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea0c0af-30da-4d2e-bcc4-e7faf0872ff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:22.917884 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea0c0af-30da-4d2e-bcc4-e7faf0872ff5 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:22.918103 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea0c0af-30da-4d2e-bcc4-e7faf0872ff5 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:22.918378 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea0c0af-30da-4d2e-bcc4-e7faf0872ff5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:22.919273 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea0c0af-30da-4d2e-bcc4-e7faf0872ff5 None admin] RBAC: Adding query filter params (role.id=634ba284303b4626b5a0402772c68f5c, scope.domain.id=default, user.id=4cc9b8973fb54520a299cde16c0ec076) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:06:22.919622 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea0c0af-30da-4d2e-bcc4-e7faf0872ff5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:06:22.921101 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea0c0af-30da-4d2e-bcc4-e7faf0872ff5 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:06:22.928083 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 11/20] 10.222.0.70 () {56 vars in 1322 bytes} [Tue May 10 19:06:22 2022] GET /identity/v3/role_assignments?user.id=4cc9b8973fb54520a299cde16c0ec076&scope.domain.id=default&role.id=634ba284303b4626b5a0402772c68f5c => generated 233 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:06:22.955264 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707e563a-83e3-40eb-a38b-e7d2e13fe0e0 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:22.991413 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed158bc1-cbfc-4551-b213-a156e8c01d0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:22.992019 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed158bc1-cbfc-4551-b213-a156e8c01d0b None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:22.992300 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed158bc1-cbfc-4551-b213-a156e8c01d0b None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:22.992682 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed158bc1-cbfc-4551-b213-a156e8c01d0b None admin] PATH_INFO: `/v3/domains` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:22.993456 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed158bc1-cbfc-4551-b213-a156e8c01d0b None admin] RBAC: Adding query filter params (name=Default) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:06:22.993819 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed158bc1-cbfc-4551-b213-a156e8c01d0b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:06:22.995292 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed158bc1-cbfc-4551-b213-a156e8c01d0b None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:06:23.015106 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 10/21] 10.222.0.70 () {56 vars in 1109 bytes} [Tue May 10 19:06:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:06:25.496003 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77a3eb6-6469-4bfa-99aa-038d9c802970 None None] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:25.497023 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77a3eb6-6469-4bfa-99aa-038d9c802970 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:25.497503 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77a3eb6-6469-4bfa-99aa-038d9c802970 None None] PATH_INFO: `/` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:25.499346 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 12/22] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:06:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:06:25.504460 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1face604-b699-43d3-b5c0-cc5d7eb37f15 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:25.504953 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1face604-b699-43d3-b5c0-cc5d7eb37f15 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:25.505029 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1face604-b699-43d3-b5c0-cc5d7eb37f15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:25.529440 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-1face604-b699-43d3-b5c0-cc5d7eb37f15 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:06:25.530643 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-1face604-b699-43d3-b5c0-cc5d7eb37f15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:06:25.623882 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 11/23] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:06:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 19:06:25.665994 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77a3eb6-6469-4bfa-99aa-038d9c802970 None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:25.796958 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77a3eb6-6469-4bfa-99aa-038d9c802970 None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:25.835115 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a5ad16-59df-4833-a370-6625bfe6021d None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:25.835785 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a5ad16-59df-4833-a370-6625bfe6021d None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:25.836264 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a5ad16-59df-4833-a370-6625bfe6021d None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:25.840917 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 12/24] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:06:25 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:06:25.844748 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f5c086-e309-49d2-8055-0935a462fbe5 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:25.845350 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f5c086-e309-49d2-8055-0935a462fbe5 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:25.845849 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f5c086-e309-49d2-8055-0935a462fbe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:25.851283 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347fbe3c-41b2-489a-a851-c08f96c7cbc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:25.852098 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347fbe3c-41b2-489a-a851-c08f96c7cbc2 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:25.852383 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347fbe3c-41b2-489a-a851-c08f96c7cbc2 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:25.852683 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347fbe3c-41b2-489a-a851-c08f96c7cbc2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:25.876444 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347fbe3c-41b2-489a-a851-c08f96c7cbc2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:06:25.884564 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application [None req-347fbe3c-41b2-489a-a851-c08f96c7cbc2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 19:06:25.884564 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:06:25.884564 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:06:25.884564 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:06:25.884564 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:06:25.884564 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:06:25.884564 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:06:25.884564 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:06:25.884564 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:06:25.884564 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:06:25.884564 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:06:25.884564 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:06:25.884564 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:06:25.884564 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:06:25.884564 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:06:25.884564 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:06:25.885503 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:06:25.885503 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:06:25.885503 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:06:25.885503 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:06:25.885503 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:06:25.885503 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:06:25.885503 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:06:25.885503 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:06:25.885503 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:06:25.885503 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:06:25.885503 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:06:25.885503 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application with Lock( May 10 19:06:25.885503 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:06:25.885503 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._enter() May 10 19:06:25.885503 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:06:25.885503 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:06:25.886281 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:06:25.886281 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.creator() May 10 19:06:25.886281 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:06:25.886281 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application created_value = creator( May 10 19:06:25.886281 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:06:25.886281 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:06:25.886281 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:06:25.886281 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:06:25.886281 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:06:25.886281 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:06:25.886281 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 19:06:25.886281 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application May 10 19:06:25.886281 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 13/25] 10.222.0.70 () {56 vars in 1096 bytes} [Tue May 10 19:06:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:06:25.888509 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-f1f5c086-e309-49d2-8055-0935a462fbe5 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:06:25.889966 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-f1f5c086-e309-49d2-8055-0935a462fbe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:06:25.892051 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347fbe3c-41b2-489a-a851-c08f96c7cbc2 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:26.033459 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347fbe3c-41b2-489a-a851-c08f96c7cbc2 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:26.044444 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 13/26] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:06:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 19:06:26.078386 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f5c086-e309-49d2-8055-0935a462fbe5 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:26.087956 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e4efe3-4e0e-4a39-ac82-859578e34097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:26.088661 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e4efe3-4e0e-4a39-ac82-859578e34097 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:26.088948 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e4efe3-4e0e-4a39-ac82-859578e34097 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:26.089225 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e4efe3-4e0e-4a39-ac82-859578e34097 None admin] PATH_INFO: `/v3/roles` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:26.089974 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e4efe3-4e0e-4a39-ac82-859578e34097 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:06:26.090279 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e4efe3-4e0e-4a39-ac82-859578e34097 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:06:26.092011 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e4efe3-4e0e-4a39-ac82-859578e34097 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:06:26.104566 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 14/27] 10.222.0.70 () {56 vars in 1099 bytes} [Tue May 10 19:06:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:06:26.110437 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e4efe3-4e0e-4a39-ac82-859578e34097 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:26.232446 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f5c086-e309-49d2-8055-0935a462fbe5 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:26.255973 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e4efe3-4e0e-4a39-ac82-859578e34097 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:26.309369 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efe6f7d-6ce8-44a5-b699-21ffaea973f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:26.310050 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efe6f7d-6ce8-44a5-b699-21ffaea973f1 None admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:26.310334 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efe6f7d-6ce8-44a5-b699-21ffaea973f1 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:26.310607 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efe6f7d-6ce8-44a5-b699-21ffaea973f1 None admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:26.311361 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efe6f7d-6ce8-44a5-b699-21ffaea973f1 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:06:26.312861 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efe6f7d-6ce8-44a5-b699-21ffaea973f1 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:06:26.325114 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5d0b6b-8131-477e-a7c3-2783c2ca0713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:26.326003 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5d0b6b-8131-477e-a7c3-2783c2ca0713 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:26.326293 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5d0b6b-8131-477e-a7c3-2783c2ca0713 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:26.326567 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5d0b6b-8131-477e-a7c3-2783c2ca0713 None admin] PATH_INFO: `/v3/users/4cc9b8973fb54520a299cde16c0ec076` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:26.327832 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5d0b6b-8131-477e-a7c3-2783c2ca0713 None admin] RBAC: Authorizing `identity:get_user(user_id=4cc9b8973fb54520a299cde16c0ec076)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:06:26.329383 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5d0b6b-8131-477e-a7c3-2783c2ca0713 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:06:26.330976 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 15/28] 10.222.0.70 () {56 vars in 1177 bytes} [Tue May 10 19:06:26 2022] GET /identity/v3/users/4cc9b8973fb54520a299cde16c0ec076 => generated 247 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:06:26.337264 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5d0b6b-8131-477e-a7c3-2783c2ca0713 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:26.439141 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5d0b6b-8131-477e-a7c3-2783c2ca0713 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:26.486023 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e216326d-e1a6-4d8a-aee1-1345ce5acbad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:26.486830 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e216326d-e1a6-4d8a-aee1-1345ce5acbad None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:26.487115 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e216326d-e1a6-4d8a-aee1-1345ce5acbad None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:26.487389 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e216326d-e1a6-4d8a-aee1-1345ce5acbad None admin] PATH_INFO: `/v3/domains/default` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:26.493136 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e216326d-e1a6-4d8a-aee1-1345ce5acbad None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:06:26.494624 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e216326d-e1a6-4d8a-aee1-1345ce5acbad None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:06:26.494729 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 14/29] 10.222.0.70 () {60 vars in 1131 bytes} [Tue May 10 19:06:26 2022] POST /identity/v3/roles => generated 219 bytes in 417 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:06:26.496289 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a84acb-df68-4336-bb11-57ac5cc651b7 None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:26.496396 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 16/30] 10.222.0.70 () {56 vars in 1108 bytes} [Tue May 10 19:06:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:06:26.496822 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a84acb-df68-4336-bb11-57ac5cc651b7 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:26.496895 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a84acb-df68-4336-bb11-57ac5cc651b7 None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:26.498066 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 15/31] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:06:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:06:26.503864 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124d835f-8b18-4512-8c6b-822d0cb894d7 None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:26.504154 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124d835f-8b18-4512-8c6b-822d0cb894d7 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:26.504455 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124d835f-8b18-4512-8c6b-822d0cb894d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:26.514626 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a84acb-df68-4336-bb11-57ac5cc651b7 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:26.542642 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-124d835f-8b18-4512-8c6b-822d0cb894d7 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:06:26.543874 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-124d835f-8b18-4512-8c6b-822d0cb894d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:06:26.633526 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 17/32] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:06:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 19:06:26.667441 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a84acb-df68-4336-bb11-57ac5cc651b7 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:26.676491 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124d835f-8b18-4512-8c6b-822d0cb894d7 None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:26.722427 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d9b4e2-bfa8-4dab-a6f4-73d0fb912349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:26.723459 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d9b4e2-bfa8-4dab-a6f4-73d0fb912349 None admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:26.723712 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d9b4e2-bfa8-4dab-a6f4-73d0fb912349 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:26.723999 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d9b4e2-bfa8-4dab-a6f4-73d0fb912349 None admin] PATH_INFO: `/v3/domains/default/users/4cc9b8973fb54520a299cde16c0ec076/roles/634ba284303b4626b5a0402772c68f5c` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:26.728457 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d9b4e2-bfa8-4dab-a6f4-73d0fb912349 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=4cc9b8973fb54520a299cde16c0ec076, role_id=634ba284303b4626b5a0402772c68f5c)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:06:26.729014 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d9b4e2-bfa8-4dab-a6f4-73d0fb912349 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:06:26.758155 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 16/33] 10.222.0.70 () {58 vars in 1361 bytes} [Tue May 10 19:06:26 2022] PUT /identity/v3/domains/default/users/4cc9b8973fb54520a299cde16c0ec076/roles/634ba284303b4626b5a0402772c68f5c => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:06:26.833169 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124d835f-8b18-4512-8c6b-822d0cb894d7 None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:26.875719 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39cf79f-8a60-4277-866f-cb7e12ec2582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:26.876590 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39cf79f-8a60-4277-866f-cb7e12ec2582 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:26.876879 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39cf79f-8a60-4277-866f-cb7e12ec2582 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:26.877157 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39cf79f-8a60-4277-866f-cb7e12ec2582 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:26.889117 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39cf79f-8a60-4277-866f-cb7e12ec2582 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:06:26.890560 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39cf79f-8a60-4277-866f-cb7e12ec2582 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:06:26.920293 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application [None req-a39cf79f-8a60-4277-866f-cb7e12ec2582 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:06:26.920293 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:06:26.920293 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:06:26.920293 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:06:26.920293 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:06:26.920293 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:06:26.920293 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:06:26.920293 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:06:26.920293 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:06:26.920293 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:06:26.920293 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:06:26.920293 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:06:26.920293 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 19:06:26.920293 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 19:06:26.920293 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 19:06:26.921208 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 19:06:26.921208 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:06:26.921208 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:06:26.921208 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:06:26.921208 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:06:26.921208 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:06:26.921208 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:06:26.921208 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:06:26.921208 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application with Lock( May 10 19:06:26.921208 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:06:26.921208 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._enter() May 10 19:06:26.921208 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:06:26.921208 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:06:26.921208 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:06:26.921208 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.creator() May 10 19:06:26.921208 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:06:26.921208 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application created_value = creator( May 10 19:06:26.922058 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 19:06:26.922058 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 19:06:26.922058 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:06:26.922058 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application May 10 19:06:26.922058 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 18/34] 10.222.0.70 () {56 vars in 1108 bytes} [Tue May 10 19:06:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 19:06:26.928725 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d9b4e2-bfa8-4dab-a6f4-73d0fb912349 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:27.082744 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d9b4e2-bfa8-4dab-a6f4-73d0fb912349 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:27.127862 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55bd5d1-4341-4e96-966c-ba805478a9cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:27.128987 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55bd5d1-4341-4e96-966c-ba805478a9cb None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:27.129491 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55bd5d1-4341-4e96-966c-ba805478a9cb None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:27.129965 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55bd5d1-4341-4e96-966c-ba805478a9cb None admin] PATH_INFO: `/v3/domains` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:27.131025 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55bd5d1-4341-4e96-966c-ba805478a9cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:06:27.131595 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55bd5d1-4341-4e96-966c-ba805478a9cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:06:27.133256 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55bd5d1-4341-4e96-966c-ba805478a9cb None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:06:27.150186 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 17/35] 10.222.0.70 () {56 vars in 1109 bytes} [Tue May 10 19:06:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:06:27.155985 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39cf79f-8a60-4277-866f-cb7e12ec2582 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:27.293750 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39cf79f-8a60-4277-866f-cb7e12ec2582 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:27.336662 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25842117-4bf3-41b8-980a-3db93eff0370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:27.337344 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25842117-4bf3-41b8-980a-3db93eff0370 None admin] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:27.337635 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25842117-4bf3-41b8-980a-3db93eff0370 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:27.337916 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25842117-4bf3-41b8-980a-3db93eff0370 None admin] PATH_INFO: `/v3/projects` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:27.338655 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25842117-4bf3-41b8-980a-3db93eff0370 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:06:27.340135 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25842117-4bf3-41b8-980a-3db93eff0370 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:06:27.506947 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 19/36] 10.222.0.70 () {60 vars in 1141 bytes} [Tue May 10 19:06:27 2022] POST /identity/v3/projects => generated 301 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:06:27.983670 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9676aecb-0079-41bd-9a17-f342d5a11e90 None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:27.984632 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9676aecb-0079-41bd-9a17-f342d5a11e90 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:27.985124 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9676aecb-0079-41bd-9a17-f342d5a11e90 None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:27.986741 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 18/37] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:06:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:06:27.992934 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8336e28-8b2f-40d4-9e66-ce3f66e90eb6 None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:27.993460 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8336e28-8b2f-40d4-9e66-ce3f66e90eb6 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:27.993927 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8336e28-8b2f-40d4-9e66-ce3f66e90eb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:28.012465 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-e8336e28-8b2f-40d4-9e66-ce3f66e90eb6 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:06:28.014193 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-e8336e28-8b2f-40d4-9e66-ce3f66e90eb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:06:28.081777 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 20/38] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:06:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 19:06:28.104342 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9676aecb-0079-41bd-9a17-f342d5a11e90 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:28.152234 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dd11c6-327c-4a92-ad6a-e088ff54b918 None None] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:28.152568 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dd11c6-327c-4a92-ad6a-e088ff54b918 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:28.152827 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dd11c6-327c-4a92-ad6a-e088ff54b918 None None] PATH_INFO: `/` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:28.154191 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 21/39] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:06:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 19:06:28.159574 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90b5d1e-74aa-4c51-8219-e75cb19382a2 None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:28.160125 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90b5d1e-74aa-4c51-8219-e75cb19382a2 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:28.160799 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90b5d1e-74aa-4c51-8219-e75cb19382a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:28.194665 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-a90b5d1e-74aa-4c51-8219-e75cb19382a2 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:06:28.196233 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-a90b5d1e-74aa-4c51-8219-e75cb19382a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:06:28.225862 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9676aecb-0079-41bd-9a17-f342d5a11e90 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:28.263888 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89037343-c06b-4bb0-98d7-0c412092bcb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:28.264867 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89037343-c06b-4bb0-98d7-0c412092bcb1 None admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:28.265293 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89037343-c06b-4bb0-98d7-0c412092bcb1 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:28.265724 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89037343-c06b-4bb0-98d7-0c412092bcb1 None admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:28.266626 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89037343-c06b-4bb0-98d7-0c412092bcb1 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:06:28.268238 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89037343-c06b-4bb0-98d7-0c412092bcb1 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:06:28.292701 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 19/40] 10.222.0.70 () {60 vars in 1131 bytes} [Tue May 10 19:06:28 2022] POST /identity/v3/roles => generated 223 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:06:28.305234 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 22/41] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:06:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 19:06:28.345453 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89037343-c06b-4bb0-98d7-0c412092bcb1 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:28.473268 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89037343-c06b-4bb0-98d7-0c412092bcb1 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:28.523093 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d83bf55-36bf-4cce-b791-0b217ba4d36a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:28.524039 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d83bf55-36bf-4cce-b791-0b217ba4d36a None admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:28.524515 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d83bf55-36bf-4cce-b791-0b217ba4d36a None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:28.524989 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d83bf55-36bf-4cce-b791-0b217ba4d36a None admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:28.525919 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d83bf55-36bf-4cce-b791-0b217ba4d36a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:06:28.527479 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d83bf55-36bf-4cce-b791-0b217ba4d36a None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:06:28.553953 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 20/42] 10.222.0.70 () {60 vars in 1131 bytes} [Tue May 10 19:06:28 2022] POST /identity/v3/roles => generated 225 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:06:28.692391 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbd1374-17d3-4d37-9aac-3bbc9c23b248 None None] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:28.692945 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbd1374-17d3-4d37-9aac-3bbc9c23b248 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:28.693019 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbd1374-17d3-4d37-9aac-3bbc9c23b248 None None] PATH_INFO: `/` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:28.694678 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 23/43] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:06:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:06:28.700878 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214184eb-f947-4ae0-b9b0-0a4353e99c40 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:28.701490 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214184eb-f947-4ae0-b9b0-0a4353e99c40 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:28.701987 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214184eb-f947-4ae0-b9b0-0a4353e99c40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:28.722290 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-214184eb-f947-4ae0-b9b0-0a4353e99c40 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:06:28.724138 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-214184eb-f947-4ae0-b9b0-0a4353e99c40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:06:28.813420 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 21/44] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:06:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 19:06:28.837627 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbd1374-17d3-4d37-9aac-3bbc9c23b248 None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:28.937580 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbd1374-17d3-4d37-9aac-3bbc9c23b248 None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:28.975993 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63da1fa3-87a8-4fad-836d-7229dc28f682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:28.976820 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63da1fa3-87a8-4fad-836d-7229dc28f682 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:28.977106 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63da1fa3-87a8-4fad-836d-7229dc28f682 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:28.977382 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63da1fa3-87a8-4fad-836d-7229dc28f682 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:28.978558 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63da1fa3-87a8-4fad-836d-7229dc28f682 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:06:28.980146 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63da1fa3-87a8-4fad-836d-7229dc28f682 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:06:28.981779 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 24/45] 10.222.0.70 () {56 vars in 1108 bytes} [Tue May 10 19:06:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:06:28.987386 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214184eb-f947-4ae0-b9b0-0a4353e99c40 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:29.081438 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214184eb-f947-4ae0-b9b0-0a4353e99c40 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:29.116042 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809d6981-adf5-4e6a-8d4d-c13bb9442edc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:29.116730 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809d6981-adf5-4e6a-8d4d-c13bb9442edc None admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:29.117014 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809d6981-adf5-4e6a-8d4d-c13bb9442edc None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:29.117288 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809d6981-adf5-4e6a-8d4d-c13bb9442edc None admin] PATH_INFO: `/v3/projects` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:29.118051 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809d6981-adf5-4e6a-8d4d-c13bb9442edc None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:06:29.119541 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809d6981-adf5-4e6a-8d4d-c13bb9442edc None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:06:29.146896 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 22/46] 10.222.0.70 () {60 vars in 1141 bytes} [Tue May 10 19:06:28 2022] POST /identity/v3/projects => generated 312 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:06:29.633145 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d029411-fb5f-4aa8-bf99-93c6f1200844 None None] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:29.633431 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d029411-fb5f-4aa8-bf99-93c6f1200844 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:29.633896 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d029411-fb5f-4aa8-bf99-93c6f1200844 None None] PATH_INFO: `/` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:29.635431 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 25/47] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:06:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:06:29.640738 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c90c812-5615-4c87-9d2e-b6c1d7052e10 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:29.641031 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c90c812-5615-4c87-9d2e-b6c1d7052e10 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:29.641308 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c90c812-5615-4c87-9d2e-b6c1d7052e10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:29.658093 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-2c90c812-5615-4c87-9d2e-b6c1d7052e10 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:06:29.659274 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-2c90c812-5615-4c87-9d2e-b6c1d7052e10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:06:29.721470 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 23/48] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:06:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 19:06:29.744928 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d029411-fb5f-4aa8-bf99-93c6f1200844 None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:29.840011 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d029411-fb5f-4aa8-bf99-93c6f1200844 None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:29.872443 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a467154a-1d94-4f84-b74d-50d62a07cb81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:29.873242 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a467154a-1d94-4f84-b74d-50d62a07cb81 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:29.873527 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a467154a-1d94-4f84-b74d-50d62a07cb81 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:29.873804 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a467154a-1d94-4f84-b74d-50d62a07cb81 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:29.883452 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a467154a-1d94-4f84-b74d-50d62a07cb81 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:06:29.890894 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application [None req-a467154a-1d94-4f84-b74d-50d62a07cb81 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 19:06:29.890894 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:06:29.890894 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:06:29.890894 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:06:29.890894 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:06:29.890894 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:06:29.890894 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:06:29.890894 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:06:29.890894 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:06:29.890894 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:06:29.890894 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:06:29.890894 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:06:29.890894 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:06:29.890894 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:06:29.890894 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:06:29.890894 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:06:29.891750 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:06:29.891750 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:06:29.891750 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:06:29.891750 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:06:29.891750 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:06:29.891750 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:06:29.891750 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:06:29.891750 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:06:29.891750 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:06:29.891750 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:06:29.891750 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:06:29.891750 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application with Lock( May 10 19:06:29.891750 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:06:29.891750 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._enter() May 10 19:06:29.891750 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:06:29.891750 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:06:29.892583 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:06:29.892583 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.creator() May 10 19:06:29.892583 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:06:29.892583 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application created_value = creator( May 10 19:06:29.892583 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:06:29.892583 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:06:29.892583 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:06:29.892583 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:06:29.892583 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:06:29.892583 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:06:29.892583 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 19:06:29.892583 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application May 10 19:06:29.892583 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 26/49] 10.222.0.70 () {56 vars in 1096 bytes} [Tue May 10 19:06:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:06:29.899103 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c90c812-5615-4c87-9d2e-b6c1d7052e10 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:30.001448 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c90c812-5615-4c87-9d2e-b6c1d7052e10 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:30.034162 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0619cad-6de2-4c73-a3ce-4fd939d5a3c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:30.034822 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0619cad-6de2-4c73-a3ce-4fd939d5a3c1 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:30.035103 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0619cad-6de2-4c73-a3ce-4fd939d5a3c1 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:30.035378 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0619cad-6de2-4c73-a3ce-4fd939d5a3c1 None admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:30.036115 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0619cad-6de2-4c73-a3ce-4fd939d5a3c1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:06:30.036458 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0619cad-6de2-4c73-a3ce-4fd939d5a3c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:06:30.037850 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0619cad-6de2-4c73-a3ce-4fd939d5a3c1 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:06:30.049939 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 24/50] 10.222.0.70 () {56 vars in 1099 bytes} [Tue May 10 19:06:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:06:30.056240 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a467154a-1d94-4f84-b74d-50d62a07cb81 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:30.155845 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a467154a-1d94-4f84-b74d-50d62a07cb81 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:30.188441 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ddd07b-fd67-46cf-9abd-784b59fd8aea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:30.189523 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ddd07b-fd67-46cf-9abd-784b59fd8aea None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:30.190029 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ddd07b-fd67-46cf-9abd-784b59fd8aea None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:30.190475 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ddd07b-fd67-46cf-9abd-784b59fd8aea None admin] PATH_INFO: `/v3/users/4cc9b8973fb54520a299cde16c0ec076` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:30.191847 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ddd07b-fd67-46cf-9abd-784b59fd8aea None admin] RBAC: Authorizing `identity:get_user(user_id=4cc9b8973fb54520a299cde16c0ec076)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:06:30.193527 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ddd07b-fd67-46cf-9abd-784b59fd8aea None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:06:30.195351 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 27/51] 10.222.0.70 () {56 vars in 1177 bytes} [Tue May 10 19:06:30 2022] GET /identity/v3/users/4cc9b8973fb54520a299cde16c0ec076 => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:06:30.200876 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0619cad-6de2-4c73-a3ce-4fd939d5a3c1 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:30.300401 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0619cad-6de2-4c73-a3ce-4fd939d5a3c1 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:30.335482 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77759d0-0f6a-4bee-bcfd-e4f6f624d425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:30.336282 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77759d0-0f6a-4bee-bcfd-e4f6f624d425 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:30.336591 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77759d0-0f6a-4bee-bcfd-e4f6f624d425 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:30.336865 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77759d0-0f6a-4bee-bcfd-e4f6f624d425 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:30.338023 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77759d0-0f6a-4bee-bcfd-e4f6f624d425 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:06:30.339475 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77759d0-0f6a-4bee-bcfd-e4f6f624d425 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:06:30.341313 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 25/52] 10.222.0.70 () {56 vars in 1108 bytes} [Tue May 10 19:06:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:06:30.346879 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ddd07b-fd67-46cf-9abd-784b59fd8aea None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:30.443507 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ddd07b-fd67-46cf-9abd-784b59fd8aea None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:30.475593 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f56580e-1f95-45ff-a1e7-20a2210dfd8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:30.476245 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f56580e-1f95-45ff-a1e7-20a2210dfd8b None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:30.476580 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f56580e-1f95-45ff-a1e7-20a2210dfd8b None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:30.476847 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f56580e-1f95-45ff-a1e7-20a2210dfd8b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:30.477665 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f56580e-1f95-45ff-a1e7-20a2210dfd8b None admin] RBAC: Adding query filter params (role.id=634ba284303b4626b5a0402772c68f5c, scope.domain.id=default, user.id=4cc9b8973fb54520a299cde16c0ec076) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:06:30.477973 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f56580e-1f95-45ff-a1e7-20a2210dfd8b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:06:30.479418 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f56580e-1f95-45ff-a1e7-20a2210dfd8b None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:06:30.485235 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 28/53] 10.222.0.70 () {56 vars in 1322 bytes} [Tue May 10 19:06:30 2022] GET /identity/v3/role_assignments?user.id=4cc9b8973fb54520a299cde16c0ec076&scope.domain.id=default&role.id=634ba284303b4626b5a0402772c68f5c => generated 530 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:06:31.398137 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e749a76-5695-42eb-9274-164d48087cf6 None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:31.398629 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e749a76-5695-42eb-9274-164d48087cf6 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:31.398629 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e749a76-5695-42eb-9274-164d48087cf6 None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:31.399984 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 26/54] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:06:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:06:31.405425 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caccefa7-e531-42a7-98cd-36256e185031 None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:31.405828 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caccefa7-e531-42a7-98cd-36256e185031 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:31.405989 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caccefa7-e531-42a7-98cd-36256e185031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:31.422487 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-caccefa7-e531-42a7-98cd-36256e185031 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:06:31.423653 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-caccefa7-e531-42a7-98cd-36256e185031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:06:31.487002 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 29/55] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:06:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 19:06:31.509490 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e749a76-5695-42eb-9274-164d48087cf6 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:31.606065 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e749a76-5695-42eb-9274-164d48087cf6 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:31.636920 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617e3ad4-f597-4f82-a26a-0b6ae7e83c3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:31.637704 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617e3ad4-f597-4f82-a26a-0b6ae7e83c3c None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:31.637981 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617e3ad4-f597-4f82-a26a-0b6ae7e83c3c None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:31.638249 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617e3ad4-f597-4f82-a26a-0b6ae7e83c3c None admin] PATH_INFO: `/v3/domains/default` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:31.639401 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617e3ad4-f597-4f82-a26a-0b6ae7e83c3c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:06:31.640862 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617e3ad4-f597-4f82-a26a-0b6ae7e83c3c None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:06:31.642607 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 27/56] 10.222.0.70 () {56 vars in 1108 bytes} [Tue May 10 19:06:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:06:31.648496 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caccefa7-e531-42a7-98cd-36256e185031 None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:31.741574 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caccefa7-e531-42a7-98cd-36256e185031 None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:31.772734 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf205d2-192c-4d7c-b975-a986c5b00996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:31.773397 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf205d2-192c-4d7c-b975-a986c5b00996 None admin] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:31.773686 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf205d2-192c-4d7c-b975-a986c5b00996 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:31.773964 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf205d2-192c-4d7c-b975-a986c5b00996 None admin] PATH_INFO: `/v3/projects` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:31.774677 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf205d2-192c-4d7c-b975-a986c5b00996 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:06:31.776114 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf205d2-192c-4d7c-b975-a986c5b00996 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:06:31.799174 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 30/57] 10.222.0.70 () {60 vars in 1140 bytes} [Tue May 10 19:06:31 2022] POST /identity/v3/projects => generated 298 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:06:33.991054 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc98ff14-9324-43da-9900-ea0a706ec626 None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:33.991518 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc98ff14-9324-43da-9900-ea0a706ec626 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:33.991619 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc98ff14-9324-43da-9900-ea0a706ec626 None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:33.992981 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 28/58] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:06:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:06:33.998068 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79592b7-d0c1-4399-ad12-9666f26862ff None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:33.998473 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79592b7-d0c1-4399-ad12-9666f26862ff None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:33.998835 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79592b7-d0c1-4399-ad12-9666f26862ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:34.015084 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-d79592b7-d0c1-4399-ad12-9666f26862ff None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:06:34.016258 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-d79592b7-d0c1-4399-ad12-9666f26862ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:06:34.078110 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 31/59] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:06:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 19:06:34.103216 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc98ff14-9324-43da-9900-ea0a706ec626 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:34.198259 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc98ff14-9324-43da-9900-ea0a706ec626 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:34.230069 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7496c326-a7f6-49b6-a40d-80584e686938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:34.230802 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7496c326-a7f6-49b6-a40d-80584e686938 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:34.231086 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7496c326-a7f6-49b6-a40d-80584e686938 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:34.231360 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7496c326-a7f6-49b6-a40d-80584e686938 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:34.232557 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7496c326-a7f6-49b6-a40d-80584e686938 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:06:34.233997 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7496c326-a7f6-49b6-a40d-80584e686938 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:06:34.235589 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 29/60] 10.222.0.70 () {56 vars in 1108 bytes} [Tue May 10 19:06:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:06:34.241678 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79592b7-d0c1-4399-ad12-9666f26862ff None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:34.334365 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79592b7-d0c1-4399-ad12-9666f26862ff None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:34.366470 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6ad7dc-1448-47b4-8fe2-78e7c1ae9349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:34.367132 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6ad7dc-1448-47b4-8fe2-78e7c1ae9349 None admin] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:34.367415 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6ad7dc-1448-47b4-8fe2-78e7c1ae9349 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:34.367686 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6ad7dc-1448-47b4-8fe2-78e7c1ae9349 None admin] PATH_INFO: `/v3/users` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:34.368382 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6ad7dc-1448-47b4-8fe2-78e7c1ae9349 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:06:34.369857 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6ad7dc-1448-47b4-8fe2-78e7c1ae9349 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:06:34.393851 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 32/61] 10.222.0.70 () {60 vars in 1132 bytes} [Tue May 10 19:06:34 2022] POST /identity/v3/users => generated 275 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:06:37.832741 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f65e8d-7965-4fc8-81ca-25b44965770f None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:37.834002 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f65e8d-7965-4fc8-81ca-25b44965770f None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:37.835050 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f65e8d-7965-4fc8-81ca-25b44965770f None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:37.836891 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 30/62] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:06:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:06:37.842033 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac16e8d-3e46-4cb9-8f9d-f34753dee45f None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:37.842862 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac16e8d-3e46-4cb9-8f9d-f34753dee45f None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:37.843546 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac16e8d-3e46-4cb9-8f9d-f34753dee45f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:37.863678 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-dac16e8d-3e46-4cb9-8f9d-f34753dee45f None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:06:37.865178 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-dac16e8d-3e46-4cb9-8f9d-f34753dee45f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:06:37.959348 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 33/63] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:06:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 19:06:37.993040 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f65e8d-7965-4fc8-81ca-25b44965770f None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:38.121188 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f65e8d-7965-4fc8-81ca-25b44965770f None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:38.160906 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba47bd1-abb3-43af-bc40-9dc81786c088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:38.162067 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba47bd1-abb3-43af-bc40-9dc81786c088 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:38.163068 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba47bd1-abb3-43af-bc40-9dc81786c088 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:38.163548 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba47bd1-abb3-43af-bc40-9dc81786c088 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:38.177267 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba47bd1-abb3-43af-bc40-9dc81786c088 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:06:38.186942 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-5ba47bd1-abb3-43af-bc40-9dc81786c088 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 19:06:38.186942 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:06:38.186942 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:06:38.186942 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:06:38.186942 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:06:38.186942 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:06:38.186942 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:06:38.186942 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:06:38.186942 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:06:38.186942 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:06:38.186942 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:06:38.186942 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:06:38.186942 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:06:38.186942 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:06:38.186942 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:06:38.186942 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:06:38.187814 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:06:38.187814 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:06:38.187814 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:06:38.187814 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:06:38.187814 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:06:38.187814 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:06:38.187814 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:06:38.187814 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:06:38.187814 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:06:38.187814 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:06:38.187814 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:06:38.187814 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( May 10 19:06:38.187814 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:06:38.187814 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() May 10 19:06:38.187814 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:06:38.187814 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:06:38.188609 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:06:38.188609 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() May 10 19:06:38.188609 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:06:38.188609 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( May 10 19:06:38.188609 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:06:38.188609 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:06:38.188609 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:06:38.188609 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:06:38.188609 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:06:38.188609 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:06:38.188609 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 19:06:38.188609 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:06:38.191274 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 31/64] 10.222.0.70 () {56 vars in 1099 bytes} [Tue May 10 19:06:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:06:38.196731 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac16e8d-3e46-4cb9-8f9d-f34753dee45f None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:38.239179 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ec91de-22b5-4c3c-9262-a8daefbf9a4d None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:38.239812 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ec91de-22b5-4c3c-9262-a8daefbf9a4d None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:38.240338 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ec91de-22b5-4c3c-9262-a8daefbf9a4d None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:38.241948 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 32/65] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:06:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 19:06:38.246978 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b4235f-4b90-4b26-8494-f56d374533ab None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:38.247494 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b4235f-4b90-4b26-8494-f56d374533ab None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:38.247964 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b4235f-4b90-4b26-8494-f56d374533ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:38.277986 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-31b4235f-4b90-4b26-8494-f56d374533ab None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:06:38.281616 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-31b4235f-4b90-4b26-8494-f56d374533ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:06:38.335398 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac16e8d-3e46-4cb9-8f9d-f34753dee45f None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:38.376590 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8546296f-9cac-45a8-848c-5e796ea19ef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:38.377200 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8546296f-9cac-45a8-848c-5e796ea19ef4 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:38.377484 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8546296f-9cac-45a8-848c-5e796ea19ef4 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:38.377759 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8546296f-9cac-45a8-848c-5e796ea19ef4 None admin] PATH_INFO: `/v3/roles` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:38.378519 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8546296f-9cac-45a8-848c-5e796ea19ef4 None admin] RBAC: Adding query filter params (name=member) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:06:38.378824 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8546296f-9cac-45a8-848c-5e796ea19ef4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:06:38.380260 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8546296f-9cac-45a8-848c-5e796ea19ef4 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:06:38.396552 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 34/66] 10.222.0.70 () {56 vars in 1101 bytes} [Tue May 10 19:06:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:06:38.399675 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51da58c-eab3-446a-9c96-079a9f94bb1a None None] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:38.399969 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51da58c-eab3-446a-9c96-079a9f94bb1a None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:38.400249 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51da58c-eab3-446a-9c96-079a9f94bb1a None None] PATH_INFO: `/` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:38.401552 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 35/67] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:06:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:06:38.409509 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51da58c-eab3-446a-9c96-079a9f94bb1a None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:38.440664 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 33/68] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:06:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 19:06:38.444061 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ea2413-014a-498c-b62a-ea1608ba0d95 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:38.444355 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ea2413-014a-498c-b62a-ea1608ba0d95 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:38.444663 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ea2413-014a-498c-b62a-ea1608ba0d95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:38.478944 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-24ea2413-014a-498c-b62a-ea1608ba0d95 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:06:38.480140 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-24ea2413-014a-498c-b62a-ea1608ba0d95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:06:38.590025 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51da58c-eab3-446a-9c96-079a9f94bb1a None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:38.591204 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 34/69] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:06:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 19:06:38.598650 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ea2413-014a-498c-b62a-ea1608ba0d95 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:38.697149 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62d0698-5f04-4974-b023-233e871025dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:38.698429 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62d0698-5f04-4974-b023-233e871025dc None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:38.698905 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62d0698-5f04-4974-b023-233e871025dc None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:38.699370 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62d0698-5f04-4974-b023-233e871025dc None admin] PATH_INFO: `/v3/users/6ad40793dcf0490689f2bcb5b52fd84e` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:38.729063 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ea2413-014a-498c-b62a-ea1608ba0d95 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:38.749167 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62d0698-5f04-4974-b023-233e871025dc None admin] RBAC: Authorizing `identity:get_user(user_id=6ad40793dcf0490689f2bcb5b52fd84e)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:06:38.751039 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62d0698-5f04-4974-b023-233e871025dc None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:06:38.753027 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 36/70] 10.222.0.70 () {56 vars in 1177 bytes} [Tue May 10 19:06:38 2022] GET /identity/v3/users/6ad40793dcf0490689f2bcb5b52fd84e => generated 275 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:06:38.753980 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62d0698-5f04-4974-b023-233e871025dc None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:38.770198 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864660d3-59f9-4693-8d6f-752e5bd98e31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:38.770198 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864660d3-59f9-4693-8d6f-752e5bd98e31 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:38.770198 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864660d3-59f9-4693-8d6f-752e5bd98e31 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:38.770198 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864660d3-59f9-4693-8d6f-752e5bd98e31 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:38.785783 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864660d3-59f9-4693-8d6f-752e5bd98e31 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:06:38.797335 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-864660d3-59f9-4693-8d6f-752e5bd98e31 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 19:06:38.797335 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:06:38.797335 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:06:38.797335 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:06:38.797335 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:06:38.797335 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:06:38.797335 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:06:38.797335 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:06:38.797335 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:06:38.797335 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:06:38.797335 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:06:38.797335 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:06:38.797335 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:06:38.797335 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:06:38.797335 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:06:38.797335 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:06:38.798221 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:06:38.798221 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:06:38.798221 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:06:38.798221 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:06:38.798221 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:06:38.798221 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:06:38.798221 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:06:38.798221 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:06:38.798221 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:06:38.798221 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:06:38.798221 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:06:38.798221 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( May 10 19:06:38.798221 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:06:38.798221 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() May 10 19:06:38.798221 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:06:38.798221 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:06:38.798990 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:06:38.798990 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() May 10 19:06:38.798990 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:06:38.798990 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( May 10 19:06:38.798990 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:06:38.798990 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:06:38.798990 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:06:38.798990 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:06:38.798990 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:06:38.798990 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:06:38.798990 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 19:06:38.798990 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:06:38.798990 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 35/71] 10.222.0.70 () {56 vars in 1114 bytes} [Tue May 10 19:06:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:06:38.799624 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864660d3-59f9-4693-8d6f-752e5bd98e31 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:38.910588 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864660d3-59f9-4693-8d6f-752e5bd98e31 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:38.917527 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62d0698-5f04-4974-b023-233e871025dc None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:38.950592 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c25a60-d2ae-4efd-b682-f31588894ee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:38.951119 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c25a60-d2ae-4efd-b682-f31588894ee9 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:38.951407 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c25a60-d2ae-4efd-b682-f31588894ee9 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:38.951687 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c25a60-d2ae-4efd-b682-f31588894ee9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:38.978003 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a235e261-e412-42d5-b73e-671bf235930c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:38.978899 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a235e261-e412-42d5-b73e-671bf235930c None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:38.979192 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a235e261-e412-42d5-b73e-671bf235930c None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:38.979472 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a235e261-e412-42d5-b73e-671bf235930c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:38.996916 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a235e261-e412-42d5-b73e-671bf235930c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:06:39.006685 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application [None req-a235e261-e412-42d5-b73e-671bf235930c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 19:06:39.006685 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:06:39.006685 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:06:39.006685 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:06:39.006685 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:06:39.006685 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:06:39.006685 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:06:39.006685 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:06:39.006685 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:06:39.006685 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:06:39.006685 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:06:39.006685 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:06:39.006685 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:06:39.006685 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:06:39.006685 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:06:39.006685 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:06:39.007614 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:06:39.007614 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:06:39.007614 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:06:39.007614 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:06:39.007614 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:06:39.007614 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:06:39.007614 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:06:39.007614 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:06:39.007614 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:06:39.007614 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:06:39.007614 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:06:39.007614 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application with Lock( May 10 19:06:39.007614 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:06:39.007614 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._enter() May 10 19:06:39.007614 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:06:39.007614 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:06:39.008390 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:06:39.008390 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.creator() May 10 19:06:39.008390 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:06:39.008390 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application created_value = creator( May 10 19:06:39.008390 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:06:39.008390 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:06:39.008390 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:06:39.008390 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:06:39.008390 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:06:39.008390 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:06:39.008390 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 19:06:39.008390 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application May 10 19:06:39.011034 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 37/72] 10.222.0.70 () {56 vars in 1096 bytes} [Tue May 10 19:06:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:06:39.017460 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a235e261-e412-42d5-b73e-671bf235930c None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:39.098297 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c25a60-d2ae-4efd-b682-f31588894ee9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:06:39.101802 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c25a60-d2ae-4efd-b682-f31588894ee9 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:06:39.185257 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a235e261-e412-42d5-b73e-671bf235930c None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:39.217582 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 36/73] 10.222.0.70 () {58 vars in 1282 bytes} [Tue May 10 19:06:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 19:06:39.218704 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c25a60-d2ae-4efd-b682-f31588894ee9 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:39.234634 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eb843f-13ef-43b8-abd2-91c15cec262d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:39.235528 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eb843f-13ef-43b8-abd2-91c15cec262d None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:39.235921 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eb843f-13ef-43b8-abd2-91c15cec262d None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:39.236306 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eb843f-13ef-43b8-abd2-91c15cec262d None admin] PATH_INFO: `/v3/roles` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:39.237652 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23eb843f-13ef-43b8-abd2-91c15cec262d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:06:39.238044 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23eb843f-13ef-43b8-abd2-91c15cec262d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:06:39.239569 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23eb843f-13ef-43b8-abd2-91c15cec262d None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:06:39.250937 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 38/74] 10.222.0.70 () {56 vars in 1111 bytes} [Tue May 10 19:06:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:06:39.253620 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7de9ad9-2a0b-4ef4-8313-80fd3879bcb4 None None] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:39.254078 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7de9ad9-2a0b-4ef4-8313-80fd3879bcb4 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:39.254541 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7de9ad9-2a0b-4ef4-8313-80fd3879bcb4 None None] PATH_INFO: `/` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:39.256876 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 39/75] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:06:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:06:39.258282 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7de9ad9-2a0b-4ef4-8313-80fd3879bcb4 None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:39.327444 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c25a60-d2ae-4efd-b682-f31588894ee9 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:39.361094 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77f34fc-66fc-4d6b-9877-97d228be9da8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:39.361765 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77f34fc-66fc-4d6b-9877-97d228be9da8 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:39.362046 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77f34fc-66fc-4d6b-9877-97d228be9da8 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:39.362325 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77f34fc-66fc-4d6b-9877-97d228be9da8 None admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:39.363065 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77f34fc-66fc-4d6b-9877-97d228be9da8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:06:39.363369 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77f34fc-66fc-4d6b-9877-97d228be9da8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:06:39.364782 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77f34fc-66fc-4d6b-9877-97d228be9da8 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:06:39.366215 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7de9ad9-2a0b-4ef4-8313-80fd3879bcb4 None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:39.377214 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 37/76] 10.222.0.70 () {56 vars in 1099 bytes} [Tue May 10 19:06:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:06:39.377214 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77f34fc-66fc-4d6b-9877-97d228be9da8 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:39.406773 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfd3dc8-fd45-4ca7-a204-ab1f92f53daa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:39.407636 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfd3dc8-fd45-4ca7-a204-ab1f92f53daa None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:39.408646 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfd3dc8-fd45-4ca7-a204-ab1f92f53daa None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:39.408646 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfd3dc8-fd45-4ca7-a204-ab1f92f53daa None admin] PATH_INFO: `/v3/projects/b028ff2c5aa54499a9cd429125c28fc7` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:39.409572 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfd3dc8-fd45-4ca7-a204-ab1f92f53daa None admin] RBAC: Authorizing `identity:get_project(project_id=b028ff2c5aa54499a9cd429125c28fc7)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:06:39.411028 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfd3dc8-fd45-4ca7-a204-ab1f92f53daa None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:06:39.412827 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 40/77] 10.222.0.70 () {56 vars in 1186 bytes} [Tue May 10 19:06:39 2022] GET /identity/v3/projects/b028ff2c5aa54499a9cd429125c28fc7 => generated 298 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:06:39.414050 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b275fb9c-a5f1-4822-9ea0-8054dffba169 None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:39.414337 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b275fb9c-a5f1-4822-9ea0-8054dffba169 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:39.414610 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b275fb9c-a5f1-4822-9ea0-8054dffba169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:39.432164 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-b275fb9c-a5f1-4822-9ea0-8054dffba169 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:06:39.433368 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-b275fb9c-a5f1-4822-9ea0-8054dffba169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:06:39.470099 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77f34fc-66fc-4d6b-9877-97d228be9da8 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:39.498944 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 41/78] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:06:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 19:06:39.503158 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63491ca-821e-471a-8afc-2c8a3dae9207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:39.504032 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63491ca-821e-471a-8afc-2c8a3dae9207 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:39.504327 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63491ca-821e-471a-8afc-2c8a3dae9207 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:39.504616 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63491ca-821e-471a-8afc-2c8a3dae9207 None admin] PATH_INFO: `/v3/users/6ad40793dcf0490689f2bcb5b52fd84e` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:39.505817 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63491ca-821e-471a-8afc-2c8a3dae9207 None admin] RBAC: Authorizing `identity:get_user(user_id=6ad40793dcf0490689f2bcb5b52fd84e)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:06:39.507793 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63491ca-821e-471a-8afc-2c8a3dae9207 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:06:39.509439 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 38/79] 10.222.0.70 () {56 vars in 1177 bytes} [Tue May 10 19:06:39 2022] GET /identity/v3/users/6ad40793dcf0490689f2bcb5b52fd84e => generated 275 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:06:39.510149 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db583ee-cc36-482a-aac8-aa4b9c41a273 None None] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:39.510252 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63491ca-821e-471a-8afc-2c8a3dae9207 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:39.510837 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db583ee-cc36-482a-aac8-aa4b9c41a273 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:39.511310 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db583ee-cc36-482a-aac8-aa4b9c41a273 None None] PATH_INFO: `/` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:39.513172 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 42/80] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:06:39 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:06:39.514189 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db583ee-cc36-482a-aac8-aa4b9c41a273 None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:39.612151 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63491ca-821e-471a-8afc-2c8a3dae9207 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:39.621876 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db583ee-cc36-482a-aac8-aa4b9c41a273 None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:39.645216 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c68b7b-fbb0-4821-aa9e-6d210b1bdc44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:39.646242 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c68b7b-fbb0-4821-aa9e-6d210b1bdc44 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:39.646841 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c68b7b-fbb0-4821-aa9e-6d210b1bdc44 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:39.646841 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c68b7b-fbb0-4821-aa9e-6d210b1bdc44 None admin] PATH_INFO: `/v3/users/4cc9b8973fb54520a299cde16c0ec076` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:39.648340 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c68b7b-fbb0-4821-aa9e-6d210b1bdc44 None admin] RBAC: Authorizing `identity:get_user(user_id=4cc9b8973fb54520a299cde16c0ec076)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:06:39.650110 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c68b7b-fbb0-4821-aa9e-6d210b1bdc44 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:06:39.651743 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 39/81] 10.222.0.70 () {56 vars in 1177 bytes} [Tue May 10 19:06:39 2022] GET /identity/v3/users/4cc9b8973fb54520a299cde16c0ec076 => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:06:39.652544 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c68b7b-fbb0-4821-aa9e-6d210b1bdc44 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:39.659723 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9549464-48c7-49ba-a0f8-9d362940e4c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:39.660392 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9549464-48c7-49ba-a0f8-9d362940e4c9 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:39.660709 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9549464-48c7-49ba-a0f8-9d362940e4c9 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:39.660989 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9549464-48c7-49ba-a0f8-9d362940e4c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:39.661819 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9549464-48c7-49ba-a0f8-9d362940e4c9 None admin] RBAC: Adding query filter params (role.id=5c07cf5bfbd3427db18428aa50420962, scope.project.id=b028ff2c5aa54499a9cd429125c28fc7, user.id=6ad40793dcf0490689f2bcb5b52fd84e) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:06:39.662690 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9549464-48c7-49ba-a0f8-9d362940e4c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:06:39.664149 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9549464-48c7-49ba-a0f8-9d362940e4c9 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:06:39.670330 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 43/82] 10.222.0.70 () {56 vars in 1374 bytes} [Tue May 10 19:06:39 2022] GET /identity/v3/role_assignments?user.id=6ad40793dcf0490689f2bcb5b52fd84e&scope.project.id=b028ff2c5aa54499a9cd429125c28fc7&role.id=5c07cf5bfbd3427db18428aa50420962 => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:06:39.671373 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5d997c-2c0c-45a2-a149-5c5c2d32f494 None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:39.671670 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5d997c-2c0c-45a2-a149-5c5c2d32f494 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:39.671947 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5d997c-2c0c-45a2-a149-5c5c2d32f494 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:39.707750 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-dd5d997c-2c0c-45a2-a149-5c5c2d32f494 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:06:39.709887 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-dd5d997c-2c0c-45a2-a149-5c5c2d32f494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:06:39.765339 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c68b7b-fbb0-4821-aa9e-6d210b1bdc44 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:39.802304 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e1e356-24ee-4fa8-9532-f74a6301b95c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:39.803577 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e1e356-24ee-4fa8-9532-f74a6301b95c None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:39.803865 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e1e356-24ee-4fa8-9532-f74a6301b95c None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:39.804144 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e1e356-24ee-4fa8-9532-f74a6301b95c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:39.807627 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 44/83] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:06:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 19:06:39.808750 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5d997c-2c0c-45a2-a149-5c5c2d32f494 None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:39.897625 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e1e356-24ee-4fa8-9532-f74a6301b95c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:06:39.899035 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e1e356-24ee-4fa8-9532-f74a6301b95c None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:06:39.919882 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5d997c-2c0c-45a2-a149-5c5c2d32f494 None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:39.958891 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf7c951-3aa4-4f73-97f4-fe276719a896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:39.959922 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf7c951-3aa4-4f73-97f4-fe276719a896 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:39.960700 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf7c951-3aa4-4f73-97f4-fe276719a896 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:39.961186 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf7c951-3aa4-4f73-97f4-fe276719a896 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:39.973892 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf7c951-3aa4-4f73-97f4-fe276719a896 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:06:39.981702 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application [None req-2cf7c951-3aa4-4f73-97f4-fe276719a896 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 19:06:39.981702 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:06:39.981702 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:06:39.981702 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:06:39.981702 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:06:39.981702 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:06:39.981702 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:06:39.981702 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:06:39.981702 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:06:39.981702 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:06:39.981702 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:06:39.981702 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:06:39.981702 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:06:39.981702 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:06:39.981702 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:06:39.981702 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:06:39.982812 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:06:39.982812 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:06:39.982812 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:06:39.982812 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:06:39.982812 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:06:39.982812 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:06:39.982812 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:06:39.982812 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:06:39.982812 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:06:39.982812 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:06:39.982812 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:06:39.982812 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application with Lock( May 10 19:06:39.982812 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:06:39.982812 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._enter() May 10 19:06:39.982812 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:06:39.982812 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:06:39.983687 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:06:39.983687 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.creator() May 10 19:06:39.983687 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:06:39.983687 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application created_value = creator( May 10 19:06:39.983687 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:06:39.983687 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:06:39.983687 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:06:39.983687 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:06:39.983687 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:06:39.983687 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:06:39.983687 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 19:06:39.983687 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application May 10 19:06:39.985577 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 45/84] 10.222.0.70 () {56 vars in 1099 bytes} [Tue May 10 19:06:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:06:39.991435 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf7c951-3aa4-4f73-97f4-fe276719a896 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:40.020996 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 40/85] 10.222.0.70 () {58 vars in 1282 bytes} [Tue May 10 19:06:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 19:06:40.021862 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e1e356-24ee-4fa8-9532-f74a6301b95c None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:40.117710 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf7c951-3aa4-4f73-97f4-fe276719a896 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:40.129250 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e1e356-24ee-4fa8-9532-f74a6301b95c None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:40.159976 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e81026-3165-4790-a6e9-4fe31b3fa807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:40.161008 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e81026-3165-4790-a6e9-4fe31b3fa807 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:40.161537 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e81026-3165-4790-a6e9-4fe31b3fa807 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:40.162060 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e81026-3165-4790-a6e9-4fe31b3fa807 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:40.163449 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899e8fdf-011c-4575-a45d-dca319620a33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:40.164346 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899e8fdf-011c-4575-a45d-dca319620a33 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:40.164751 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899e8fdf-011c-4575-a45d-dca319620a33 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:40.165141 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899e8fdf-011c-4575-a45d-dca319620a33 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:40.166418 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899e8fdf-011c-4575-a45d-dca319620a33 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:06:40.168489 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899e8fdf-011c-4575-a45d-dca319620a33 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:06:40.170440 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 41/86] 10.222.0.70 () {56 vars in 1108 bytes} [Tue May 10 19:06:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:06:40.171214 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899e8fdf-011c-4575-a45d-dca319620a33 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:40.239770 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e81026-3165-4790-a6e9-4fe31b3fa807 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:06:40.241515 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e81026-3165-4790-a6e9-4fe31b3fa807 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:06:40.289165 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899e8fdf-011c-4575-a45d-dca319620a33 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:40.324473 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa94d45e-2cf9-48ee-89cf-e6a8e732e588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:40.325679 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa94d45e-2cf9-48ee-89cf-e6a8e732e588 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:40.326236 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa94d45e-2cf9-48ee-89cf-e6a8e732e588 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:40.326787 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa94d45e-2cf9-48ee-89cf-e6a8e732e588 None admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:40.327681 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa94d45e-2cf9-48ee-89cf-e6a8e732e588 None admin] RBAC: Adding query filter params (name=member) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:06:40.328312 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa94d45e-2cf9-48ee-89cf-e6a8e732e588 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:06:40.330530 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa94d45e-2cf9-48ee-89cf-e6a8e732e588 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:06:40.341609 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 42/87] 10.222.0.70 () {56 vars in 1101 bytes} [Tue May 10 19:06:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:06:40.342874 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa94d45e-2cf9-48ee-89cf-e6a8e732e588 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:40.347586 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 46/88] 10.222.0.70 () {58 vars in 1282 bytes} [Tue May 10 19:06:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 19:06:40.348567 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e81026-3165-4790-a6e9-4fe31b3fa807 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:40.447716 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e81026-3165-4790-a6e9-4fe31b3fa807 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:40.468014 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa94d45e-2cf9-48ee-89cf-e6a8e732e588 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:40.482663 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2afea2-686a-4ab8-8c8b-1e006f08be00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:40.483515 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2afea2-686a-4ab8-8c8b-1e006f08be00 None admin] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:40.483899 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2afea2-686a-4ab8-8c8b-1e006f08be00 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:40.484277 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2afea2-686a-4ab8-8c8b-1e006f08be00 None admin] PATH_INFO: `/v3/users` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:40.485115 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2afea2-686a-4ab8-8c8b-1e006f08be00 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:06:40.486657 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2afea2-686a-4ab8-8c8b-1e006f08be00 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:06:40.509170 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9b4feb-2adc-4754-94cd-df6576d331fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:40.509917 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 47/89] 10.222.0.70 () {60 vars in 1132 bytes} [Tue May 10 19:06:40 2022] POST /identity/v3/users => generated 289 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:06:40.510508 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9b4feb-2adc-4754-94cd-df6576d331fa None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:40.510944 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9b4feb-2adc-4754-94cd-df6576d331fa None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:40.511120 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2afea2-686a-4ab8-8c8b-1e006f08be00 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:40.511605 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9b4feb-2adc-4754-94cd-df6576d331fa None admin] PATH_INFO: `/v3/projects/b028ff2c5aa54499a9cd429125c28fc7` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:40.513125 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9b4feb-2adc-4754-94cd-df6576d331fa None admin] RBAC: Authorizing `identity:get_project(project_id=b028ff2c5aa54499a9cd429125c28fc7)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:06:40.514850 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9b4feb-2adc-4754-94cd-df6576d331fa None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:06:40.522092 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 43/90] 10.222.0.70 () {56 vars in 1186 bytes} [Tue May 10 19:06:40 2022] GET /identity/v3/projects/b028ff2c5aa54499a9cd429125c28fc7 => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:06:40.523419 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9b4feb-2adc-4754-94cd-df6576d331fa None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:40.677093 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2afea2-686a-4ab8-8c8b-1e006f08be00 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:40.727679 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9b4feb-2adc-4754-94cd-df6576d331fa None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:40.759720 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9aa608-4918-4997-a0fa-c980e83408ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:40.760764 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9aa608-4918-4997-a0fa-c980e83408ad None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:40.761041 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9aa608-4918-4997-a0fa-c980e83408ad None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:40.761321 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9aa608-4918-4997-a0fa-c980e83408ad None admin] PATH_INFO: `/v3/users/6ad40793dcf0490689f2bcb5b52fd84e` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:40.762867 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9aa608-4918-4997-a0fa-c980e83408ad None admin] RBAC: Authorizing `identity:get_user(user_id=6ad40793dcf0490689f2bcb5b52fd84e)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:06:40.764349 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9aa608-4918-4997-a0fa-c980e83408ad None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:06:40.766012 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 48/91] 10.222.0.70 () {56 vars in 1177 bytes} [Tue May 10 19:06:40 2022] GET /identity/v3/users/6ad40793dcf0490689f2bcb5b52fd84e => generated 275 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:06:40.766253 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c43414-9623-47a6-8b03-eb0f0f2aad13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:40.766777 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9aa608-4918-4997-a0fa-c980e83408ad None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:40.767599 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c43414-9623-47a6-8b03-eb0f0f2aad13 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:40.768027 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c43414-9623-47a6-8b03-eb0f0f2aad13 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:40.768517 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c43414-9623-47a6-8b03-eb0f0f2aad13 None admin] PATH_INFO: `/v3/projects/b028ff2c5aa54499a9cd429125c28fc7` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:40.770830 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c43414-9623-47a6-8b03-eb0f0f2aad13 None admin] RBAC: Authorizing `identity:get_project(project_id=b028ff2c5aa54499a9cd429125c28fc7)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:06:40.773512 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c43414-9623-47a6-8b03-eb0f0f2aad13 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:06:40.775845 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 44/92] 10.222.0.70 () {56 vars in 1186 bytes} [Tue May 10 19:06:40 2022] GET /identity/v3/projects/b028ff2c5aa54499a9cd429125c28fc7 => generated 298 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:06:40.776981 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c43414-9623-47a6-8b03-eb0f0f2aad13 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:40.883563 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9aa608-4918-4997-a0fa-c980e83408ad None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:40.891279 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c43414-9623-47a6-8b03-eb0f0f2aad13 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:40.918611 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6b819a-448b-42b1-b6a7-852611d8e2c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:40.919284 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6b819a-448b-42b1-b6a7-852611d8e2c8 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:40.919582 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6b819a-448b-42b1-b6a7-852611d8e2c8 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:40.919853 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6b819a-448b-42b1-b6a7-852611d8e2c8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:40.920719 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6b819a-448b-42b1-b6a7-852611d8e2c8 None admin] RBAC: Adding query filter params (role.id=49187695e1bf4c15980bb68c83ca61de, scope.project.id=b028ff2c5aa54499a9cd429125c28fc7, user.id=6ad40793dcf0490689f2bcb5b52fd84e) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:06:40.921257 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6b819a-448b-42b1-b6a7-852611d8e2c8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:06:40.922491 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6b819a-448b-42b1-b6a7-852611d8e2c8 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:06:40.927921 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2794d939-7f11-4863-b5e2-78d5b57139cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:40.928489 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 49/93] 10.222.0.70 () {56 vars in 1374 bytes} [Tue May 10 19:06:40 2022] GET /identity/v3/role_assignments?user.id=6ad40793dcf0490689f2bcb5b52fd84e&scope.project.id=b028ff2c5aa54499a9cd429125c28fc7&role.id=49187695e1bf4c15980bb68c83ca61de => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:06:40.929449 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2794d939-7f11-4863-b5e2-78d5b57139cb None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:40.929645 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6b819a-448b-42b1-b6a7-852611d8e2c8 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:40.930113 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2794d939-7f11-4863-b5e2-78d5b57139cb None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:40.930653 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2794d939-7f11-4863-b5e2-78d5b57139cb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:41.003294 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2794d939-7f11-4863-b5e2-78d5b57139cb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:06:41.004986 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2794d939-7f11-4863-b5e2-78d5b57139cb None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:06:41.044728 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6b819a-448b-42b1-b6a7-852611d8e2c8 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:41.079964 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85593288-949c-4d49-af41-ff6793e4170e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:41.080678 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85593288-949c-4d49-af41-ff6793e4170e None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:41.080968 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85593288-949c-4d49-af41-ff6793e4170e None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:41.081248 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85593288-949c-4d49-af41-ff6793e4170e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:41.082098 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85593288-949c-4d49-af41-ff6793e4170e None admin] RBAC: Adding query filter params (role.id=634ba284303b4626b5a0402772c68f5c, scope.project.id=b028ff2c5aa54499a9cd429125c28fc7, user.id=4cc9b8973fb54520a299cde16c0ec076) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:06:41.082416 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85593288-949c-4d49-af41-ff6793e4170e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:06:41.084288 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85593288-949c-4d49-af41-ff6793e4170e None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:06:41.091168 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 50/94] 10.222.0.70 () {56 vars in 1374 bytes} [Tue May 10 19:06:40 2022] GET /identity/v3/role_assignments?user.id=4cc9b8973fb54520a299cde16c0ec076&scope.project.id=b028ff2c5aa54499a9cd429125c28fc7&role.id=634ba284303b4626b5a0402772c68f5c => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:06:41.111320 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 45/95] 10.222.0.70 () {58 vars in 1282 bytes} [Tue May 10 19:06:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 19:06:41.117798 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85593288-949c-4d49-af41-ff6793e4170e None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:41.252183 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85593288-949c-4d49-af41-ff6793e4170e None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:41.290708 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1b441a-972e-4f50-b1bb-7919c0a4dc09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:41.291606 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1b441a-972e-4f50-b1bb-7919c0a4dc09 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:41.291895 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1b441a-972e-4f50-b1bb-7919c0a4dc09 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:41.292179 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1b441a-972e-4f50-b1bb-7919c0a4dc09 None admin] PATH_INFO: `/v3/projects/6591932d24eb4c8a89c48619ec1c6c2e` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:41.293470 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1b441a-972e-4f50-b1bb-7919c0a4dc09 None admin] RBAC: Authorizing `identity:get_project(project_id=6591932d24eb4c8a89c48619ec1c6c2e)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:06:41.294985 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1b441a-972e-4f50-b1bb-7919c0a4dc09 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:06:41.296826 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 51/96] 10.222.0.70 () {56 vars in 1186 bytes} [Tue May 10 19:06:41 2022] GET /identity/v3/projects/6591932d24eb4c8a89c48619ec1c6c2e => generated 312 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:06:41.303142 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2794d939-7f11-4863-b5e2-78d5b57139cb None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:41.426805 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2794d939-7f11-4863-b5e2-78d5b57139cb None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:41.467188 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899cd1f0-0be6-4ba5-9fb1-cb94e374d218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:41.468202 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899cd1f0-0be6-4ba5-9fb1-cb94e374d218 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:41.468736 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899cd1f0-0be6-4ba5-9fb1-cb94e374d218 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:41.469208 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899cd1f0-0be6-4ba5-9fb1-cb94e374d218 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:41.470235 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899cd1f0-0be6-4ba5-9fb1-cb94e374d218 None admin] RBAC: Adding query filter params (role.id=5c07cf5bfbd3427db18428aa50420962, scope.project.id=6591932d24eb4c8a89c48619ec1c6c2e, user.id=6ad40793dcf0490689f2bcb5b52fd84e) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:06:41.470741 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899cd1f0-0be6-4ba5-9fb1-cb94e374d218 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:06:41.472386 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899cd1f0-0be6-4ba5-9fb1-cb94e374d218 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:06:41.487518 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 46/97] 10.222.0.70 () {56 vars in 1374 bytes} [Tue May 10 19:06:41 2022] GET /identity/v3/role_assignments?user.id=6ad40793dcf0490689f2bcb5b52fd84e&scope.project.id=6591932d24eb4c8a89c48619ec1c6c2e&role.id=5c07cf5bfbd3427db18428aa50420962 => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:06:42.533217 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832b4649-cdde-4195-8bed-ebd37377f637 None None] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:42.533716 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832b4649-cdde-4195-8bed-ebd37377f637 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:42.533789 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832b4649-cdde-4195-8bed-ebd37377f637 None None] PATH_INFO: `/` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:42.535479 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 52/98] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:06:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:06:42.545879 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda561dd-f830-460d-ba92-0a9dc3c0c64e None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:42.546319 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda561dd-f830-460d-ba92-0a9dc3c0c64e None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:42.546518 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda561dd-f830-460d-ba92-0a9dc3c0c64e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:42.565824 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-bda561dd-f830-460d-ba92-0a9dc3c0c64e None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:06:42.567029 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-bda561dd-f830-460d-ba92-0a9dc3c0c64e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:06:42.642615 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 47/99] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:06:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 19:06:42.677398 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832b4649-cdde-4195-8bed-ebd37377f637 None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:42.794168 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832b4649-cdde-4195-8bed-ebd37377f637 None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:42.836730 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7909b8b5-62a8-4c9e-87e0-3a985a189001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:42.837550 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7909b8b5-62a8-4c9e-87e0-3a985a189001 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:42.837840 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7909b8b5-62a8-4c9e-87e0-3a985a189001 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:42.838122 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7909b8b5-62a8-4c9e-87e0-3a985a189001 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:42.853316 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7909b8b5-62a8-4c9e-87e0-3a985a189001 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:06:42.860976 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application [None req-7909b8b5-62a8-4c9e-87e0-3a985a189001 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 19:06:42.860976 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:06:42.860976 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:06:42.860976 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:06:42.860976 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:06:42.860976 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:06:42.860976 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:06:42.860976 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:06:42.860976 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:06:42.860976 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:06:42.860976 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:06:42.860976 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:06:42.860976 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:06:42.860976 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:06:42.860976 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:06:42.860976 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:06:42.861836 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:06:42.861836 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:06:42.861836 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:06:42.861836 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:06:42.861836 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:06:42.861836 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:06:42.861836 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:06:42.861836 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:06:42.861836 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:06:42.861836 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:06:42.861836 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:06:42.861836 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application with Lock( May 10 19:06:42.861836 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:06:42.861836 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._enter() May 10 19:06:42.861836 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:06:42.861836 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:06:42.863018 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:06:42.863018 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.creator() May 10 19:06:42.863018 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:06:42.863018 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application created_value = creator( May 10 19:06:42.863018 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:06:42.863018 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:06:42.863018 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:06:42.863018 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:06:42.863018 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:06:42.863018 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:06:42.863018 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 19:06:42.863018 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application May 10 19:06:42.863018 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 53/100] 10.222.0.70 () {56 vars in 1099 bytes} [Tue May 10 19:06:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:06:42.868487 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda561dd-f830-460d-ba92-0a9dc3c0c64e None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:42.986344 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda561dd-f830-460d-ba92-0a9dc3c0c64e None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:43.024348 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac73dbc2-6513-4529-9e50-e98a7392664e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:43.025053 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac73dbc2-6513-4529-9e50-e98a7392664e None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:43.025345 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac73dbc2-6513-4529-9e50-e98a7392664e None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:43.025627 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac73dbc2-6513-4529-9e50-e98a7392664e None admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:43.026373 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac73dbc2-6513-4529-9e50-e98a7392664e None admin] RBAC: Adding query filter params (name=member) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:06:43.026684 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac73dbc2-6513-4529-9e50-e98a7392664e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:06:43.028074 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac73dbc2-6513-4529-9e50-e98a7392664e None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:06:43.036351 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 48/101] 10.222.0.70 () {56 vars in 1101 bytes} [Tue May 10 19:06:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:06:43.042301 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7909b8b5-62a8-4c9e-87e0-3a985a189001 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:43.143621 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7909b8b5-62a8-4c9e-87e0-3a985a189001 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:43.184150 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004d754f-df4a-43ac-9e1f-539ac9f04962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:43.185101 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004d754f-df4a-43ac-9e1f-539ac9f04962 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:43.185390 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004d754f-df4a-43ac-9e1f-539ac9f04962 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:43.185669 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004d754f-df4a-43ac-9e1f-539ac9f04962 None admin] PATH_INFO: `/v3/users/6ad40793dcf0490689f2bcb5b52fd84e` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:43.187017 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004d754f-df4a-43ac-9e1f-539ac9f04962 None admin] RBAC: Authorizing `identity:get_user(user_id=6ad40793dcf0490689f2bcb5b52fd84e)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:06:43.188534 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004d754f-df4a-43ac-9e1f-539ac9f04962 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:06:43.190545 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 54/102] 10.222.0.70 () {56 vars in 1177 bytes} [Tue May 10 19:06:43 2022] GET /identity/v3/users/6ad40793dcf0490689f2bcb5b52fd84e => generated 275 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:06:43.196449 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac73dbc2-6513-4529-9e50-e98a7392664e None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:43.299950 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac73dbc2-6513-4529-9e50-e98a7392664e None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:43.339908 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77cc87d-eb2d-4676-af6e-d4a3a29a1520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:43.340806 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77cc87d-eb2d-4676-af6e-d4a3a29a1520 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:43.341095 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77cc87d-eb2d-4676-af6e-d4a3a29a1520 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:43.341374 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77cc87d-eb2d-4676-af6e-d4a3a29a1520 None admin] PATH_INFO: `/v3/projects/b028ff2c5aa54499a9cd429125c28fc7` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:43.342596 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77cc87d-eb2d-4676-af6e-d4a3a29a1520 None admin] RBAC: Authorizing `identity:get_project(project_id=b028ff2c5aa54499a9cd429125c28fc7)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:06:43.344059 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77cc87d-eb2d-4676-af6e-d4a3a29a1520 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:06:43.346109 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 49/103] 10.222.0.70 () {56 vars in 1186 bytes} [Tue May 10 19:06:43 2022] GET /identity/v3/projects/b028ff2c5aa54499a9cd429125c28fc7 => generated 298 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:06:43.351997 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004d754f-df4a-43ac-9e1f-539ac9f04962 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:43.464016 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004d754f-df4a-43ac-9e1f-539ac9f04962 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:43.499997 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af96d15-39c9-4062-a473-48ea760d84c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:43.500929 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af96d15-39c9-4062-a473-48ea760d84c9 None admin] REQUEST_METHOD: `PUT` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:43.501216 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af96d15-39c9-4062-a473-48ea760d84c9 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:43.501503 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af96d15-39c9-4062-a473-48ea760d84c9 None admin] PATH_INFO: `/v3/projects/b028ff2c5aa54499a9cd429125c28fc7/users/6ad40793dcf0490689f2bcb5b52fd84e/roles/5c07cf5bfbd3427db18428aa50420962` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:43.506238 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af96d15-39c9-4062-a473-48ea760d84c9 None admin] RBAC: Authorizing `identity:create_grant(project_id=b028ff2c5aa54499a9cd429125c28fc7, user_id=6ad40793dcf0490689f2bcb5b52fd84e, role_id=5c07cf5bfbd3427db18428aa50420962)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:06:43.507710 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af96d15-39c9-4062-a473-48ea760d84c9 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:06:43.528668 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 55/104] 10.222.0.70 () {58 vars in 1439 bytes} [Tue May 10 19:06:43 2022] PUT /identity/v3/projects/b028ff2c5aa54499a9cd429125c28fc7/users/6ad40793dcf0490689f2bcb5b52fd84e/roles/5c07cf5bfbd3427db18428aa50420962 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:06:44.592869 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e576b5-99cc-4bd5-b9e8-890678bfdefd None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:44.593364 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e576b5-99cc-4bd5-b9e8-890678bfdefd None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:44.593438 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e576b5-99cc-4bd5-b9e8-890678bfdefd None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:44.594795 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 50/105] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:06:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:06:44.600484 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a6dd40-013e-4b8e-b634-bfea2797c6d9 None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:44.600929 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a6dd40-013e-4b8e-b634-bfea2797c6d9 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:44.601116 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a6dd40-013e-4b8e-b634-bfea2797c6d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:44.622786 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-88a6dd40-013e-4b8e-b634-bfea2797c6d9 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:06:44.623991 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-88a6dd40-013e-4b8e-b634-bfea2797c6d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:06:44.700552 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 56/106] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:06:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 19:06:44.724879 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e576b5-99cc-4bd5-b9e8-890678bfdefd None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:44.834911 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e576b5-99cc-4bd5-b9e8-890678bfdefd None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:44.874618 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f474637-f733-435c-91b0-a421888ef679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:44.875342 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f474637-f733-435c-91b0-a421888ef679 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:44.875629 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f474637-f733-435c-91b0-a421888ef679 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:44.875908 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f474637-f733-435c-91b0-a421888ef679 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:44.878397 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f474637-f733-435c-91b0-a421888ef679 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:06:44.879863 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f474637-f733-435c-91b0-a421888ef679 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:06:44.882065 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 51/107] 10.222.0.70 () {56 vars in 1108 bytes} [Tue May 10 19:06:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:06:44.887615 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a6dd40-013e-4b8e-b634-bfea2797c6d9 None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:44.907997 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5aff56-63d2-457c-a19a-e819c4e6737f None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:44.907997 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5aff56-63d2-457c-a19a-e819c4e6737f None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:44.907997 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5aff56-63d2-457c-a19a-e819c4e6737f None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:44.908721 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 52/108] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:06:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:06:44.924804 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffac5255-d9d2-4592-8c86-74f6c3f21901 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:44.925396 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffac5255-d9d2-4592-8c86-74f6c3f21901 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:44.925878 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffac5255-d9d2-4592-8c86-74f6c3f21901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:44.966360 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-ffac5255-d9d2-4592-8c86-74f6c3f21901 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:06:44.967562 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-ffac5255-d9d2-4592-8c86-74f6c3f21901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:06:45.036054 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a6dd40-013e-4b8e-b634-bfea2797c6d9 None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:45.070647 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6c5b58-c150-4903-ae49-81893da1d47a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:45.071320 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6c5b58-c150-4903-ae49-81893da1d47a None admin] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:45.071610 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6c5b58-c150-4903-ae49-81893da1d47a None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:45.071891 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6c5b58-c150-4903-ae49-81893da1d47a None admin] PATH_INFO: `/v3/projects` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:45.072720 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6c5b58-c150-4903-ae49-81893da1d47a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:06:45.074179 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6c5b58-c150-4903-ae49-81893da1d47a None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:06:45.100809 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 57/109] 10.222.0.70 () {60 vars in 1141 bytes} [Tue May 10 19:06:44 2022] POST /identity/v3/projects => generated 302 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:06:45.102223 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08585de4-ae29-4564-9c67-0f4e417ece2a None None] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:45.102617 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08585de4-ae29-4564-9c67-0f4e417ece2a None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:45.102906 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08585de4-ae29-4564-9c67-0f4e417ece2a None None] PATH_INFO: `/` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:45.109441 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 58/110] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:06:45 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:06:45.116534 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581d3834-f6e2-4fd8-b986-adf8bd8f6e15 None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:45.116932 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581d3834-f6e2-4fd8-b986-adf8bd8f6e15 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:45.117227 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581d3834-f6e2-4fd8-b986-adf8bd8f6e15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:45.127127 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 53/111] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:06:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 19:06:45.145634 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-581d3834-f6e2-4fd8-b986-adf8bd8f6e15 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:06:45.147263 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-581d3834-f6e2-4fd8-b986-adf8bd8f6e15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:06:45.161734 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffac5255-d9d2-4592-8c86-74f6c3f21901 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:45.274308 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 59/112] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:06:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 19:06:45.276095 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2ee25f-1f3c-436a-a16d-6707d17f7d93 None None] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:45.276591 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2ee25f-1f3c-436a-a16d-6707d17f7d93 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:45.277045 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2ee25f-1f3c-436a-a16d-6707d17f7d93 None None] PATH_INFO: `/` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:45.279252 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 60/113] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:06:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:06:45.285628 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f312d56-1af4-41c4-befe-02c5fb938da2 None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:45.286186 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f312d56-1af4-41c4-befe-02c5fb938da2 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:45.286672 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f312d56-1af4-41c4-befe-02c5fb938da2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:45.307259 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-7f312d56-1af4-41c4-befe-02c5fb938da2 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:06:45.309417 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-7f312d56-1af4-41c4-befe-02c5fb938da2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:06:45.365710 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffac5255-d9d2-4592-8c86-74f6c3f21901 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:45.401359 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 61/114] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:06:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 19:06:45.402606 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f312d56-1af4-41c4-befe-02c5fb938da2 None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:45.420132 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80c3db4-159e-4dde-a7a2-0ae4b73f9060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:45.421087 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80c3db4-159e-4dde-a7a2-0ae4b73f9060 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:45.421375 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80c3db4-159e-4dde-a7a2-0ae4b73f9060 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:45.421681 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80c3db4-159e-4dde-a7a2-0ae4b73f9060 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:45.444770 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80c3db4-159e-4dde-a7a2-0ae4b73f9060 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:06:45.453200 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-b80c3db4-159e-4dde-a7a2-0ae4b73f9060 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 19:06:45.453200 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:06:45.453200 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:06:45.453200 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:06:45.453200 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:06:45.453200 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:06:45.453200 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:06:45.453200 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:06:45.453200 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:06:45.453200 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:06:45.453200 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:06:45.453200 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:06:45.453200 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:06:45.453200 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:06:45.453200 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:06:45.453200 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:06:45.454186 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:06:45.454186 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:06:45.454186 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:06:45.454186 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:06:45.454186 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:06:45.454186 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:06:45.454186 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:06:45.454186 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:06:45.454186 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:06:45.454186 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:06:45.454186 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:06:45.454186 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( May 10 19:06:45.454186 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:06:45.454186 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() May 10 19:06:45.454186 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:06:45.454186 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:06:45.455020 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:06:45.455020 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() May 10 19:06:45.455020 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:06:45.455020 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( May 10 19:06:45.455020 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:06:45.455020 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:06:45.455020 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:06:45.455020 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:06:45.455020 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:06:45.455020 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:06:45.455020 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 19:06:45.455020 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:06:45.457609 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 54/115] 10.222.0.70 () {56 vars in 1096 bytes} [Tue May 10 19:06:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:06:45.459073 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80c3db4-159e-4dde-a7a2-0ae4b73f9060 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:45.521324 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f312d56-1af4-41c4-befe-02c5fb938da2 None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:45.558534 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5fa5b8-422c-47b8-b98b-b732ec0b1b6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:45.560791 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5fa5b8-422c-47b8-b98b-b732ec0b1b6d None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:45.560791 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5fa5b8-422c-47b8-b98b-b732ec0b1b6d None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:45.560791 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5fa5b8-422c-47b8-b98b-b732ec0b1b6d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:45.570251 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80c3db4-159e-4dde-a7a2-0ae4b73f9060 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:45.576953 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5fa5b8-422c-47b8-b98b-b732ec0b1b6d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:06:45.587443 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application [None req-ad5fa5b8-422c-47b8-b98b-b732ec0b1b6d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 19:06:45.587443 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:06:45.587443 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:06:45.587443 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:06:45.587443 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:06:45.587443 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:06:45.587443 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:06:45.587443 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:06:45.587443 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:06:45.587443 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:06:45.587443 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:06:45.587443 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:06:45.587443 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:06:45.587443 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:06:45.587443 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:06:45.587443 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:06:45.588763 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:06:45.588763 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:06:45.588763 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:06:45.588763 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:06:45.588763 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:06:45.588763 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:06:45.588763 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:06:45.588763 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:06:45.588763 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:06:45.588763 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:06:45.588763 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:06:45.588763 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application with Lock( May 10 19:06:45.588763 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:06:45.588763 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._enter() May 10 19:06:45.588763 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:06:45.588763 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:06:45.589579 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:06:45.589579 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.creator() May 10 19:06:45.589579 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:06:45.589579 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application created_value = creator( May 10 19:06:45.589579 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:06:45.589579 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:06:45.589579 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:06:45.589579 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:06:45.589579 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:06:45.589579 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:06:45.589579 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 19:06:45.589579 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application May 10 19:06:45.589579 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 62/116] 10.222.0.70 () {56 vars in 1114 bytes} [Tue May 10 19:06:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:06:45.589579 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5fa5b8-422c-47b8-b98b-b732ec0b1b6d None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:45.616983 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cde0961-9124-401c-b330-23b370f6a49f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:45.618502 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cde0961-9124-401c-b330-23b370f6a49f None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:45.619032 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cde0961-9124-401c-b330-23b370f6a49f None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:45.619612 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cde0961-9124-401c-b330-23b370f6a49f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:45.631510 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cde0961-9124-401c-b330-23b370f6a49f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:06:45.639870 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-6cde0961-9124-401c-b330-23b370f6a49f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 10 19:06:45.639870 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:06:45.639870 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:06:45.639870 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:06:45.639870 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:06:45.639870 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:06:45.639870 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:06:45.639870 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:06:45.639870 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:06:45.639870 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:06:45.639870 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:06:45.639870 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:06:45.639870 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:06:45.639870 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:06:45.639870 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:06:45.639870 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:06:45.641379 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:06:45.641379 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:06:45.641379 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:06:45.641379 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:06:45.641379 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:06:45.641379 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:06:45.641379 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:06:45.641379 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:06:45.641379 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:06:45.641379 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:06:45.641379 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:06:45.641379 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( May 10 19:06:45.641379 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:06:45.641379 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() May 10 19:06:45.641379 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:06:45.641379 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:06:45.642153 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:06:45.642153 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() May 10 19:06:45.642153 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:06:45.642153 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( May 10 19:06:45.642153 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:06:45.642153 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:06:45.642153 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:06:45.642153 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:06:45.642153 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:06:45.642153 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:06:45.642153 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 10 19:06:45.642153 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:06:45.644441 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 55/117] 10.222.0.70 () {56 vars in 1099 bytes} [Tue May 10 19:06:45 2022] GET /identity/v3/roles/reader => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:06:45.645562 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cde0961-9124-401c-b330-23b370f6a49f None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:45.699570 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5fa5b8-422c-47b8-b98b-b732ec0b1b6d None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:45.734371 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0989e5e6-a830-4ca4-af73-5427ab63f903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:45.735344 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0989e5e6-a830-4ca4-af73-5427ab63f903 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:45.735639 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0989e5e6-a830-4ca4-af73-5427ab63f903 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:45.735922 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0989e5e6-a830-4ca4-af73-5427ab63f903 None admin] PATH_INFO: `/v3/roles` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:45.736705 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0989e5e6-a830-4ca4-af73-5427ab63f903 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:06:45.737016 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0989e5e6-a830-4ca4-af73-5427ab63f903 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:06:45.738424 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0989e5e6-a830-4ca4-af73-5427ab63f903 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:06:45.749996 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 63/118] 10.222.0.70 () {56 vars in 1099 bytes} [Tue May 10 19:06:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:06:45.750631 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0989e5e6-a830-4ca4-af73-5427ab63f903 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:45.751829 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cde0961-9124-401c-b330-23b370f6a49f None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:45.788139 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab48d4d-3aeb-47a2-be38-b16f938b92af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:45.789196 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab48d4d-3aeb-47a2-be38-b16f938b92af None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:45.789708 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab48d4d-3aeb-47a2-be38-b16f938b92af None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:45.790282 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab48d4d-3aeb-47a2-be38-b16f938b92af None admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:45.791237 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab48d4d-3aeb-47a2-be38-b16f938b92af None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:06:45.791753 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab48d4d-3aeb-47a2-be38-b16f938b92af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:06:45.793369 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab48d4d-3aeb-47a2-be38-b16f938b92af None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:06:45.801918 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 56/119] 10.222.0.70 () {56 vars in 1111 bytes} [Tue May 10 19:06:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:06:45.803727 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3c1c79-ea34-4a2b-91d7-aa2e9a1009ca None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:45.804235 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3c1c79-ea34-4a2b-91d7-aa2e9a1009ca None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:45.804773 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3c1c79-ea34-4a2b-91d7-aa2e9a1009ca None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:45.806226 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 57/120] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:06:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:06:45.807436 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3c1c79-ea34-4a2b-91d7-aa2e9a1009ca None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:45.869054 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0989e5e6-a830-4ca4-af73-5427ab63f903 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:45.905617 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f17593-3d82-4b39-81a8-c44792c0a0f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:45.906305 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f17593-3d82-4b39-81a8-c44792c0a0f2 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:45.906592 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f17593-3d82-4b39-81a8-c44792c0a0f2 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:45.906921 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f17593-3d82-4b39-81a8-c44792c0a0f2 None admin] PATH_INFO: `/v3/roles` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:45.908121 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f17593-3d82-4b39-81a8-c44792c0a0f2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:06:45.908450 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f17593-3d82-4b39-81a8-c44792c0a0f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:06:45.910121 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f17593-3d82-4b39-81a8-c44792c0a0f2 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:06:45.921370 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 64/121] 10.222.0.70 () {56 vars in 1101 bytes} [Tue May 10 19:06:45 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:06:45.921668 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3c1c79-ea34-4a2b-91d7-aa2e9a1009ca None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:45.922157 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f17593-3d82-4b39-81a8-c44792c0a0f2 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:45.964749 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6efdb4-016f-4207-bdb5-094453d9bbf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:45.965909 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6efdb4-016f-4207-bdb5-094453d9bbf9 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:45.966414 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6efdb4-016f-4207-bdb5-094453d9bbf9 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:45.966899 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6efdb4-016f-4207-bdb5-094453d9bbf9 None admin] PATH_INFO: `/v3/users/4cc9b8973fb54520a299cde16c0ec076` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:45.968361 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6efdb4-016f-4207-bdb5-094453d9bbf9 None admin] RBAC: Authorizing `identity:get_user(user_id=4cc9b8973fb54520a299cde16c0ec076)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:06:45.970071 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6efdb4-016f-4207-bdb5-094453d9bbf9 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:06:45.972312 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 58/122] 10.222.0.70 () {56 vars in 1177 bytes} [Tue May 10 19:06:45 2022] GET /identity/v3/users/4cc9b8973fb54520a299cde16c0ec076 => generated 247 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:06:45.973807 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dab810-bedc-4704-824c-023a99299d1e None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:45.974340 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dab810-bedc-4704-824c-023a99299d1e None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:45.974860 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dab810-bedc-4704-824c-023a99299d1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:45.994841 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-f2dab810-bedc-4704-824c-023a99299d1e None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:06:45.996673 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-f2dab810-bedc-4704-824c-023a99299d1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:06:46.044923 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f17593-3d82-4b39-81a8-c44792c0a0f2 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:46.079276 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846861e1-90c2-4976-b4b4-e63df8b42c0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:46.080629 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846861e1-90c2-4976-b4b4-e63df8b42c0a None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:46.081141 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846861e1-90c2-4976-b4b4-e63df8b42c0a None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:46.081678 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846861e1-90c2-4976-b4b4-e63df8b42c0a None admin] PATH_INFO: `/v3/users/6ad40793dcf0490689f2bcb5b52fd84e` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:46.083378 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846861e1-90c2-4976-b4b4-e63df8b42c0a None admin] RBAC: Authorizing `identity:get_user(user_id=6ad40793dcf0490689f2bcb5b52fd84e)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:06:46.084311 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 59/123] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:06:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 19:06:46.085062 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dab810-bedc-4704-824c-023a99299d1e None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:46.086337 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846861e1-90c2-4976-b4b4-e63df8b42c0a None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:06:46.088517 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 65/124] 10.222.0.70 () {56 vars in 1177 bytes} [Tue May 10 19:06:45 2022] GET /identity/v3/users/6ad40793dcf0490689f2bcb5b52fd84e => generated 275 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:06:46.089560 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846861e1-90c2-4976-b4b4-e63df8b42c0a None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:46.199486 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846861e1-90c2-4976-b4b4-e63df8b42c0a None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:46.206702 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dab810-bedc-4704-824c-023a99299d1e None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:46.234163 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2756eee-cf55-47a8-a30f-a6d86cd1d7a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:46.235410 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2756eee-cf55-47a8-a30f-a6d86cd1d7a8 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:46.235919 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2756eee-cf55-47a8-a30f-a6d86cd1d7a8 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:46.236395 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2756eee-cf55-47a8-a30f-a6d86cd1d7a8 None admin] PATH_INFO: `/v3/projects/b028ff2c5aa54499a9cd429125c28fc7` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:46.237892 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2756eee-cf55-47a8-a30f-a6d86cd1d7a8 None admin] RBAC: Authorizing `identity:get_project(project_id=b028ff2c5aa54499a9cd429125c28fc7)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:06:46.239620 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2756eee-cf55-47a8-a30f-a6d86cd1d7a8 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:06:46.241988 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 66/125] 10.222.0.70 () {56 vars in 1186 bytes} [Tue May 10 19:06:46 2022] GET /identity/v3/projects/b028ff2c5aa54499a9cd429125c28fc7 => generated 298 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:06:46.243001 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2756eee-cf55-47a8-a30f-a6d86cd1d7a8 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:46.252246 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613572a3-53c8-42d2-90a7-f0a973624437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:46.253619 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613572a3-53c8-42d2-90a7-f0a973624437 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:46.253918 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613572a3-53c8-42d2-90a7-f0a973624437 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:46.254203 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613572a3-53c8-42d2-90a7-f0a973624437 None admin] PATH_INFO: `/v3/users/3be5d85ba1164758a27aba26310f23e6` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:46.272842 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613572a3-53c8-42d2-90a7-f0a973624437 None admin] RBAC: Authorizing `identity:get_user(user_id=3be5d85ba1164758a27aba26310f23e6)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:06:46.274619 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613572a3-53c8-42d2-90a7-f0a973624437 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:06:46.276591 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 60/126] 10.222.0.70 () {56 vars in 1177 bytes} [Tue May 10 19:06:46 2022] GET /identity/v3/users/3be5d85ba1164758a27aba26310f23e6 => generated 289 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:06:46.277588 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613572a3-53c8-42d2-90a7-f0a973624437 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:46.372334 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2756eee-cf55-47a8-a30f-a6d86cd1d7a8 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:46.382104 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613572a3-53c8-42d2-90a7-f0a973624437 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:46.408248 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca964f2-44a7-457e-a340-91b0457eea9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:46.409166 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca964f2-44a7-457e-a340-91b0457eea9b None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:46.409455 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca964f2-44a7-457e-a340-91b0457eea9b None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:46.409735 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca964f2-44a7-457e-a340-91b0457eea9b None admin] PATH_INFO: `/v3/projects/b028ff2c5aa54499a9cd429125c28fc7` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:46.410932 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca964f2-44a7-457e-a340-91b0457eea9b None admin] RBAC: Authorizing `identity:get_project(project_id=b028ff2c5aa54499a9cd429125c28fc7)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:06:46.412614 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca964f2-44a7-457e-a340-91b0457eea9b None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:06:46.414327 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 67/127] 10.222.0.70 () {56 vars in 1186 bytes} [Tue May 10 19:06:46 2022] GET /identity/v3/projects/b028ff2c5aa54499a9cd429125c28fc7 => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:06:46.414884 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca964f2-44a7-457e-a340-91b0457eea9b None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:46.425675 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba5f90b-8467-4a8f-8cc8-479671ec8a17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:46.427077 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba5f90b-8467-4a8f-8cc8-479671ec8a17 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:46.427874 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba5f90b-8467-4a8f-8cc8-479671ec8a17 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:46.428369 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba5f90b-8467-4a8f-8cc8-479671ec8a17 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:46.441828 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba5f90b-8467-4a8f-8cc8-479671ec8a17 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:06:46.452926 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-6ba5f90b-8467-4a8f-8cc8-479671ec8a17 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 19:06:46.452926 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:06:46.452926 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:06:46.452926 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:06:46.452926 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:06:46.452926 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:06:46.452926 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:06:46.452926 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:06:46.452926 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:06:46.452926 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:06:46.452926 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:06:46.452926 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:06:46.452926 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:06:46.452926 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:06:46.452926 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:06:46.452926 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:06:46.453824 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:06:46.453824 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:06:46.453824 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:06:46.453824 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:06:46.453824 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:06:46.453824 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:06:46.453824 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:06:46.453824 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:06:46.453824 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:06:46.453824 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:06:46.453824 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:06:46.453824 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( May 10 19:06:46.453824 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:06:46.453824 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() May 10 19:06:46.453824 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:06:46.453824 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:06:46.454614 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:06:46.454614 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() May 10 19:06:46.454614 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:06:46.454614 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( May 10 19:06:46.454614 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:06:46.454614 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:06:46.454614 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:06:46.454614 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:06:46.454614 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:06:46.454614 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:06:46.454614 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 19:06:46.454614 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:06:46.457158 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 61/128] 10.222.0.70 () {56 vars in 1099 bytes} [Tue May 10 19:06:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:06:46.458885 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba5f90b-8467-4a8f-8cc8-479671ec8a17 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:46.530657 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca964f2-44a7-457e-a340-91b0457eea9b None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:46.561473 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba5f90b-8467-4a8f-8cc8-479671ec8a17 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:46.575238 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257a2679-15db-4951-b746-a86626ca09f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:46.576691 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257a2679-15db-4951-b746-a86626ca09f8 None admin] REQUEST_METHOD: `PUT` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:46.577608 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257a2679-15db-4951-b746-a86626ca09f8 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:46.578073 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257a2679-15db-4951-b746-a86626ca09f8 None admin] PATH_INFO: `/v3/projects/b028ff2c5aa54499a9cd429125c28fc7/users/4cc9b8973fb54520a299cde16c0ec076/roles/634ba284303b4626b5a0402772c68f5c` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:46.581275 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257a2679-15db-4951-b746-a86626ca09f8 None admin] RBAC: Authorizing `identity:create_grant(project_id=b028ff2c5aa54499a9cd429125c28fc7, user_id=4cc9b8973fb54520a299cde16c0ec076, role_id=634ba284303b4626b5a0402772c68f5c)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:06:46.583243 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257a2679-15db-4951-b746-a86626ca09f8 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:06:46.602415 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 68/129] 10.222.0.70 () {58 vars in 1439 bytes} [Tue May 10 19:06:46 2022] PUT /identity/v3/projects/b028ff2c5aa54499a9cd429125c28fc7/users/4cc9b8973fb54520a299cde16c0ec076/roles/634ba284303b4626b5a0402772c68f5c => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:06:46.608524 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9a337c-c9fb-404b-b99e-8f56234eedb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:46.608524 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9a337c-c9fb-404b-b99e-8f56234eedb5 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:46.608524 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9a337c-c9fb-404b-b99e-8f56234eedb5 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:46.608524 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9a337c-c9fb-404b-b99e-8f56234eedb5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:46.611220 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257a2679-15db-4951-b746-a86626ca09f8 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:46.738730 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9a337c-c9fb-404b-b99e-8f56234eedb5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:06:46.741056 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9a337c-c9fb-404b-b99e-8f56234eedb5 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:06:46.790365 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257a2679-15db-4951-b746-a86626ca09f8 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:46.826341 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5a906c-acaa-4dda-af11-d7c614416a82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:46.827367 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5a906c-acaa-4dda-af11-d7c614416a82 None admin] REQUEST_METHOD: `PUT` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:46.827724 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5a906c-acaa-4dda-af11-d7c614416a82 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:46.828080 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5a906c-acaa-4dda-af11-d7c614416a82 None admin] PATH_INFO: `/v3/projects/b028ff2c5aa54499a9cd429125c28fc7/users/6ad40793dcf0490689f2bcb5b52fd84e/roles/49187695e1bf4c15980bb68c83ca61de` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:46.830547 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5a906c-acaa-4dda-af11-d7c614416a82 None admin] RBAC: Authorizing `identity:create_grant(project_id=b028ff2c5aa54499a9cd429125c28fc7, user_id=6ad40793dcf0490689f2bcb5b52fd84e, role_id=49187695e1bf4c15980bb68c83ca61de)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:06:46.832233 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5a906c-acaa-4dda-af11-d7c614416a82 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:06:46.849059 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 69/130] 10.222.0.70 () {58 vars in 1439 bytes} [Tue May 10 19:06:46 2022] PUT /identity/v3/projects/b028ff2c5aa54499a9cd429125c28fc7/users/6ad40793dcf0490689f2bcb5b52fd84e/roles/49187695e1bf4c15980bb68c83ca61de => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:06:46.850037 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5a906c-acaa-4dda-af11-d7c614416a82 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:46.857638 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 62/131] 10.222.0.70 () {58 vars in 1282 bytes} [Tue May 10 19:06:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 19:06:46.859216 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167e6b1d-73cb-4f6d-977e-7800501118d4 None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:46.859508 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167e6b1d-73cb-4f6d-977e-7800501118d4 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:46.859793 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167e6b1d-73cb-4f6d-977e-7800501118d4 None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:46.862961 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 63/132] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:06:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:06:46.863838 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167e6b1d-73cb-4f6d-977e-7800501118d4 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:46.981842 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167e6b1d-73cb-4f6d-977e-7800501118d4 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:47.007458 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5a906c-acaa-4dda-af11-d7c614416a82 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:47.018649 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d18c33b-0cbc-43f2-ad39-91c24351ccf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:47.019697 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d18c33b-0cbc-43f2-ad39-91c24351ccf9 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:47.020120 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d18c33b-0cbc-43f2-ad39-91c24351ccf9 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:47.020530 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d18c33b-0cbc-43f2-ad39-91c24351ccf9 None admin] PATH_INFO: `/v3/projects/b028ff2c5aa54499a9cd429125c28fc7` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:47.022419 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d18c33b-0cbc-43f2-ad39-91c24351ccf9 None admin] RBAC: Authorizing `identity:get_project(project_id=b028ff2c5aa54499a9cd429125c28fc7)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:06:47.024012 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d18c33b-0cbc-43f2-ad39-91c24351ccf9 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:06:47.025869 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 64/133] 10.222.0.70 () {56 vars in 1186 bytes} [Tue May 10 19:06:46 2022] GET /identity/v3/projects/b028ff2c5aa54499a9cd429125c28fc7 => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:06:47.027322 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5c6fed-fdf8-472e-a893-803a4af7d256 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:47.027708 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5c6fed-fdf8-472e-a893-803a4af7d256 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:47.028099 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5c6fed-fdf8-472e-a893-803a4af7d256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:47.045461 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-ca5c6fed-fdf8-472e-a893-803a4af7d256 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:06:47.047121 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-ca5c6fed-fdf8-472e-a893-803a4af7d256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:06:47.049984 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0adcfaa-e309-43eb-95e3-3096a6553235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:47.051820 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0adcfaa-e309-43eb-95e3-3096a6553235 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:47.052267 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0adcfaa-e309-43eb-95e3-3096a6553235 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:47.052836 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0adcfaa-e309-43eb-95e3-3096a6553235 None admin] PATH_INFO: `/v3/roles` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:47.053750 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0adcfaa-e309-43eb-95e3-3096a6553235 None admin] RBAC: Adding query filter params (name=member) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:06:47.054257 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0adcfaa-e309-43eb-95e3-3096a6553235 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:06:47.055954 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0adcfaa-e309-43eb-95e3-3096a6553235 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:06:47.069691 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 70/134] 10.222.0.70 () {56 vars in 1101 bytes} [Tue May 10 19:06:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:06:47.070734 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0adcfaa-e309-43eb-95e3-3096a6553235 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:47.133028 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 65/135] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:06:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 19:06:47.134642 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5c6fed-fdf8-472e-a893-803a4af7d256 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:47.180054 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0adcfaa-e309-43eb-95e3-3096a6553235 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:47.217992 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33259ef-0b74-40a0-9d06-75d3e1fa925d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:47.218935 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33259ef-0b74-40a0-9d06-75d3e1fa925d None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:47.219336 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33259ef-0b74-40a0-9d06-75d3e1fa925d None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:47.219711 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33259ef-0b74-40a0-9d06-75d3e1fa925d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:47.220661 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33259ef-0b74-40a0-9d06-75d3e1fa925d None admin] RBAC: Adding query filter params (role.id=93fda71e71a04ccb862ff5177646d5b5, scope.project.id=b028ff2c5aa54499a9cd429125c28fc7, user.id=3be5d85ba1164758a27aba26310f23e6) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:06:47.221486 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33259ef-0b74-40a0-9d06-75d3e1fa925d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:06:47.222629 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33259ef-0b74-40a0-9d06-75d3e1fa925d None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:06:47.229066 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 71/136] 10.222.0.70 () {56 vars in 1374 bytes} [Tue May 10 19:06:47 2022] GET /identity/v3/role_assignments?user.id=3be5d85ba1164758a27aba26310f23e6&scope.project.id=b028ff2c5aa54499a9cd429125c28fc7&role.id=93fda71e71a04ccb862ff5177646d5b5 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:06:47.230054 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33259ef-0b74-40a0-9d06-75d3e1fa925d None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:47.265015 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5c6fed-fdf8-472e-a893-803a4af7d256 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:47.306474 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744a92c7-3422-4f6f-824b-a701172adb13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:47.307499 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744a92c7-3422-4f6f-824b-a701172adb13 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:47.308834 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744a92c7-3422-4f6f-824b-a701172adb13 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:47.309210 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744a92c7-3422-4f6f-824b-a701172adb13 None admin] PATH_INFO: `/v3/users/6ad40793dcf0490689f2bcb5b52fd84e` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:47.310677 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744a92c7-3422-4f6f-824b-a701172adb13 None admin] RBAC: Authorizing `identity:get_user(user_id=6ad40793dcf0490689f2bcb5b52fd84e)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:06:47.313013 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744a92c7-3422-4f6f-824b-a701172adb13 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:06:47.314115 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 66/137] 10.222.0.70 () {56 vars in 1177 bytes} [Tue May 10 19:06:47 2022] GET /identity/v3/users/6ad40793dcf0490689f2bcb5b52fd84e => generated 275 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:06:47.320506 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744a92c7-3422-4f6f-824b-a701172adb13 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:47.345006 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33259ef-0b74-40a0-9d06-75d3e1fa925d None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:47.384730 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d520a590-1f7a-4284-99a7-df565cb7dc19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:47.385798 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d520a590-1f7a-4284-99a7-df565cb7dc19 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:47.386182 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d520a590-1f7a-4284-99a7-df565cb7dc19 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:47.386551 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d520a590-1f7a-4284-99a7-df565cb7dc19 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:47.398046 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d520a590-1f7a-4284-99a7-df565cb7dc19 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:06:47.406088 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application [None req-d520a590-1f7a-4284-99a7-df565cb7dc19 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 19:06:47.406088 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:06:47.406088 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:06:47.406088 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:06:47.406088 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:06:47.406088 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:06:47.406088 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:06:47.406088 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:06:47.406088 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:06:47.406088 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:06:47.406088 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:06:47.406088 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:06:47.406088 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:06:47.406088 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:06:47.406088 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:06:47.406088 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:06:47.407043 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:06:47.407043 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:06:47.407043 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:06:47.407043 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:06:47.407043 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:06:47.407043 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:06:47.407043 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:06:47.407043 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:06:47.407043 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:06:47.407043 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:06:47.407043 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:06:47.407043 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application with Lock( May 10 19:06:47.407043 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:06:47.407043 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._enter() May 10 19:06:47.407043 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:06:47.407043 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:06:47.407831 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:06:47.407831 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.creator() May 10 19:06:47.407831 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:06:47.407831 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application created_value = creator( May 10 19:06:47.407831 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:06:47.407831 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:06:47.407831 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:06:47.407831 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:06:47.407831 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:06:47.407831 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:06:47.407831 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 19:06:47.407831 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application May 10 19:06:47.407831 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 72/138] 10.222.0.70 () {56 vars in 1099 bytes} [Tue May 10 19:06:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:06:47.413199 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d520a590-1f7a-4284-99a7-df565cb7dc19 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:47.453529 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744a92c7-3422-4f6f-824b-a701172adb13 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:47.498143 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bb5ee8-4b91-4278-9de9-06b6eedfbf5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:47.500019 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bb5ee8-4b91-4278-9de9-06b6eedfbf5d None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:47.500713 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bb5ee8-4b91-4278-9de9-06b6eedfbf5d None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:47.501300 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bb5ee8-4b91-4278-9de9-06b6eedfbf5d None admin] PATH_INFO: `/v3/projects/6591932d24eb4c8a89c48619ec1c6c2e` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:47.503079 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bb5ee8-4b91-4278-9de9-06b6eedfbf5d None admin] RBAC: Authorizing `identity:get_project(project_id=6591932d24eb4c8a89c48619ec1c6c2e)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:06:47.505170 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bb5ee8-4b91-4278-9de9-06b6eedfbf5d None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:06:47.508401 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 67/139] 10.222.0.70 () {56 vars in 1186 bytes} [Tue May 10 19:06:47 2022] GET /identity/v3/projects/6591932d24eb4c8a89c48619ec1c6c2e => generated 312 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:06:47.517602 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bb5ee8-4b91-4278-9de9-06b6eedfbf5d None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:47.537922 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d520a590-1f7a-4284-99a7-df565cb7dc19 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:47.617496 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993827aa-8f5a-43d9-980d-fe5f28e8e4f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:47.618579 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993827aa-8f5a-43d9-980d-fe5f28e8e4f0 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:47.619062 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993827aa-8f5a-43d9-980d-fe5f28e8e4f0 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:47.619545 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993827aa-8f5a-43d9-980d-fe5f28e8e4f0 None admin] PATH_INFO: `/v3/roles` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:47.620531 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993827aa-8f5a-43d9-980d-fe5f28e8e4f0 None admin] RBAC: Adding query filter params (name=member) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:06:47.621037 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993827aa-8f5a-43d9-980d-fe5f28e8e4f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:06:47.623610 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993827aa-8f5a-43d9-980d-fe5f28e8e4f0 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:06:47.639632 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 73/140] 10.222.0.70 () {56 vars in 1101 bytes} [Tue May 10 19:06:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:06:47.645333 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993827aa-8f5a-43d9-980d-fe5f28e8e4f0 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:47.680981 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bb5ee8-4b91-4278-9de9-06b6eedfbf5d None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:47.727538 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e735dc-cfdd-428e-a6a0-d3d5d2a378e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:47.728852 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e735dc-cfdd-428e-a6a0-d3d5d2a378e9 None admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:47.729352 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e735dc-cfdd-428e-a6a0-d3d5d2a378e9 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:47.729827 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e735dc-cfdd-428e-a6a0-d3d5d2a378e9 None admin] PATH_INFO: `/v3/projects/6591932d24eb4c8a89c48619ec1c6c2e/users/6ad40793dcf0490689f2bcb5b52fd84e/roles/5c07cf5bfbd3427db18428aa50420962` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:47.734042 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e735dc-cfdd-428e-a6a0-d3d5d2a378e9 None admin] RBAC: Authorizing `identity:create_grant(project_id=6591932d24eb4c8a89c48619ec1c6c2e, user_id=6ad40793dcf0490689f2bcb5b52fd84e, role_id=5c07cf5bfbd3427db18428aa50420962)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:06:47.735952 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e735dc-cfdd-428e-a6a0-d3d5d2a378e9 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:06:47.761813 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 68/141] 10.222.0.70 () {58 vars in 1439 bytes} [Tue May 10 19:06:47 2022] PUT /identity/v3/projects/6591932d24eb4c8a89c48619ec1c6c2e/users/6ad40793dcf0490689f2bcb5b52fd84e/roles/5c07cf5bfbd3427db18428aa50420962 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:06:47.856255 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993827aa-8f5a-43d9-980d-fe5f28e8e4f0 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:47.905017 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c82f875-f3e2-49d0-88cf-fa90d45564c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:47.907581 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c82f875-f3e2-49d0-88cf-fa90d45564c5 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:47.908100 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c82f875-f3e2-49d0-88cf-fa90d45564c5 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:47.908607 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c82f875-f3e2-49d0-88cf-fa90d45564c5 None admin] PATH_INFO: `/v3/users/6ad40793dcf0490689f2bcb5b52fd84e` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:47.913299 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c82f875-f3e2-49d0-88cf-fa90d45564c5 None admin] RBAC: Authorizing `identity:get_user(user_id=6ad40793dcf0490689f2bcb5b52fd84e)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:06:47.915135 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c82f875-f3e2-49d0-88cf-fa90d45564c5 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:06:47.917266 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 74/142] 10.222.0.70 () {56 vars in 1177 bytes} [Tue May 10 19:06:47 2022] GET /identity/v3/users/6ad40793dcf0490689f2bcb5b52fd84e => generated 275 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:06:47.923113 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e735dc-cfdd-428e-a6a0-d3d5d2a378e9 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:48.035513 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bc2c8b-b17d-47c9-bc81-5f03c232fa32 None None] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:48.035856 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bc2c8b-b17d-47c9-bc81-5f03c232fa32 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:48.036089 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bc2c8b-b17d-47c9-bc81-5f03c232fa32 None None] PATH_INFO: `/` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:48.038141 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 75/143] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:06:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:06:48.045608 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358df841-2010-4017-84db-bfa92a61ee7a None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:48.045998 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358df841-2010-4017-84db-bfa92a61ee7a None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:48.046237 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358df841-2010-4017-84db-bfa92a61ee7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:48.084107 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-358df841-2010-4017-84db-bfa92a61ee7a None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:06:48.085341 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-358df841-2010-4017-84db-bfa92a61ee7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:06:48.087005 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e735dc-cfdd-428e-a6a0-d3d5d2a378e9 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:48.157848 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b71816-4b0f-41e6-b3c8-23a1a18f9cf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:48.158447 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b71816-4b0f-41e6-b3c8-23a1a18f9cf5 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:48.158729 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b71816-4b0f-41e6-b3c8-23a1a18f9cf5 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:48.159000 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b71816-4b0f-41e6-b3c8-23a1a18f9cf5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:48.222755 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 76/144] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:06:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 19:06:48.230556 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b71816-4b0f-41e6-b3c8-23a1a18f9cf5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:06:48.232007 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b71816-4b0f-41e6-b3c8-23a1a18f9cf5 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:06:48.261024 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358df841-2010-4017-84db-bfa92a61ee7a None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:48.332035 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 69/145] 10.222.0.70 () {58 vars in 1282 bytes} [Tue May 10 19:06:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 19:06:48.339675 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b71816-4b0f-41e6-b3c8-23a1a18f9cf5 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:48.445253 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b71816-4b0f-41e6-b3c8-23a1a18f9cf5 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:48.480395 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909429aa-27c5-4368-9add-3f2c559822c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:48.481285 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909429aa-27c5-4368-9add-3f2c559822c0 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:48.481569 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909429aa-27c5-4368-9add-3f2c559822c0 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:48.481844 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909429aa-27c5-4368-9add-3f2c559822c0 None admin] PATH_INFO: `/v3/projects/b028ff2c5aa54499a9cd429125c28fc7` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:48.483021 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909429aa-27c5-4368-9add-3f2c559822c0 None admin] RBAC: Authorizing `identity:get_project(project_id=b028ff2c5aa54499a9cd429125c28fc7)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:06:48.484549 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909429aa-27c5-4368-9add-3f2c559822c0 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:06:48.486234 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 70/146] 10.222.0.70 () {56 vars in 1186 bytes} [Tue May 10 19:06:48 2022] GET /identity/v3/projects/b028ff2c5aa54499a9cd429125c28fc7 => generated 298 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:06:48.492067 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909429aa-27c5-4368-9add-3f2c559822c0 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:48.529043 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358df841-2010-4017-84db-bfa92a61ee7a None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:48.590560 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909429aa-27c5-4368-9add-3f2c559822c0 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:48.606654 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d648d81-518f-431a-b511-273edb3b7551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:48.607469 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d648d81-518f-431a-b511-273edb3b7551 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:48.607763 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d648d81-518f-431a-b511-273edb3b7551 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:48.608043 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d648d81-518f-431a-b511-273edb3b7551 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:48.613111 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d648d81-518f-431a-b511-273edb3b7551 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:06:48.614582 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d648d81-518f-431a-b511-273edb3b7551 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:06:48.616465 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 77/147] 10.222.0.70 () {56 vars in 1108 bytes} [Tue May 10 19:06:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:06:48.621923 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d648d81-518f-431a-b511-273edb3b7551 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:48.624714 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c249f22-84b7-4e3e-9a93-b0a0a99a728a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:48.625378 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c249f22-84b7-4e3e-9a93-b0a0a99a728a None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:48.625773 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c249f22-84b7-4e3e-9a93-b0a0a99a728a None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:48.626045 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c249f22-84b7-4e3e-9a93-b0a0a99a728a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:48.626873 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c249f22-84b7-4e3e-9a93-b0a0a99a728a None admin] RBAC: Adding query filter params (role.id=5c07cf5bfbd3427db18428aa50420962, scope.project.id=b028ff2c5aa54499a9cd429125c28fc7, user.id=6ad40793dcf0490689f2bcb5b52fd84e) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:06:48.627180 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c249f22-84b7-4e3e-9a93-b0a0a99a728a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:06:48.628746 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c249f22-84b7-4e3e-9a93-b0a0a99a728a None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:06:48.640552 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 71/148] 10.222.0.70 () {56 vars in 1374 bytes} [Tue May 10 19:06:48 2022] GET /identity/v3/role_assignments?user.id=6ad40793dcf0490689f2bcb5b52fd84e&scope.project.id=b028ff2c5aa54499a9cd429125c28fc7&role.id=5c07cf5bfbd3427db18428aa50420962 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:06:48.770207 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d648d81-518f-431a-b511-273edb3b7551 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:48.812979 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5e65f7-8126-45a6-a5c4-9cafd587c9f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:48.813672 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5e65f7-8126-45a6-a5c4-9cafd587c9f0 None admin] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:48.813954 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5e65f7-8126-45a6-a5c4-9cafd587c9f0 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:48.814231 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5e65f7-8126-45a6-a5c4-9cafd587c9f0 None admin] PATH_INFO: `/v3/users` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:48.814954 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5e65f7-8126-45a6-a5c4-9cafd587c9f0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:06:48.816448 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5e65f7-8126-45a6-a5c4-9cafd587c9f0 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:06:48.842712 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 78/149] 10.222.0.70 () {60 vars in 1132 bytes} [Tue May 10 19:06:48 2022] POST /identity/v3/users => generated 283 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:06:49.678528 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8007ac-34ee-401c-9289-4044849a11b1 None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:49.679027 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8007ac-34ee-401c-9289-4044849a11b1 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:49.679129 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8007ac-34ee-401c-9289-4044849a11b1 None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:49.680466 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 72/150] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:06:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:06:49.686255 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62108eab-ac31-4da3-98e9-6579c4c86dad None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:49.686654 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62108eab-ac31-4da3-98e9-6579c4c86dad None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:49.686822 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62108eab-ac31-4da3-98e9-6579c4c86dad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:49.705563 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-62108eab-ac31-4da3-98e9-6579c4c86dad None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:06:49.706739 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-62108eab-ac31-4da3-98e9-6579c4c86dad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:06:49.778208 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 79/151] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:06:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 19:06:49.801618 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8007ac-34ee-401c-9289-4044849a11b1 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:49.914167 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8007ac-34ee-401c-9289-4044849a11b1 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:49.961211 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45b7d6b-e065-4ca6-97c2-ea111d9fe532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:49.962025 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45b7d6b-e065-4ca6-97c2-ea111d9fe532 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:49.962309 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45b7d6b-e065-4ca6-97c2-ea111d9fe532 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:49.962590 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45b7d6b-e065-4ca6-97c2-ea111d9fe532 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:49.981160 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45b7d6b-e065-4ca6-97c2-ea111d9fe532 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:06:49.988847 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-f45b7d6b-e065-4ca6-97c2-ea111d9fe532 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 19:06:49.988847 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:06:49.988847 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:06:49.988847 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:06:49.988847 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:06:49.988847 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:06:49.988847 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:06:49.988847 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:06:49.988847 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:06:49.988847 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:06:49.988847 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:06:49.988847 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:06:49.988847 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:06:49.988847 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:06:49.988847 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:06:49.988847 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:06:49.989702 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:06:49.989702 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:06:49.989702 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:06:49.989702 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:06:49.989702 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:06:49.989702 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:06:49.989702 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:06:49.989702 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:06:49.989702 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:06:49.989702 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:06:49.989702 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:06:49.989702 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( May 10 19:06:49.989702 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:06:49.989702 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() May 10 19:06:49.989702 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:06:49.989702 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:06:49.990534 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:06:49.990534 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() May 10 19:06:49.990534 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:06:49.990534 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( May 10 19:06:49.990534 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:06:49.990534 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:06:49.990534 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:06:49.990534 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:06:49.990534 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:06:49.990534 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:06:49.990534 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 19:06:49.990534 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:06:49.990534 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 73/152] 10.222.0.70 () {56 vars in 1096 bytes} [Tue May 10 19:06:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:06:49.995900 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62108eab-ac31-4da3-98e9-6579c4c86dad None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:50.127876 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62108eab-ac31-4da3-98e9-6579c4c86dad None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:50.167204 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b3675a-c021-438b-b2bf-76040adac38e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:50.167884 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b3675a-c021-438b-b2bf-76040adac38e None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:50.168170 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b3675a-c021-438b-b2bf-76040adac38e None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:50.168467 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b3675a-c021-438b-b2bf-76040adac38e None admin] PATH_INFO: `/v3/roles` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:50.169223 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b3675a-c021-438b-b2bf-76040adac38e None admin] RBAC: Adding query filter params (name=admin) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:06:50.169530 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b3675a-c021-438b-b2bf-76040adac38e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:06:50.170932 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b3675a-c021-438b-b2bf-76040adac38e None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:06:50.180220 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 80/153] 10.222.0.70 () {56 vars in 1099 bytes} [Tue May 10 19:06:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:06:50.186069 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45b7d6b-e065-4ca6-97c2-ea111d9fe532 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:50.250012 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854c211d-da6e-4b93-8abb-d81f3bc10227 None None] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:50.250703 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854c211d-da6e-4b93-8abb-d81f3bc10227 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:50.250991 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854c211d-da6e-4b93-8abb-d81f3bc10227 None None] PATH_INFO: `/` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:50.252904 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 81/154] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:06:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:06:50.260060 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae995d1d-3ea1-497f-9001-2bf35e5da49a None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:50.260519 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae995d1d-3ea1-497f-9001-2bf35e5da49a None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:50.260817 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae995d1d-3ea1-497f-9001-2bf35e5da49a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:50.283267 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-ae995d1d-3ea1-497f-9001-2bf35e5da49a None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:06:50.284486 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-ae995d1d-3ea1-497f-9001-2bf35e5da49a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:06:50.337063 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45b7d6b-e065-4ca6-97c2-ea111d9fe532 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:50.366615 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 82/155] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:06:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 19:06:50.387389 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d954d7-4d86-4bf3-a252-3f208dfd2374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:50.388280 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d954d7-4d86-4bf3-a252-3f208dfd2374 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:50.388611 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d954d7-4d86-4bf3-a252-3f208dfd2374 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:50.388890 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d954d7-4d86-4bf3-a252-3f208dfd2374 None admin] PATH_INFO: `/v3/users/4cc9b8973fb54520a299cde16c0ec076` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:50.390082 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d954d7-4d86-4bf3-a252-3f208dfd2374 None admin] RBAC: Authorizing `identity:get_user(user_id=4cc9b8973fb54520a299cde16c0ec076)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:06:50.391541 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d954d7-4d86-4bf3-a252-3f208dfd2374 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:06:50.396631 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 74/156] 10.222.0.70 () {56 vars in 1177 bytes} [Tue May 10 19:06:50 2022] GET /identity/v3/users/4cc9b8973fb54520a299cde16c0ec076 => generated 247 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:06:50.399101 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae995d1d-3ea1-497f-9001-2bf35e5da49a None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:50.476051 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d954d7-4d86-4bf3-a252-3f208dfd2374 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:50.545797 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae995d1d-3ea1-497f-9001-2bf35e5da49a None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:50.607283 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af3e372-e15d-44ea-835c-4facd919e74b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:50.607976 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af3e372-e15d-44ea-835c-4facd919e74b None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:50.608254 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af3e372-e15d-44ea-835c-4facd919e74b None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:50.608550 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af3e372-e15d-44ea-835c-4facd919e74b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:50.680526 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d954d7-4d86-4bf3-a252-3f208dfd2374 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:50.687706 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af3e372-e15d-44ea-835c-4facd919e74b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:06:50.689276 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af3e372-e15d-44ea-835c-4facd919e74b None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:06:50.745260 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2452d9-41c4-4358-b07a-7d1570456ed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:50.746110 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2452d9-41c4-4358-b07a-7d1570456ed4 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:50.746398 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2452d9-41c4-4358-b07a-7d1570456ed4 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:50.746676 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2452d9-41c4-4358-b07a-7d1570456ed4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:50.761423 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2452d9-41c4-4358-b07a-7d1570456ed4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:06:50.777908 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-0a2452d9-41c4-4358-b07a-7d1570456ed4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 19:06:50.777908 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:06:50.777908 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:06:50.777908 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:06:50.777908 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:06:50.777908 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:06:50.777908 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:06:50.777908 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:06:50.777908 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:06:50.777908 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:06:50.777908 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:06:50.777908 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:06:50.777908 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:06:50.777908 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:06:50.777908 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:06:50.777908 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:06:50.779970 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:06:50.779970 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:06:50.779970 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:06:50.779970 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:06:50.779970 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:06:50.779970 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:06:50.779970 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:06:50.779970 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:06:50.779970 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:06:50.779970 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:06:50.779970 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:06:50.779970 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( May 10 19:06:50.779970 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:06:50.779970 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() May 10 19:06:50.779970 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:06:50.779970 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:06:50.781973 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:06:50.781973 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() May 10 19:06:50.781973 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:06:50.781973 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( May 10 19:06:50.781973 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:06:50.781973 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:06:50.781973 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:06:50.781973 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:06:50.781973 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:06:50.781973 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:06:50.781973 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 19:06:50.781973 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:06:50.781973 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 75/157] 10.222.0.70 () {56 vars in 1114 bytes} [Tue May 10 19:06:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 19:06:50.799750 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2452d9-41c4-4358-b07a-7d1570456ed4 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:50.836264 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 83/158] 10.222.0.70 () {58 vars in 1282 bytes} [Tue May 10 19:06:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 19:06:50.854109 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af3e372-e15d-44ea-835c-4facd919e74b None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:50.914522 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2452d9-41c4-4358-b07a-7d1570456ed4 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:50.948716 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8c3206-fd64-46c8-9d3e-5c3990d454d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:50.949785 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8c3206-fd64-46c8-9d3e-5c3990d454d9 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:50.950273 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8c3206-fd64-46c8-9d3e-5c3990d454d9 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:50.950762 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8c3206-fd64-46c8-9d3e-5c3990d454d9 None admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:50.951714 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8c3206-fd64-46c8-9d3e-5c3990d454d9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:06:50.952222 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8c3206-fd64-46c8-9d3e-5c3990d454d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:06:50.953837 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8c3206-fd64-46c8-9d3e-5c3990d454d9 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:06:50.964186 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 76/159] 10.222.0.70 () {56 vars in 1111 bytes} [Tue May 10 19:06:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:06:50.969245 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af3e372-e15d-44ea-835c-4facd919e74b None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:50.969990 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e0fba8-6db4-4a8b-b872-622b1cd4416f None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:50.970293 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e0fba8-6db4-4a8b-b872-622b1cd4416f None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:50.970576 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e0fba8-6db4-4a8b-b872-622b1cd4416f None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:50.972016 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 77/160] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:06:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:06:50.977311 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e0fba8-6db4-4a8b-b872-622b1cd4416f None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:51.005316 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c581be12-4e70-45b1-86d9-bc2af2b8c9a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:51.007064 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c581be12-4e70-45b1-86d9-bc2af2b8c9a3 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:51.007535 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c581be12-4e70-45b1-86d9-bc2af2b8c9a3 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:51.008041 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c581be12-4e70-45b1-86d9-bc2af2b8c9a3 None admin] PATH_INFO: `/v3/projects/b028ff2c5aa54499a9cd429125c28fc7` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:51.009497 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c581be12-4e70-45b1-86d9-bc2af2b8c9a3 None admin] RBAC: Authorizing `identity:get_project(project_id=b028ff2c5aa54499a9cd429125c28fc7)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:06:51.011206 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c581be12-4e70-45b1-86d9-bc2af2b8c9a3 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:06:51.013211 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 84/161] 10.222.0.70 () {56 vars in 1186 bytes} [Tue May 10 19:06:50 2022] GET /identity/v3/projects/b028ff2c5aa54499a9cd429125c28fc7 => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:06:51.014612 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c85ea4d-7e7e-4c63-b79c-15b2ae36424b None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:51.015087 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c85ea4d-7e7e-4c63-b79c-15b2ae36424b None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:51.015549 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c85ea4d-7e7e-4c63-b79c-15b2ae36424b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:51.032277 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-7c85ea4d-7e7e-4c63-b79c-15b2ae36424b None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:06:51.033975 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-7c85ea4d-7e7e-4c63-b79c-15b2ae36424b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:06:51.101572 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 85/162] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:06:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 19:06:51.102963 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c85ea4d-7e7e-4c63-b79c-15b2ae36424b None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:51.112967 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e0fba8-6db4-4a8b-b872-622b1cd4416f None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:51.147919 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42851f9-75a4-42be-973b-2968d71579ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:51.148918 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42851f9-75a4-42be-973b-2968d71579ee None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:51.149124 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42851f9-75a4-42be-973b-2968d71579ee None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:51.149385 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42851f9-75a4-42be-973b-2968d71579ee None admin] PATH_INFO: `/v3/users/6ad40793dcf0490689f2bcb5b52fd84e` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:51.150605 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42851f9-75a4-42be-973b-2968d71579ee None admin] RBAC: Authorizing `identity:get_user(user_id=6ad40793dcf0490689f2bcb5b52fd84e)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:06:51.152056 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42851f9-75a4-42be-973b-2968d71579ee None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:06:51.153725 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 78/163] 10.222.0.70 () {56 vars in 1177 bytes} [Tue May 10 19:06:50 2022] GET /identity/v3/users/6ad40793dcf0490689f2bcb5b52fd84e => generated 275 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:06:51.154479 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42851f9-75a4-42be-973b-2968d71579ee None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:51.221672 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c85ea4d-7e7e-4c63-b79c-15b2ae36424b None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:51.256153 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7d4ffb-8ab5-4266-9a75-99800c825a66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:51.257173 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7d4ffb-8ab5-4266-9a75-99800c825a66 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:51.257685 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7d4ffb-8ab5-4266-9a75-99800c825a66 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:51.258172 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7d4ffb-8ab5-4266-9a75-99800c825a66 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:51.258748 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42851f9-75a4-42be-973b-2968d71579ee None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:51.259502 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7d4ffb-8ab5-4266-9a75-99800c825a66 None admin] RBAC: Adding query filter params (role.id=634ba284303b4626b5a0402772c68f5c, scope.project.id=b028ff2c5aa54499a9cd429125c28fc7, user.id=4cc9b8973fb54520a299cde16c0ec076) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:06:51.260015 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7d4ffb-8ab5-4266-9a75-99800c825a66 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:06:51.261843 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7d4ffb-8ab5-4266-9a75-99800c825a66 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:06:51.269401 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 86/164] 10.222.0.70 () {56 vars in 1374 bytes} [Tue May 10 19:06:51 2022] GET /identity/v3/role_assignments?user.id=4cc9b8973fb54520a299cde16c0ec076&scope.project.id=b028ff2c5aa54499a9cd429125c28fc7&role.id=634ba284303b4626b5a0402772c68f5c => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:06:51.270930 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c4a8b4-ebaf-4da4-bbb2-7351d8d39e6f None None] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:51.271967 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c4a8b4-ebaf-4da4-bbb2-7351d8d39e6f None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:51.272545 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c4a8b4-ebaf-4da4-bbb2-7351d8d39e6f None None] PATH_INFO: `/` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:51.274039 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 87/165] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:06:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:06:51.274912 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c4a8b4-ebaf-4da4-bbb2-7351d8d39e6f None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:51.313670 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c16d51-7a7b-40f4-97b3-b401cd0a4bf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:51.314548 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c16d51-7a7b-40f4-97b3-b401cd0a4bf1 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:51.314834 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c16d51-7a7b-40f4-97b3-b401cd0a4bf1 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:51.315131 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c16d51-7a7b-40f4-97b3-b401cd0a4bf1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:51.339195 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c16d51-7a7b-40f4-97b3-b401cd0a4bf1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:06:51.355461 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-f0c16d51-7a7b-40f4-97b3-b401cd0a4bf1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 10 19:06:51.355461 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:06:51.355461 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:06:51.355461 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:06:51.355461 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:06:51.355461 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:06:51.355461 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:06:51.355461 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:06:51.355461 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:06:51.355461 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:06:51.355461 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:06:51.355461 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:06:51.355461 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:06:51.355461 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:06:51.355461 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:06:51.355461 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:06:51.356446 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:06:51.356446 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:06:51.356446 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:06:51.356446 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:06:51.356446 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:06:51.356446 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:06:51.356446 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:06:51.356446 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:06:51.356446 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:06:51.356446 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:06:51.356446 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:06:51.356446 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( May 10 19:06:51.356446 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:06:51.356446 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() May 10 19:06:51.356446 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:06:51.356446 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:06:51.357858 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:06:51.357858 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() May 10 19:06:51.357858 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:06:51.357858 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( May 10 19:06:51.357858 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:06:51.357858 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:06:51.357858 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:06:51.357858 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:06:51.357858 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:06:51.357858 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:06:51.357858 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 10 19:06:51.357858 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:06:51.357858 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 79/166] 10.222.0.70 () {56 vars in 1099 bytes} [Tue May 10 19:06:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:06:51.358507 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009c99eb-e522-438a-89f6-f60fc0068e64 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:51.358573 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009c99eb-e522-438a-89f6-f60fc0068e64 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:51.358931 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009c99eb-e522-438a-89f6-f60fc0068e64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:51.389495 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-009c99eb-e522-438a-89f6-f60fc0068e64 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:06:51.390693 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-009c99eb-e522-438a-89f6-f60fc0068e64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:06:51.396942 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c4a8b4-ebaf-4da4-bbb2-7351d8d39e6f None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:51.431512 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8dde3e-e029-4f7b-b083-2d911e387b70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:51.432608 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8dde3e-e029-4f7b-b083-2d911e387b70 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:51.433089 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8dde3e-e029-4f7b-b083-2d911e387b70 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:51.433576 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8dde3e-e029-4f7b-b083-2d911e387b70 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:51.508349 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8dde3e-e029-4f7b-b083-2d911e387b70 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:06:51.510489 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8dde3e-e029-4f7b-b083-2d911e387b70 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:06:51.515946 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 80/167] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:06:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 19:06:51.519333 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009c99eb-e522-438a-89f6-f60fc0068e64 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:51.641333 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 88/168] 10.222.0.70 () {58 vars in 1282 bytes} [Tue May 10 19:06:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 19:06:51.642565 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8dde3e-e029-4f7b-b083-2d911e387b70 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:51.717731 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009c99eb-e522-438a-89f6-f60fc0068e64 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:51.760444 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57024d67-49c2-43d7-a428-8c6f04ca5793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:51.761234 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57024d67-49c2-43d7-a428-8c6f04ca5793 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:51.761525 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57024d67-49c2-43d7-a428-8c6f04ca5793 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:51.761807 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57024d67-49c2-43d7-a428-8c6f04ca5793 None admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:51.762818 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57024d67-49c2-43d7-a428-8c6f04ca5793 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:06:51.763125 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57024d67-49c2-43d7-a428-8c6f04ca5793 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:06:51.765457 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57024d67-49c2-43d7-a428-8c6f04ca5793 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:06:51.768608 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8dde3e-e029-4f7b-b083-2d911e387b70 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:51.775458 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 81/169] 10.222.0.70 () {56 vars in 1101 bytes} [Tue May 10 19:06:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:06:51.776283 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57024d67-49c2-43d7-a428-8c6f04ca5793 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:51.811002 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05062db-d836-45cc-9e78-3ec3a283fc7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:51.812740 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05062db-d836-45cc-9e78-3ec3a283fc7f None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:51.813037 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05062db-d836-45cc-9e78-3ec3a283fc7f None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:51.813313 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05062db-d836-45cc-9e78-3ec3a283fc7f None admin] PATH_INFO: `/v3/roles/member` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:51.835702 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05062db-d836-45cc-9e78-3ec3a283fc7f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:06:51.846088 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application [None req-e05062db-d836-45cc-9e78-3ec3a283fc7f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 19:06:51.846088 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:06:51.846088 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:06:51.846088 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:06:51.846088 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:06:51.846088 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:06:51.846088 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:06:51.846088 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:06:51.846088 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:06:51.846088 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:06:51.846088 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:06:51.846088 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:06:51.846088 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:06:51.846088 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:06:51.846088 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:06:51.846088 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:06:51.846989 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:06:51.846989 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:06:51.846989 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:06:51.846989 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:06:51.846989 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:06:51.846989 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:06:51.846989 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:06:51.846989 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:06:51.846989 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:06:51.846989 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:06:51.846989 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:06:51.846989 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application with Lock( May 10 19:06:51.846989 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:06:51.846989 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._enter() May 10 19:06:51.846989 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:06:51.846989 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:06:51.847763 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:06:51.847763 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.creator() May 10 19:06:51.847763 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:06:51.847763 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application created_value = creator( May 10 19:06:51.847763 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:06:51.847763 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:06:51.847763 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:06:51.847763 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:06:51.847763 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:06:51.847763 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:06:51.847763 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 19:06:51.847763 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application May 10 19:06:51.849838 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 89/170] 10.222.0.70 () {56 vars in 1099 bytes} [Tue May 10 19:06:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:06:51.850693 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05062db-d836-45cc-9e78-3ec3a283fc7f None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:51.904705 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57024d67-49c2-43d7-a428-8c6f04ca5793 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:51.948291 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb29bd88-cbb2-4663-8cbe-08651b0770b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:51.949432 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb29bd88-cbb2-4663-8cbe-08651b0770b4 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:51.949857 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb29bd88-cbb2-4663-8cbe-08651b0770b4 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:51.950269 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb29bd88-cbb2-4663-8cbe-08651b0770b4 None admin] PATH_INFO: `/v3/projects/b028ff2c5aa54499a9cd429125c28fc7` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:51.951613 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb29bd88-cbb2-4663-8cbe-08651b0770b4 None admin] RBAC: Authorizing `identity:get_project(project_id=b028ff2c5aa54499a9cd429125c28fc7)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:06:51.953752 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb29bd88-cbb2-4663-8cbe-08651b0770b4 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:06:51.956074 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 82/171] 10.222.0.70 () {56 vars in 1186 bytes} [Tue May 10 19:06:51 2022] GET /identity/v3/projects/b028ff2c5aa54499a9cd429125c28fc7 => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:06:51.957207 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb29bd88-cbb2-4663-8cbe-08651b0770b4 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:51.971754 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05062db-d836-45cc-9e78-3ec3a283fc7f None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:52.011307 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4543f2-1f72-40b4-ade3-23d06240dc44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:52.012476 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4543f2-1f72-40b4-ade3-23d06240dc44 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:52.013026 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4543f2-1f72-40b4-ade3-23d06240dc44 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:52.013402 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4543f2-1f72-40b4-ade3-23d06240dc44 None admin] PATH_INFO: `/v3/users/3be5d85ba1164758a27aba26310f23e6` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:52.015364 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4543f2-1f72-40b4-ade3-23d06240dc44 None admin] RBAC: Authorizing `identity:get_user(user_id=3be5d85ba1164758a27aba26310f23e6)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:06:52.017137 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4543f2-1f72-40b4-ade3-23d06240dc44 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:06:52.019370 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 90/172] 10.222.0.70 () {56 vars in 1177 bytes} [Tue May 10 19:06:51 2022] GET /identity/v3/users/3be5d85ba1164758a27aba26310f23e6 => generated 289 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:06:52.020144 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4543f2-1f72-40b4-ade3-23d06240dc44 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:52.077711 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb29bd88-cbb2-4663-8cbe-08651b0770b4 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:52.119409 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3726cf84-9d8a-4b08-9b97-add81baca7b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:52.120595 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3726cf84-9d8a-4b08-9b97-add81baca7b1 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:52.120949 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3726cf84-9d8a-4b08-9b97-add81baca7b1 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:52.121375 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3726cf84-9d8a-4b08-9b97-add81baca7b1 None admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:52.122441 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3726cf84-9d8a-4b08-9b97-add81baca7b1 None admin] RBAC: Adding query filter params (name=member) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:06:52.122891 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3726cf84-9d8a-4b08-9b97-add81baca7b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:06:52.124589 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3726cf84-9d8a-4b08-9b97-add81baca7b1 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:06:52.127607 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4543f2-1f72-40b4-ade3-23d06240dc44 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:52.134323 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 83/173] 10.222.0.70 () {56 vars in 1101 bytes} [Tue May 10 19:06:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:06:52.135229 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3726cf84-9d8a-4b08-9b97-add81baca7b1 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:52.167628 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936fdc34-7521-4b86-aa67-1d4d0ea09be8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:52.168358 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936fdc34-7521-4b86-aa67-1d4d0ea09be8 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:52.168787 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936fdc34-7521-4b86-aa67-1d4d0ea09be8 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:52.169165 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936fdc34-7521-4b86-aa67-1d4d0ea09be8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:52.170091 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936fdc34-7521-4b86-aa67-1d4d0ea09be8 None admin] RBAC: Adding query filter params (role.id=49187695e1bf4c15980bb68c83ca61de, scope.project.id=b028ff2c5aa54499a9cd429125c28fc7, user.id=6ad40793dcf0490689f2bcb5b52fd84e) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:06:52.170503 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936fdc34-7521-4b86-aa67-1d4d0ea09be8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:06:52.172062 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936fdc34-7521-4b86-aa67-1d4d0ea09be8 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:06:52.178875 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 91/174] 10.222.0.70 () {56 vars in 1374 bytes} [Tue May 10 19:06:52 2022] GET /identity/v3/role_assignments?user.id=6ad40793dcf0490689f2bcb5b52fd84e&scope.project.id=b028ff2c5aa54499a9cd429125c28fc7&role.id=49187695e1bf4c15980bb68c83ca61de => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:06:52.179756 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936fdc34-7521-4b86-aa67-1d4d0ea09be8 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:52.293634 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936fdc34-7521-4b86-aa67-1d4d0ea09be8 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:52.310837 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3726cf84-9d8a-4b08-9b97-add81baca7b1 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:52.332507 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230b746a-1eee-4bb4-937c-7a0e7cb9ab9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:52.334234 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230b746a-1eee-4bb4-937c-7a0e7cb9ab9f None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:52.334521 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230b746a-1eee-4bb4-937c-7a0e7cb9ab9f None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:52.334795 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230b746a-1eee-4bb4-937c-7a0e7cb9ab9f None admin] PATH_INFO: `/v3/users/6ad40793dcf0490689f2bcb5b52fd84e` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:52.336065 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230b746a-1eee-4bb4-937c-7a0e7cb9ab9f None admin] RBAC: Authorizing `identity:get_user(user_id=6ad40793dcf0490689f2bcb5b52fd84e)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:06:52.337754 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230b746a-1eee-4bb4-937c-7a0e7cb9ab9f None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:06:52.339627 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 92/175] 10.222.0.70 () {56 vars in 1177 bytes} [Tue May 10 19:06:52 2022] GET /identity/v3/users/6ad40793dcf0490689f2bcb5b52fd84e => generated 275 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:06:52.345067 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230b746a-1eee-4bb4-937c-7a0e7cb9ab9f None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:52.368559 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a039ec1-8bb5-49b5-be0b-c74bc708f4a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:52.369461 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a039ec1-8bb5-49b5-be0b-c74bc708f4a7 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:52.369743 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a039ec1-8bb5-49b5-be0b-c74bc708f4a7 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:52.370018 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a039ec1-8bb5-49b5-be0b-c74bc708f4a7 None admin] PATH_INFO: `/v3/projects/b028ff2c5aa54499a9cd429125c28fc7` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:52.371275 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a039ec1-8bb5-49b5-be0b-c74bc708f4a7 None admin] RBAC: Authorizing `identity:get_project(project_id=b028ff2c5aa54499a9cd429125c28fc7)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:06:52.372796 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a039ec1-8bb5-49b5-be0b-c74bc708f4a7 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:06:52.374888 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 84/176] 10.222.0.70 () {56 vars in 1186 bytes} [Tue May 10 19:06:52 2022] GET /identity/v3/projects/b028ff2c5aa54499a9cd429125c28fc7 => generated 298 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:06:52.381820 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a039ec1-8bb5-49b5-be0b-c74bc708f4a7 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:52.496443 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a039ec1-8bb5-49b5-be0b-c74bc708f4a7 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:52.532602 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3428351f-855a-45d5-8825-6a102bd2325f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:52.533637 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3428351f-855a-45d5-8825-6a102bd2325f None admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:52.533928 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3428351f-855a-45d5-8825-6a102bd2325f None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:52.534371 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3428351f-855a-45d5-8825-6a102bd2325f None admin] PATH_INFO: `/v3/projects/b028ff2c5aa54499a9cd429125c28fc7/users/3be5d85ba1164758a27aba26310f23e6/roles/93fda71e71a04ccb862ff5177646d5b5` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:52.536379 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3428351f-855a-45d5-8825-6a102bd2325f None admin] RBAC: Authorizing `identity:create_grant(project_id=b028ff2c5aa54499a9cd429125c28fc7, user_id=3be5d85ba1164758a27aba26310f23e6, role_id=93fda71e71a04ccb862ff5177646d5b5)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:06:52.539270 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3428351f-855a-45d5-8825-6a102bd2325f None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:06:52.557711 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 85/177] 10.222.0.70 () {58 vars in 1439 bytes} [Tue May 10 19:06:52 2022] PUT /identity/v3/projects/b028ff2c5aa54499a9cd429125c28fc7/users/3be5d85ba1164758a27aba26310f23e6/roles/93fda71e71a04ccb862ff5177646d5b5 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 19:06:52.576409 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230b746a-1eee-4bb4-937c-7a0e7cb9ab9f None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:52.612910 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7816fa-ea6d-40f3-b259-28506bca9195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:52.613583 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7816fa-ea6d-40f3-b259-28506bca9195 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:52.613868 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7816fa-ea6d-40f3-b259-28506bca9195 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:52.614144 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7816fa-ea6d-40f3-b259-28506bca9195 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:52.685423 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7816fa-ea6d-40f3-b259-28506bca9195 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:06:52.686939 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7816fa-ea6d-40f3-b259-28506bca9195 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:06:52.790729 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 93/178] 10.222.0.70 () {58 vars in 1282 bytes} [Tue May 10 19:06:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 10 19:06:52.796597 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3428351f-855a-45d5-8825-6a102bd2325f None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:52.908743 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3428351f-855a-45d5-8825-6a102bd2325f None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:52.956870 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d6c6e9-47c0-4812-bc8d-d65b559b07fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:52.956870 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d6c6e9-47c0-4812-bc8d-d65b559b07fa None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:52.956870 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d6c6e9-47c0-4812-bc8d-d65b559b07fa None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:52.956870 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d6c6e9-47c0-4812-bc8d-d65b559b07fa None admin] PATH_INFO: `/v3/projects/6591932d24eb4c8a89c48619ec1c6c2e` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:52.958527 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d6c6e9-47c0-4812-bc8d-d65b559b07fa None admin] RBAC: Authorizing `identity:get_project(project_id=6591932d24eb4c8a89c48619ec1c6c2e)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:06:52.961674 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d6c6e9-47c0-4812-bc8d-d65b559b07fa None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:06:52.961674 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 86/179] 10.222.0.70 () {56 vars in 1186 bytes} [Tue May 10 19:06:52 2022] GET /identity/v3/projects/6591932d24eb4c8a89c48619ec1c6c2e => generated 312 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:06:52.967825 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7816fa-ea6d-40f3-b259-28506bca9195 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:53.074367 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7816fa-ea6d-40f3-b259-28506bca9195 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:53.115854 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a5de42-1a93-4205-89c0-87aefe12513c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:53.116783 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a5de42-1a93-4205-89c0-87aefe12513c None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:53.118615 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42acc49-6b3b-44da-a632-cfbdd719634d None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:53.119050 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42acc49-6b3b-44da-a632-cfbdd719634d None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:53.119493 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42acc49-6b3b-44da-a632-cfbdd719634d None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:53.120629 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a5de42-1a93-4205-89c0-87aefe12513c None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:53.120947 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a5de42-1a93-4205-89c0-87aefe12513c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:53.121522 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 87/180] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:06:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 19:06:53.124468 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a5de42-1a93-4205-89c0-87aefe12513c None admin] RBAC: Adding query filter params (role.id=5c07cf5bfbd3427db18428aa50420962, scope.project.id=6591932d24eb4c8a89c48619ec1c6c2e, user.id=6ad40793dcf0490689f2bcb5b52fd84e) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:06:53.124468 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a5de42-1a93-4205-89c0-87aefe12513c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:06:53.124468 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a5de42-1a93-4205-89c0-87aefe12513c None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:06:53.133345 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda3f98e-3d04-4a9b-9e3a-ab31342e9dc6 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:53.133909 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda3f98e-3d04-4a9b-9e3a-ab31342e9dc6 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:53.134106 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 94/181] 10.222.0.70 () {56 vars in 1374 bytes} [Tue May 10 19:06:52 2022] GET /identity/v3/role_assignments?user.id=6ad40793dcf0490689f2bcb5b52fd84e&scope.project.id=6591932d24eb4c8a89c48619ec1c6c2e&role.id=5c07cf5bfbd3427db18428aa50420962 => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:06:53.134592 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda3f98e-3d04-4a9b-9e3a-ab31342e9dc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:53.173601 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-bda3f98e-3d04-4a9b-9e3a-ab31342e9dc6 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:06:53.175179 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-bda3f98e-3d04-4a9b-9e3a-ab31342e9dc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:06:53.296337 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 88/182] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:06:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 19:06:53.332942 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a5de42-1a93-4205-89c0-87aefe12513c None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:53.478439 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3949c3e-b632-4daa-8fb2-5bd401861c8d None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:53.478753 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3949c3e-b632-4daa-8fb2-5bd401861c8d None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:53.479000 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3949c3e-b632-4daa-8fb2-5bd401861c8d None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:53.480475 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 89/183] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:06:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 19:06:53.485361 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a5de42-1a93-4205-89c0-87aefe12513c None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:53.485485 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec866d4-6805-412c-bae6-150f967fdc51 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:53.485681 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec866d4-6805-412c-bae6-150f967fdc51 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:53.485965 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec866d4-6805-412c-bae6-150f967fdc51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:53.508592 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-eec866d4-6805-412c-bae6-150f967fdc51 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:06:53.509829 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-eec866d4-6805-412c-bae6-150f967fdc51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:06:53.527255 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb20d6fa-93f7-4741-9255-a3b99cd3a734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:53.528451 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb20d6fa-93f7-4741-9255-a3b99cd3a734 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:53.528943 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb20d6fa-93f7-4741-9255-a3b99cd3a734 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:53.529438 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb20d6fa-93f7-4741-9255-a3b99cd3a734 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:53.544082 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb20d6fa-93f7-4741-9255-a3b99cd3a734 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:06:53.552087 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application [None req-cb20d6fa-93f7-4741-9255-a3b99cd3a734 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 19:06:53.552087 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:06:53.552087 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:06:53.552087 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:06:53.552087 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:06:53.552087 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:06:53.552087 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:06:53.552087 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:06:53.552087 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:06:53.552087 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:06:53.552087 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:06:53.552087 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:06:53.552087 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:06:53.552087 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:06:53.552087 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:06:53.552087 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:06:53.553664 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:06:53.553664 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:06:53.553664 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:06:53.553664 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:06:53.553664 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:06:53.553664 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:06:53.553664 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:06:53.553664 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:06:53.553664 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:06:53.553664 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:06:53.553664 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:06:53.553664 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application with Lock( May 10 19:06:53.553664 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:06:53.553664 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._enter() May 10 19:06:53.553664 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:06:53.553664 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:06:53.554481 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:06:53.554481 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.creator() May 10 19:06:53.554481 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:06:53.554481 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application created_value = creator( May 10 19:06:53.554481 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:06:53.554481 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:06:53.554481 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:06:53.554481 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:06:53.554481 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:06:53.554481 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:06:53.554481 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 19:06:53.554481 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application May 10 19:06:53.557454 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 95/184] 10.222.0.70 () {56 vars in 1096 bytes} [Tue May 10 19:06:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:06:53.565759 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb20d6fa-93f7-4741-9255-a3b99cd3a734 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:53.610155 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 90/185] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:06:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 19:06:53.653811 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec866d4-6805-412c-bae6-150f967fdc51 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:53.696759 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb20d6fa-93f7-4741-9255-a3b99cd3a734 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:53.733926 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c03a93a-1ffb-4ac1-86ba-fb25bc96830e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:53.734604 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c03a93a-1ffb-4ac1-86ba-fb25bc96830e None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:53.734886 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c03a93a-1ffb-4ac1-86ba-fb25bc96830e None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:53.735160 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c03a93a-1ffb-4ac1-86ba-fb25bc96830e None admin] PATH_INFO: `/v3/roles` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:53.736037 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c03a93a-1ffb-4ac1-86ba-fb25bc96830e None admin] RBAC: Adding query filter params (name=admin) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:06:53.736587 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c03a93a-1ffb-4ac1-86ba-fb25bc96830e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:06:53.738544 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c03a93a-1ffb-4ac1-86ba-fb25bc96830e None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:06:53.749268 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 96/186] 10.222.0.70 () {56 vars in 1099 bytes} [Tue May 10 19:06:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:06:53.755465 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c03a93a-1ffb-4ac1-86ba-fb25bc96830e None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:53.782317 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec866d4-6805-412c-bae6-150f967fdc51 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:53.821603 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14518aac-1ac2-48e7-a071-ae84783571fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:53.823085 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14518aac-1ac2-48e7-a071-ae84783571fe None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:53.823367 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14518aac-1ac2-48e7-a071-ae84783571fe None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:53.823650 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14518aac-1ac2-48e7-a071-ae84783571fe None admin] PATH_INFO: `/v3/domains/default` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:53.824855 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14518aac-1ac2-48e7-a071-ae84783571fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:06:53.826292 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14518aac-1ac2-48e7-a071-ae84783571fe None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:06:53.827905 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 91/187] 10.222.0.70 () {56 vars in 1108 bytes} [Tue May 10 19:06:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:06:53.829122 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68901f63-3a48-4347-933f-c5f64f212016 None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:53.829405 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68901f63-3a48-4347-933f-c5f64f212016 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:53.829682 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68901f63-3a48-4347-933f-c5f64f212016 None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:53.835330 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 92/188] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:06:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:06:53.835330 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68901f63-3a48-4347-933f-c5f64f212016 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:53.861912 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c03a93a-1ffb-4ac1-86ba-fb25bc96830e None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:53.900096 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc856d4-931e-4339-8484-97703c61a27b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:53.901263 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc856d4-931e-4339-8484-97703c61a27b None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:53.901547 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc856d4-931e-4339-8484-97703c61a27b None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:53.901978 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc856d4-931e-4339-8484-97703c61a27b None admin] PATH_INFO: `/v3/users/8dab2b5634fd49a4aa4558661b5af9b0` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:53.916072 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc856d4-931e-4339-8484-97703c61a27b None admin] RBAC: Authorizing `identity:get_user(user_id=8dab2b5634fd49a4aa4558661b5af9b0)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:06:53.917597 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc856d4-931e-4339-8484-97703c61a27b None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:06:53.919282 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 97/189] 10.222.0.70 () {56 vars in 1177 bytes} [Tue May 10 19:06:53 2022] GET /identity/v3/users/8dab2b5634fd49a4aa4558661b5af9b0 => generated 283 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:06:53.920499 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aa03cf-8733-4d3b-b7c8-841ab3728e7e None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:53.922056 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aa03cf-8733-4d3b-b7c8-841ab3728e7e None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:53.922340 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aa03cf-8733-4d3b-b7c8-841ab3728e7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:53.938497 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-28aa03cf-8733-4d3b-b7c8-841ab3728e7e None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:06:53.939687 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-28aa03cf-8733-4d3b-b7c8-841ab3728e7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:06:53.953547 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68901f63-3a48-4347-933f-c5f64f212016 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:53.988158 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9150a2-5013-4050-bd02-343ccb041c4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:53.989238 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9150a2-5013-4050-bd02-343ccb041c4b None admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:53.989614 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9150a2-5013-4050-bd02-343ccb041c4b None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:53.989928 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9150a2-5013-4050-bd02-343ccb041c4b None admin] PATH_INFO: `/v3/users` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:53.990644 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9150a2-5013-4050-bd02-343ccb041c4b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:06:53.992080 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9150a2-5013-4050-bd02-343ccb041c4b None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:06:54.012477 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 98/190] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:06:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 19:06:54.012477 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aa03cf-8733-4d3b-b7c8-841ab3728e7e None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:54.044456 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 93/191] 10.222.0.70 () {60 vars in 1132 bytes} [Tue May 10 19:06:53 2022] POST /identity/v3/users => generated 297 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:06:54.044456 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9150a2-5013-4050-bd02-343ccb041c4b None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:54.149955 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9150a2-5013-4050-bd02-343ccb041c4b None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:54.162477 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aa03cf-8733-4d3b-b7c8-841ab3728e7e None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:54.191153 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69026087-c8cb-420e-8665-ce9cafbc43d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:54.192509 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69026087-c8cb-420e-8665-ce9cafbc43d0 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:54.192998 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69026087-c8cb-420e-8665-ce9cafbc43d0 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:54.193280 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69026087-c8cb-420e-8665-ce9cafbc43d0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:54.202206 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38e96e6-5065-4169-856e-e1162fcbeebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:54.202881 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38e96e6-5065-4169-856e-e1162fcbeebd None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:54.203163 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38e96e6-5065-4169-856e-e1162fcbeebd None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:54.203492 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38e96e6-5065-4169-856e-e1162fcbeebd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:54.206687 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69026087-c8cb-420e-8665-ce9cafbc43d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:06:54.216711 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-69026087-c8cb-420e-8665-ce9cafbc43d0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 19:06:54.216711 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:06:54.216711 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:06:54.216711 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:06:54.216711 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:06:54.216711 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:06:54.216711 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:06:54.216711 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:06:54.216711 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:06:54.216711 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:06:54.216711 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:06:54.216711 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:06:54.216711 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:06:54.216711 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:06:54.216711 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:06:54.216711 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:06:54.217697 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:06:54.217697 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:06:54.217697 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:06:54.217697 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:06:54.217697 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:06:54.217697 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:06:54.217697 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:06:54.217697 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:06:54.217697 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:06:54.217697 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:06:54.217697 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:06:54.217697 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( May 10 19:06:54.217697 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:06:54.217697 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() May 10 19:06:54.217697 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:06:54.217697 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:06:54.218509 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:06:54.218509 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() May 10 19:06:54.218509 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:06:54.218509 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( May 10 19:06:54.218509 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:06:54.218509 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:06:54.218509 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:06:54.218509 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:06:54.218509 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:06:54.218509 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:06:54.218509 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 19:06:54.218509 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:06:54.218509 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 94/192] 10.222.0.70 () {56 vars in 1114 bytes} [Tue May 10 19:06:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:06:54.226856 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69026087-c8cb-420e-8665-ce9cafbc43d0 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:54.291088 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38e96e6-5065-4169-856e-e1162fcbeebd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:06:54.292650 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38e96e6-5065-4169-856e-e1162fcbeebd None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:06:54.371347 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69026087-c8cb-420e-8665-ce9cafbc43d0 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:54.419880 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a377816-a595-44b1-b26b-6fa4ec463d61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:54.420562 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a377816-a595-44b1-b26b-6fa4ec463d61 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:54.420848 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a377816-a595-44b1-b26b-6fa4ec463d61 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:54.421125 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a377816-a595-44b1-b26b-6fa4ec463d61 None admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:54.422069 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 99/193] 10.222.0.70 () {58 vars in 1282 bytes} [Tue May 10 19:06:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 19:06:54.422178 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a377816-a595-44b1-b26b-6fa4ec463d61 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:06:54.422178 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a377816-a595-44b1-b26b-6fa4ec463d61 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:06:54.423566 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a377816-a595-44b1-b26b-6fa4ec463d61 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:06:54.427372 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38e96e6-5065-4169-856e-e1162fcbeebd None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:54.432460 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 95/194] 10.222.0.70 () {56 vars in 1111 bytes} [Tue May 10 19:06:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:06:54.437856 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a377816-a595-44b1-b26b-6fa4ec463d61 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:54.568995 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38e96e6-5065-4169-856e-e1162fcbeebd None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:54.581655 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a377816-a595-44b1-b26b-6fa4ec463d61 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:54.630161 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7496a2-285c-4ce4-b95c-603c03edcfc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:54.631553 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7496a2-285c-4ce4-b95c-603c03edcfc6 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:54.631833 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7496a2-285c-4ce4-b95c-603c03edcfc6 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:54.632109 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7496a2-285c-4ce4-b95c-603c03edcfc6 None admin] PATH_INFO: `/v3/projects/e0df39feccc3439b965b22d514a229be` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:54.634149 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7496a2-285c-4ce4-b95c-603c03edcfc6 None admin] RBAC: Authorizing `identity:get_project(project_id=e0df39feccc3439b965b22d514a229be)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:06:54.635626 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7496a2-285c-4ce4-b95c-603c03edcfc6 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:06:54.637557 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 100/195] 10.222.0.70 () {56 vars in 1186 bytes} [Tue May 10 19:06:54 2022] GET /identity/v3/projects/e0df39feccc3439b965b22d514a229be => generated 302 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:06:54.640247 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3c2fba-1174-43f3-b019-36b1f747497d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:54.641160 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3c2fba-1174-43f3-b019-36b1f747497d None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:54.641441 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3c2fba-1174-43f3-b019-36b1f747497d None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:54.641713 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3c2fba-1174-43f3-b019-36b1f747497d None admin] PATH_INFO: `/v3/users/8dab2b5634fd49a4aa4558661b5af9b0` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:54.642928 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3c2fba-1174-43f3-b019-36b1f747497d None admin] RBAC: Authorizing `identity:get_user(user_id=8dab2b5634fd49a4aa4558661b5af9b0)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:06:54.644385 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3c2fba-1174-43f3-b019-36b1f747497d None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:06:54.647510 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7496a2-285c-4ce4-b95c-603c03edcfc6 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:54.654426 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 96/196] 10.222.0.70 () {56 vars in 1177 bytes} [Tue May 10 19:06:54 2022] GET /identity/v3/users/8dab2b5634fd49a4aa4558661b5af9b0 => generated 283 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:06:54.655292 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3c2fba-1174-43f3-b019-36b1f747497d None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:54.824444 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7496a2-285c-4ce4-b95c-603c03edcfc6 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:54.843328 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3c2fba-1174-43f3-b019-36b1f747497d None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:54.861098 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc9deb2-190d-40b4-9921-205a487a2e63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:54.864135 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc9deb2-190d-40b4-9921-205a487a2e63 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:54.864135 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc9deb2-190d-40b4-9921-205a487a2e63 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:54.864843 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc9deb2-190d-40b4-9921-205a487a2e63 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:54.866619 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc9deb2-190d-40b4-9921-205a487a2e63 None admin] RBAC: Adding query filter params (role.id=634ba284303b4626b5a0402772c68f5c, scope.project.id=e0df39feccc3439b965b22d514a229be, user.id=8dab2b5634fd49a4aa4558661b5af9b0) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:06:54.866933 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc9deb2-190d-40b4-9921-205a487a2e63 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:06:54.869357 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc9deb2-190d-40b4-9921-205a487a2e63 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:06:54.879112 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 101/197] 10.222.0.70 () {56 vars in 1374 bytes} [Tue May 10 19:06:54 2022] GET /identity/v3/role_assignments?user.id=8dab2b5634fd49a4aa4558661b5af9b0&scope.project.id=e0df39feccc3439b965b22d514a229be&role.id=634ba284303b4626b5a0402772c68f5c => generated 259 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:06:54.899754 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946d6dad-e5f2-430a-b1e2-57dbe69cfb57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:54.900472 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946d6dad-e5f2-430a-b1e2-57dbe69cfb57 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:54.900761 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946d6dad-e5f2-430a-b1e2-57dbe69cfb57 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:54.901038 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946d6dad-e5f2-430a-b1e2-57dbe69cfb57 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:54.975783 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946d6dad-e5f2-430a-b1e2-57dbe69cfb57 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:06:54.977336 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946d6dad-e5f2-430a-b1e2-57dbe69cfb57 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:06:55.079884 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 97/198] 10.222.0.70 () {58 vars in 1282 bytes} [Tue May 10 19:06:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 19:06:55.086407 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc9deb2-190d-40b4-9921-205a487a2e63 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:55.215844 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc9deb2-190d-40b4-9921-205a487a2e63 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:55.249533 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f923974-323f-44d0-a73f-21b370bb60af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:55.250411 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f923974-323f-44d0-a73f-21b370bb60af None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:55.250693 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f923974-323f-44d0-a73f-21b370bb60af None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:55.250967 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f923974-323f-44d0-a73f-21b370bb60af None admin] PATH_INFO: `/v3/projects/e0df39feccc3439b965b22d514a229be` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:55.252154 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f923974-323f-44d0-a73f-21b370bb60af None admin] RBAC: Authorizing `identity:get_project(project_id=e0df39feccc3439b965b22d514a229be)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:06:55.253651 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f923974-323f-44d0-a73f-21b370bb60af None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:06:55.256024 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 102/199] 10.222.0.70 () {56 vars in 1186 bytes} [Tue May 10 19:06:55 2022] GET /identity/v3/projects/e0df39feccc3439b965b22d514a229be => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:06:55.261845 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946d6dad-e5f2-430a-b1e2-57dbe69cfb57 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:55.346413 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691975fc-5d29-44ad-95c9-894d369d7ef1 None None] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:55.346722 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691975fc-5d29-44ad-95c9-894d369d7ef1 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:55.346885 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691975fc-5d29-44ad-95c9-894d369d7ef1 None None] PATH_INFO: `/` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:55.348558 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 103/200] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:06:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 19:06:55.357550 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ed0891-d27c-4281-9792-b2ba6a83db51 None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:55.358088 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ed0891-d27c-4281-9792-b2ba6a83db51 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:55.358581 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ed0891-d27c-4281-9792-b2ba6a83db51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:55.365356 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946d6dad-e5f2-430a-b1e2-57dbe69cfb57 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:55.397417 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-60ed0891-d27c-4281-9792-b2ba6a83db51 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:06:55.398808 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-60ed0891-d27c-4281-9792-b2ba6a83db51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:06:55.399991 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f03082-447d-4fbe-b269-e5c2cd47d603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:55.400853 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f03082-447d-4fbe-b269-e5c2cd47d603 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:55.401275 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f03082-447d-4fbe-b269-e5c2cd47d603 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:55.401687 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f03082-447d-4fbe-b269-e5c2cd47d603 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:55.402651 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f03082-447d-4fbe-b269-e5c2cd47d603 None admin] RBAC: Adding query filter params (role.id=49187695e1bf4c15980bb68c83ca61de, scope.project.id=e0df39feccc3439b965b22d514a229be, user.id=8dab2b5634fd49a4aa4558661b5af9b0) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:06:55.403099 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f03082-447d-4fbe-b269-e5c2cd47d603 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:06:55.404722 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f03082-447d-4fbe-b269-e5c2cd47d603 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:06:55.410763 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 98/201] 10.222.0.70 () {56 vars in 1374 bytes} [Tue May 10 19:06:55 2022] GET /identity/v3/role_assignments?user.id=8dab2b5634fd49a4aa4558661b5af9b0&scope.project.id=e0df39feccc3439b965b22d514a229be&role.id=49187695e1bf4c15980bb68c83ca61de => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:06:55.526971 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 104/202] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:06:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 19:06:55.565433 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f03082-447d-4fbe-b269-e5c2cd47d603 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:55.704029 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f03082-447d-4fbe-b269-e5c2cd47d603 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:55.749159 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646abf40-f2e6-41b3-bc85-c7eb7fd8c9cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:55.749987 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646abf40-f2e6-41b3-bc85-c7eb7fd8c9cb None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:55.750266 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646abf40-f2e6-41b3-bc85-c7eb7fd8c9cb None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:55.750537 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646abf40-f2e6-41b3-bc85-c7eb7fd8c9cb None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:55.760984 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646abf40-f2e6-41b3-bc85-c7eb7fd8c9cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:06:55.768651 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-646abf40-f2e6-41b3-bc85-c7eb7fd8c9cb None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 10 19:06:55.768651 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:06:55.768651 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:06:55.768651 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:06:55.768651 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:06:55.768651 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:06:55.768651 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:06:55.768651 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:06:55.768651 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:06:55.768651 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:06:55.768651 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:06:55.768651 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:06:55.768651 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:06:55.768651 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:06:55.768651 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:06:55.768651 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:06:55.769544 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:06:55.769544 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:06:55.769544 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:06:55.769544 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:06:55.769544 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:06:55.769544 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:06:55.769544 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:06:55.769544 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:06:55.769544 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:06:55.769544 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:06:55.769544 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:06:55.769544 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( May 10 19:06:55.769544 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:06:55.769544 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() May 10 19:06:55.769544 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:06:55.769544 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:06:55.770345 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:06:55.770345 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() May 10 19:06:55.770345 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:06:55.770345 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( May 10 19:06:55.770345 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:06:55.770345 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:06:55.770345 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:06:55.770345 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:06:55.770345 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:06:55.770345 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:06:55.770345 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 10 19:06:55.770345 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:06:55.770345 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 99/203] 10.222.0.70 () {56 vars in 1099 bytes} [Tue May 10 19:06:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:06:55.776289 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ed0891-d27c-4281-9792-b2ba6a83db51 None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:55.902793 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ed0891-d27c-4281-9792-b2ba6a83db51 None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:55.941971 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a706ddea-cb3f-4f64-b129-a4638379bf95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:55.943178 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a706ddea-cb3f-4f64-b129-a4638379bf95 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:55.943474 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a706ddea-cb3f-4f64-b129-a4638379bf95 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:55.943747 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a706ddea-cb3f-4f64-b129-a4638379bf95 None admin] PATH_INFO: `/v3/roles` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:55.944523 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a706ddea-cb3f-4f64-b129-a4638379bf95 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:06:55.944833 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a706ddea-cb3f-4f64-b129-a4638379bf95 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:06:55.946226 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a706ddea-cb3f-4f64-b129-a4638379bf95 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:06:55.957590 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 105/204] 10.222.0.70 () {56 vars in 1101 bytes} [Tue May 10 19:06:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:06:55.963607 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646abf40-f2e6-41b3-bc85-c7eb7fd8c9cb None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:56.069958 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646abf40-f2e6-41b3-bc85-c7eb7fd8c9cb None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:56.103600 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fc80e1-8577-4ca8-87df-1dd5196ce7e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:56.104539 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fc80e1-8577-4ca8-87df-1dd5196ce7e0 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:56.105016 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fc80e1-8577-4ca8-87df-1dd5196ce7e0 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:56.105500 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fc80e1-8577-4ca8-87df-1dd5196ce7e0 None admin] PATH_INFO: `/v3/users/3be5d85ba1164758a27aba26310f23e6` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:56.107489 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fc80e1-8577-4ca8-87df-1dd5196ce7e0 None admin] RBAC: Authorizing `identity:get_user(user_id=3be5d85ba1164758a27aba26310f23e6)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:06:56.109402 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fc80e1-8577-4ca8-87df-1dd5196ce7e0 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:06:56.111037 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 100/205] 10.222.0.70 () {56 vars in 1177 bytes} [Tue May 10 19:06:55 2022] GET /identity/v3/users/3be5d85ba1164758a27aba26310f23e6 => generated 289 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:06:56.116956 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a706ddea-cb3f-4f64-b129-a4638379bf95 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:56.238011 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a706ddea-cb3f-4f64-b129-a4638379bf95 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:56.270861 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd5309a-ab38-4611-8678-e8b6445b10a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:56.272104 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd5309a-ab38-4611-8678-e8b6445b10a4 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:56.272390 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd5309a-ab38-4611-8678-e8b6445b10a4 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:56.272716 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd5309a-ab38-4611-8678-e8b6445b10a4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:56.363739 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd5309a-ab38-4611-8678-e8b6445b10a4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:06:56.365775 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd5309a-ab38-4611-8678-e8b6445b10a4 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:06:56.475790 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 106/206] 10.222.0.70 () {58 vars in 1282 bytes} [Tue May 10 19:06:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 19:06:56.480946 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fc80e1-8577-4ca8-87df-1dd5196ce7e0 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:56.587891 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fc80e1-8577-4ca8-87df-1dd5196ce7e0 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:56.621150 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dec1761-0195-447b-a50c-49ef18face69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:56.622071 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dec1761-0195-447b-a50c-49ef18face69 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:56.622351 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dec1761-0195-447b-a50c-49ef18face69 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:56.622611 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dec1761-0195-447b-a50c-49ef18face69 None admin] PATH_INFO: `/v3/projects/b028ff2c5aa54499a9cd429125c28fc7` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:56.623826 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dec1761-0195-447b-a50c-49ef18face69 None admin] RBAC: Authorizing `identity:get_project(project_id=b028ff2c5aa54499a9cd429125c28fc7)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:06:56.625315 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dec1761-0195-447b-a50c-49ef18face69 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:06:56.627250 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 101/207] 10.222.0.70 () {56 vars in 1186 bytes} [Tue May 10 19:06:56 2022] GET /identity/v3/projects/b028ff2c5aa54499a9cd429125c28fc7 => generated 298 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:06:56.633029 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd5309a-ab38-4611-8678-e8b6445b10a4 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:56.766079 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd5309a-ab38-4611-8678-e8b6445b10a4 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:56.806365 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6357f00-3187-4d08-9568-21a3aa50690d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:56.807021 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6357f00-3187-4d08-9568-21a3aa50690d None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:56.807281 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6357f00-3187-4d08-9568-21a3aa50690d None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:56.807558 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6357f00-3187-4d08-9568-21a3aa50690d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:56.808379 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6357f00-3187-4d08-9568-21a3aa50690d None admin] RBAC: Adding query filter params (role.id=93fda71e71a04ccb862ff5177646d5b5, scope.project.id=b028ff2c5aa54499a9cd429125c28fc7, user.id=3be5d85ba1164758a27aba26310f23e6) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:06:56.808837 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6357f00-3187-4d08-9568-21a3aa50690d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:06:56.810284 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6357f00-3187-4d08-9568-21a3aa50690d None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:06:56.816441 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 107/208] 10.222.0.70 () {56 vars in 1374 bytes} [Tue May 10 19:06:56 2022] GET /identity/v3/role_assignments?user.id=3be5d85ba1164758a27aba26310f23e6&scope.project.id=b028ff2c5aa54499a9cd429125c28fc7&role.id=93fda71e71a04ccb862ff5177646d5b5 => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:06:56.957942 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbccecf1-a97a-4d61-a103-559385959963 None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:56.958642 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbccecf1-a97a-4d61-a103-559385959963 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:56.959117 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbccecf1-a97a-4d61-a103-559385959963 None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:56.961185 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 102/209] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:06:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:06:56.967810 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce99f51-d90e-4a44-a56f-1092a1a9231a None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:56.968759 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce99f51-d90e-4a44-a56f-1092a1a9231a None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:56.969233 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce99f51-d90e-4a44-a56f-1092a1a9231a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:56.987073 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-dce99f51-d90e-4a44-a56f-1092a1a9231a None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:06:56.988766 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-dce99f51-d90e-4a44-a56f-1092a1a9231a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:06:57.070447 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 108/210] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:06:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 19:06:57.112502 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbccecf1-a97a-4d61-a103-559385959963 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:57.292474 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbccecf1-a97a-4d61-a103-559385959963 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:57.357717 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d4e36d-40e7-4e20-973a-e4695f03e929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:57.359041 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d4e36d-40e7-4e20-973a-e4695f03e929 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:57.359534 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d4e36d-40e7-4e20-973a-e4695f03e929 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:57.360010 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d4e36d-40e7-4e20-973a-e4695f03e929 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:57.372134 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a6b30e-ecaa-446b-9b03-955a4fdcbafc None None] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:57.372758 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a6b30e-ecaa-446b-9b03-955a4fdcbafc None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:57.373081 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a6b30e-ecaa-446b-9b03-955a4fdcbafc None None] PATH_INFO: `/` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:57.374643 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 109/211] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:06:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 19:06:57.377716 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d4e36d-40e7-4e20-973a-e4695f03e929 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:06:57.379916 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b15797-032b-498a-abf4-747765928ae5 None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:57.380514 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b15797-032b-498a-abf4-747765928ae5 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:57.381021 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b15797-032b-498a-abf4-747765928ae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:57.392933 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-49d4e36d-40e7-4e20-973a-e4695f03e929 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 19:06:57.392933 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:06:57.392933 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:06:57.392933 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:06:57.392933 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:06:57.392933 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:06:57.392933 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:06:57.392933 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:06:57.392933 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:06:57.392933 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:06:57.392933 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:06:57.392933 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:06:57.392933 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:06:57.392933 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:06:57.392933 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:06:57.392933 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:06:57.393866 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:06:57.393866 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:06:57.393866 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:06:57.393866 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:06:57.393866 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:06:57.393866 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:06:57.393866 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:06:57.393866 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:06:57.393866 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:06:57.393866 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:06:57.393866 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:06:57.393866 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( May 10 19:06:57.393866 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:06:57.393866 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() May 10 19:06:57.393866 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:06:57.393866 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:06:57.394649 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:06:57.394649 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() May 10 19:06:57.394649 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:06:57.394649 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( May 10 19:06:57.394649 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:06:57.394649 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:06:57.394649 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:06:57.394649 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:06:57.394649 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:06:57.394649 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:06:57.394649 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 19:06:57.394649 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:06:57.395245 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 103/212] 10.222.0.70 () {56 vars in 1099 bytes} [Tue May 10 19:06:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:06:57.402598 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d4e36d-40e7-4e20-973a-e4695f03e929 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:57.404916 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-03b15797-032b-498a-abf4-747765928ae5 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:06:57.406305 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-03b15797-032b-498a-abf4-747765928ae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:06:57.495495 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 110/213] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:06:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 19:06:57.510511 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d4e36d-40e7-4e20-973a-e4695f03e929 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:57.515768 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b15797-032b-498a-abf4-747765928ae5 None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:57.546472 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45094d5-1317-49e4-bde4-89f78737a365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:57.547479 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45094d5-1317-49e4-bde4-89f78737a365 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:57.547962 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45094d5-1317-49e4-bde4-89f78737a365 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:57.548453 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45094d5-1317-49e4-bde4-89f78737a365 None admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:57.549391 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45094d5-1317-49e4-bde4-89f78737a365 None admin] RBAC: Adding query filter params (name=member) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:06:57.549919 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45094d5-1317-49e4-bde4-89f78737a365 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:06:57.551481 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45094d5-1317-49e4-bde4-89f78737a365 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:06:57.560317 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 104/214] 10.222.0.70 () {56 vars in 1101 bytes} [Tue May 10 19:06:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:06:57.566155 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45094d5-1317-49e4-bde4-89f78737a365 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:57.633836 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b15797-032b-498a-abf4-747765928ae5 None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:57.677128 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e85a7e-2dd9-455e-bf9f-500684f20394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:57.678733 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e85a7e-2dd9-455e-bf9f-500684f20394 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:57.679468 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e85a7e-2dd9-455e-bf9f-500684f20394 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:57.679950 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e85a7e-2dd9-455e-bf9f-500684f20394 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:57.681813 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e85a7e-2dd9-455e-bf9f-500684f20394 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:06:57.683764 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e85a7e-2dd9-455e-bf9f-500684f20394 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:06:57.684068 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45094d5-1317-49e4-bde4-89f78737a365 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:57.691851 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 111/215] 10.222.0.70 () {56 vars in 1108 bytes} [Tue May 10 19:06:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:06:57.693555 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e85a7e-2dd9-455e-bf9f-500684f20394 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:57.722552 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e3f8d3-cffd-4838-adbb-0016ad81245f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:57.723597 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e3f8d3-cffd-4838-adbb-0016ad81245f None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:57.724399 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e3f8d3-cffd-4838-adbb-0016ad81245f None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:57.724723 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e3f8d3-cffd-4838-adbb-0016ad81245f None admin] PATH_INFO: `/v3/users/f364656bffa6413f9434e7cbc0df6fb5` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:57.739349 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e3f8d3-cffd-4838-adbb-0016ad81245f None admin] RBAC: Authorizing `identity:get_user(user_id=f364656bffa6413f9434e7cbc0df6fb5)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:06:57.740969 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e3f8d3-cffd-4838-adbb-0016ad81245f None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:06:57.742723 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 105/216] 10.222.0.70 () {56 vars in 1177 bytes} [Tue May 10 19:06:57 2022] GET /identity/v3/users/f364656bffa6413f9434e7cbc0df6fb5 => generated 297 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:06:57.748213 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e3f8d3-cffd-4838-adbb-0016ad81245f None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:57.820029 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e85a7e-2dd9-455e-bf9f-500684f20394 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:57.847385 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e3f8d3-cffd-4838-adbb-0016ad81245f None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:57.865863 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cccf61b-ab6c-4806-8dd8-ec301b2f4d38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:57.867269 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cccf61b-ab6c-4806-8dd8-ec301b2f4d38 None admin] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:57.867762 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cccf61b-ab6c-4806-8dd8-ec301b2f4d38 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:57.868255 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cccf61b-ab6c-4806-8dd8-ec301b2f4d38 None admin] PATH_INFO: `/v3/users` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:57.869222 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cccf61b-ab6c-4806-8dd8-ec301b2f4d38 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:06:57.871932 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cccf61b-ab6c-4806-8dd8-ec301b2f4d38 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:06:57.884759 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a39b2dc-da8a-4c4d-9332-5eebf1ac929b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:57.885551 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a39b2dc-da8a-4c4d-9332-5eebf1ac929b None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:57.885730 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a39b2dc-da8a-4c4d-9332-5eebf1ac929b None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:57.886166 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a39b2dc-da8a-4c4d-9332-5eebf1ac929b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:57.900237 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 112/217] 10.222.0.70 () {60 vars in 1132 bytes} [Tue May 10 19:06:57 2022] POST /identity/v3/users => generated 297 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:06:57.984616 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a39b2dc-da8a-4c4d-9332-5eebf1ac929b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:06:57.986134 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a39b2dc-da8a-4c4d-9332-5eebf1ac929b None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:06:58.059306 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80c877a-5d7d-4339-a625-f852ad3a7966 None None] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:58.059844 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80c877a-5d7d-4339-a625-f852ad3a7966 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:58.059844 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80c877a-5d7d-4339-a625-f852ad3a7966 None None] PATH_INFO: `/` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:58.061698 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 113/218] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:06:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 19:06:58.072489 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc15536f-31da-49c0-ac06-19a96ed050fa None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:58.072908 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc15536f-31da-49c0-ac06-19a96ed050fa None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:58.073388 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc15536f-31da-49c0-ac06-19a96ed050fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:58.099717 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 106/219] 10.222.0.70 () {58 vars in 1282 bytes} [Tue May 10 19:06:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 19:06:58.110452 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a39b2dc-da8a-4c4d-9332-5eebf1ac929b None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:58.113633 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-fc15536f-31da-49c0-ac06-19a96ed050fa None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:06:58.115109 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-fc15536f-31da-49c0-ac06-19a96ed050fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:06:58.213769 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 114/220] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:06:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 19:06:58.235936 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc15536f-31da-49c0-ac06-19a96ed050fa None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:58.236108 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a39b2dc-da8a-4c4d-9332-5eebf1ac929b None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:58.282588 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3893b2f-cc66-405c-9e53-cd24dcfe7f49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:58.283880 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3893b2f-cc66-405c-9e53-cd24dcfe7f49 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:58.284163 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3893b2f-cc66-405c-9e53-cd24dcfe7f49 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:58.284448 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3893b2f-cc66-405c-9e53-cd24dcfe7f49 None admin] PATH_INFO: `/v3/projects/e0df39feccc3439b965b22d514a229be` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:58.286777 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3893b2f-cc66-405c-9e53-cd24dcfe7f49 None admin] RBAC: Authorizing `identity:get_project(project_id=e0df39feccc3439b965b22d514a229be)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:06:58.288274 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3893b2f-cc66-405c-9e53-cd24dcfe7f49 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:06:58.290434 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 107/221] 10.222.0.70 () {56 vars in 1186 bytes} [Tue May 10 19:06:58 2022] GET /identity/v3/projects/e0df39feccc3439b965b22d514a229be => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:06:58.296216 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3893b2f-cc66-405c-9e53-cd24dcfe7f49 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:58.374862 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc15536f-31da-49c0-ac06-19a96ed050fa None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:58.406680 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3893b2f-cc66-405c-9e53-cd24dcfe7f49 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:58.418671 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563f8b6c-9a2b-4fc0-ac89-70e64b416b03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:58.419527 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563f8b6c-9a2b-4fc0-ac89-70e64b416b03 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:58.419813 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563f8b6c-9a2b-4fc0-ac89-70e64b416b03 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:58.420514 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563f8b6c-9a2b-4fc0-ac89-70e64b416b03 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:58.436348 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563f8b6c-9a2b-4fc0-ac89-70e64b416b03 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:06:58.445820 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application [None req-563f8b6c-9a2b-4fc0-ac89-70e64b416b03 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 19:06:58.445820 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:06:58.445820 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:06:58.445820 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:06:58.445820 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:06:58.445820 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:06:58.445820 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:06:58.445820 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:06:58.445820 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:06:58.445820 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:06:58.445820 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:06:58.445820 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:06:58.445820 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:06:58.445820 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:06:58.445820 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:06:58.445820 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:06:58.446742 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:06:58.446742 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:06:58.446742 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:06:58.446742 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:06:58.446742 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:06:58.446742 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:06:58.446742 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:06:58.446742 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:06:58.446742 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:06:58.446742 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:06:58.446742 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:06:58.446742 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application with Lock( May 10 19:06:58.446742 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:06:58.446742 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._enter() May 10 19:06:58.446742 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:06:58.446742 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:06:58.447943 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:06:58.447943 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.creator() May 10 19:06:58.447943 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:06:58.447943 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application created_value = creator( May 10 19:06:58.447943 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:06:58.447943 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:06:58.447943 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:06:58.447943 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:06:58.447943 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:06:58.447943 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:06:58.447943 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 19:06:58.447943 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application May 10 19:06:58.447943 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 115/222] 10.222.0.70 () {56 vars in 1096 bytes} [Tue May 10 19:06:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 19:06:58.452650 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563f8b6c-9a2b-4fc0-ac89-70e64b416b03 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:58.468875 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad18d80-da36-4272-aa22-8b5adf9983f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:58.469552 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad18d80-da36-4272-aa22-8b5adf9983f5 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:58.470011 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad18d80-da36-4272-aa22-8b5adf9983f5 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:58.470288 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad18d80-da36-4272-aa22-8b5adf9983f5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:58.471806 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad18d80-da36-4272-aa22-8b5adf9983f5 None admin] RBAC: Adding query filter params (role.id=5c07cf5bfbd3427db18428aa50420962, scope.project.id=e0df39feccc3439b965b22d514a229be, user.id=f364656bffa6413f9434e7cbc0df6fb5) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:06:58.472141 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad18d80-da36-4272-aa22-8b5adf9983f5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:06:58.474576 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad18d80-da36-4272-aa22-8b5adf9983f5 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:06:58.486022 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 108/223] 10.222.0.70 () {56 vars in 1374 bytes} [Tue May 10 19:06:58 2022] GET /identity/v3/role_assignments?user.id=f364656bffa6413f9434e7cbc0df6fb5&scope.project.id=e0df39feccc3439b965b22d514a229be&role.id=5c07cf5bfbd3427db18428aa50420962 => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:06:58.516460 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574114d6-7cae-4162-aec5-c5ebaf9ef8ce None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:58.516818 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574114d6-7cae-4162-aec5-c5ebaf9ef8ce None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:58.517190 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574114d6-7cae-4162-aec5-c5ebaf9ef8ce None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:58.518668 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 109/224] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:06:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 19:06:58.524603 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0683cfe-bf47-466c-b633-e25c45be25b5 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:58.525027 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0683cfe-bf47-466c-b633-e25c45be25b5 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:58.525412 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0683cfe-bf47-466c-b633-e25c45be25b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:58.544299 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-c0683cfe-bf47-466c-b633-e25c45be25b5 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:06:58.545757 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-c0683cfe-bf47-466c-b633-e25c45be25b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:06:58.645498 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563f8b6c-9a2b-4fc0-ac89-70e64b416b03 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:58.671009 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 110/225] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:06:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 19:06:58.710873 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0683cfe-bf47-466c-b633-e25c45be25b5 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:58.726103 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab08d49-777d-45ca-a0dc-2cde54900071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:58.726787 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab08d49-777d-45ca-a0dc-2cde54900071 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:58.727068 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab08d49-777d-45ca-a0dc-2cde54900071 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:58.727343 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab08d49-777d-45ca-a0dc-2cde54900071 None admin] PATH_INFO: `/v3/roles` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:58.728103 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab08d49-777d-45ca-a0dc-2cde54900071 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:06:58.728409 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab08d49-777d-45ca-a0dc-2cde54900071 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:06:58.729837 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab08d49-777d-45ca-a0dc-2cde54900071 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:06:58.740832 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 116/226] 10.222.0.70 () {56 vars in 1099 bytes} [Tue May 10 19:06:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:06:58.746967 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab08d49-777d-45ca-a0dc-2cde54900071 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:58.871501 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab08d49-777d-45ca-a0dc-2cde54900071 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:58.872263 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0683cfe-bf47-466c-b633-e25c45be25b5 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:58.905783 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eea836d-bdb1-4a39-8ea5-c04a619aa70f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:58.906858 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eea836d-bdb1-4a39-8ea5-c04a619aa70f None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:58.907293 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eea836d-bdb1-4a39-8ea5-c04a619aa70f None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:58.907578 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eea836d-bdb1-4a39-8ea5-c04a619aa70f None admin] PATH_INFO: `/v3/users/8dab2b5634fd49a4aa4558661b5af9b0` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:58.913209 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eea836d-bdb1-4a39-8ea5-c04a619aa70f None admin] RBAC: Authorizing `identity:get_user(user_id=8dab2b5634fd49a4aa4558661b5af9b0)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:06:58.914693 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eea836d-bdb1-4a39-8ea5-c04a619aa70f None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:06:58.916874 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 117/227] 10.222.0.70 () {56 vars in 1177 bytes} [Tue May 10 19:06:58 2022] GET /identity/v3/users/8dab2b5634fd49a4aa4558661b5af9b0 => generated 283 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:06:58.922866 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eea836d-bdb1-4a39-8ea5-c04a619aa70f None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:58.926672 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b27fee-8d49-4dbd-a629-9cac8cd5b71a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:58.927525 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b27fee-8d49-4dbd-a629-9cac8cd5b71a None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:58.927806 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b27fee-8d49-4dbd-a629-9cac8cd5b71a None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:58.928081 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b27fee-8d49-4dbd-a629-9cac8cd5b71a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:58.963353 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b27fee-8d49-4dbd-a629-9cac8cd5b71a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:06:58.976812 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-16b27fee-8d49-4dbd-a629-9cac8cd5b71a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 19:06:58.976812 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:06:58.976812 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:06:58.976812 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:06:58.976812 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:06:58.976812 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:06:58.976812 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:06:58.976812 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:06:58.976812 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:06:58.976812 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:06:58.976812 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:06:58.976812 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:06:58.976812 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:06:58.976812 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:06:58.976812 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:06:58.976812 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:06:58.977727 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:06:58.977727 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:06:58.977727 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:06:58.977727 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:06:58.977727 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:06:58.977727 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:06:58.977727 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:06:58.977727 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:06:58.977727 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:06:58.977727 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:06:58.977727 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:06:58.977727 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( May 10 19:06:58.977727 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:06:58.977727 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() May 10 19:06:58.977727 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:06:58.977727 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:06:58.979317 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:06:58.979317 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() May 10 19:06:58.979317 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:06:58.979317 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( May 10 19:06:58.979317 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:06:58.979317 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:06:58.979317 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:06:58.979317 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:06:58.979317 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:06:58.979317 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:06:58.979317 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 19:06:58.979317 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:06:58.979317 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 111/228] 10.222.0.70 () {56 vars in 1114 bytes} [Tue May 10 19:06:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 19:06:58.986558 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b27fee-8d49-4dbd-a629-9cac8cd5b71a None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:59.110210 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b27fee-8d49-4dbd-a629-9cac8cd5b71a None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:59.148825 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd974e95-d35d-40f3-aad8-11266b4f4dba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:59.149559 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd974e95-d35d-40f3-aad8-11266b4f4dba None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:59.149844 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd974e95-d35d-40f3-aad8-11266b4f4dba None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:59.150129 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd974e95-d35d-40f3-aad8-11266b4f4dba None admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:59.156501 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd974e95-d35d-40f3-aad8-11266b4f4dba None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:06:59.156501 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd974e95-d35d-40f3-aad8-11266b4f4dba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:06:59.156501 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd974e95-d35d-40f3-aad8-11266b4f4dba None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:06:59.158739 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eea836d-bdb1-4a39-8ea5-c04a619aa70f None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:59.163014 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 112/229] 10.222.0.70 () {56 vars in 1111 bytes} [Tue May 10 19:06:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:06:59.173406 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd974e95-d35d-40f3-aad8-11266b4f4dba None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:59.196055 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b5f049-df17-43a1-8e2a-e1e6d1dafe1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:59.198341 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b5f049-df17-43a1-8e2a-e1e6d1dafe1c None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:59.199469 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b5f049-df17-43a1-8e2a-e1e6d1dafe1c None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:59.200087 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b5f049-df17-43a1-8e2a-e1e6d1dafe1c None admin] PATH_INFO: `/v3/projects/e0df39feccc3439b965b22d514a229be` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:59.203477 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b5f049-df17-43a1-8e2a-e1e6d1dafe1c None admin] RBAC: Authorizing `identity:get_project(project_id=e0df39feccc3439b965b22d514a229be)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:06:59.205843 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b5f049-df17-43a1-8e2a-e1e6d1dafe1c None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:06:59.216493 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 118/230] 10.222.0.70 () {56 vars in 1186 bytes} [Tue May 10 19:06:58 2022] GET /identity/v3/projects/e0df39feccc3439b965b22d514a229be => generated 302 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:06:59.217359 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b5f049-df17-43a1-8e2a-e1e6d1dafe1c None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:59.296108 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd974e95-d35d-40f3-aad8-11266b4f4dba None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:59.331928 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6159928-1a72-422a-93e6-396f3f57556c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:59.334042 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6159928-1a72-422a-93e6-396f3f57556c None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:59.334615 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6159928-1a72-422a-93e6-396f3f57556c None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:59.335091 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6159928-1a72-422a-93e6-396f3f57556c None admin] PATH_INFO: `/v3/users/8dab2b5634fd49a4aa4558661b5af9b0` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:59.336671 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6159928-1a72-422a-93e6-396f3f57556c None admin] RBAC: Authorizing `identity:get_user(user_id=8dab2b5634fd49a4aa4558661b5af9b0)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:06:59.338338 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6159928-1a72-422a-93e6-396f3f57556c None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:06:59.340206 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 113/231] 10.222.0.70 () {56 vars in 1177 bytes} [Tue May 10 19:06:59 2022] GET /identity/v3/users/8dab2b5634fd49a4aa4558661b5af9b0 => generated 283 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:06:59.345932 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6159928-1a72-422a-93e6-396f3f57556c None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:59.434972 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b5f049-df17-43a1-8e2a-e1e6d1dafe1c None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:59.469097 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202f776c-5cf1-4353-a427-e88b93106b6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:59.470001 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202f776c-5cf1-4353-a427-e88b93106b6e None admin] REQUEST_METHOD: `PUT` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:59.470526 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202f776c-5cf1-4353-a427-e88b93106b6e None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:59.470812 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202f776c-5cf1-4353-a427-e88b93106b6e None admin] PATH_INFO: `/v3/projects/e0df39feccc3439b965b22d514a229be/users/8dab2b5634fd49a4aa4558661b5af9b0/roles/634ba284303b4626b5a0402772c68f5c` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:59.474885 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202f776c-5cf1-4353-a427-e88b93106b6e None admin] RBAC: Authorizing `identity:create_grant(project_id=e0df39feccc3439b965b22d514a229be, user_id=8dab2b5634fd49a4aa4558661b5af9b0, role_id=634ba284303b4626b5a0402772c68f5c)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:06:59.480714 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202f776c-5cf1-4353-a427-e88b93106b6e None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:06:59.502669 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 119/232] 10.222.0.70 () {58 vars in 1439 bytes} [Tue May 10 19:06:59 2022] PUT /identity/v3/projects/e0df39feccc3439b965b22d514a229be/users/8dab2b5634fd49a4aa4558661b5af9b0/roles/634ba284303b4626b5a0402772c68f5c => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:06:59.522510 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6159928-1a72-422a-93e6-396f3f57556c None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:59.584197 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c908795-7da1-4ecf-8854-a16f439c3f86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:59.585132 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c908795-7da1-4ecf-8854-a16f439c3f86 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:59.585415 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c908795-7da1-4ecf-8854-a16f439c3f86 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:59.585690 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c908795-7da1-4ecf-8854-a16f439c3f86 None admin] PATH_INFO: `/v3/projects/e0df39feccc3439b965b22d514a229be` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:59.593352 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c908795-7da1-4ecf-8854-a16f439c3f86 None admin] RBAC: Authorizing `identity:get_project(project_id=e0df39feccc3439b965b22d514a229be)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:06:59.594957 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c908795-7da1-4ecf-8854-a16f439c3f86 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:06:59.597240 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 114/233] 10.222.0.70 () {56 vars in 1186 bytes} [Tue May 10 19:06:59 2022] GET /identity/v3/projects/e0df39feccc3439b965b22d514a229be => generated 302 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:06:59.603648 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202f776c-5cf1-4353-a427-e88b93106b6e None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:59.726417 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202f776c-5cf1-4353-a427-e88b93106b6e None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:59.762877 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbd0c17-a589-40f3-a421-5731914fcbbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:59.763776 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbd0c17-a589-40f3-a421-5731914fcbbc None admin] REQUEST_METHOD: `PUT` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:59.764068 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbd0c17-a589-40f3-a421-5731914fcbbc None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:59.764338 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbd0c17-a589-40f3-a421-5731914fcbbc None admin] PATH_INFO: `/v3/projects/e0df39feccc3439b965b22d514a229be/users/8dab2b5634fd49a4aa4558661b5af9b0/roles/49187695e1bf4c15980bb68c83ca61de` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:59.767640 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbd0c17-a589-40f3-a421-5731914fcbbc None admin] RBAC: Authorizing `identity:create_grant(project_id=e0df39feccc3439b965b22d514a229be, user_id=8dab2b5634fd49a4aa4558661b5af9b0, role_id=49187695e1bf4c15980bb68c83ca61de)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:06:59.769273 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbd0c17-a589-40f3-a421-5731914fcbbc None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:06:59.792996 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 120/234] 10.222.0.70 () {58 vars in 1439 bytes} [Tue May 10 19:06:59 2022] PUT /identity/v3/projects/e0df39feccc3439b965b22d514a229be/users/8dab2b5634fd49a4aa4558661b5af9b0/roles/49187695e1bf4c15980bb68c83ca61de => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 19:07:00.829505 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e5421c-fd6f-4d29-a9a6-5815dfecb739 None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:00.830013 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e5421c-fd6f-4d29-a9a6-5815dfecb739 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:00.830280 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e5421c-fd6f-4d29-a9a6-5815dfecb739 None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:00.831494 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 115/235] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:07:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:07:00.850336 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e9259c-617a-4eb4-b718-b3bbd495ba11 None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:00.850827 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e9259c-617a-4eb4-b718-b3bbd495ba11 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:00.850899 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e9259c-617a-4eb4-b718-b3bbd495ba11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:00.872506 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-b5e9259c-617a-4eb4-b718-b3bbd495ba11 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:07:00.873730 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-b5e9259c-617a-4eb4-b718-b3bbd495ba11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:07:00.921669 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c46aa57-bcdd-4f7a-9e3d-dcd82a3bbb80 None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:00.921990 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c46aa57-bcdd-4f7a-9e3d-dcd82a3bbb80 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:00.922227 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c46aa57-bcdd-4f7a-9e3d-dcd82a3bbb80 None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:00.923605 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 116/236] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:07:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 19:07:00.934146 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ffd855-9c26-4e5f-a11c-ab0165c6ad70 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:00.934444 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ffd855-9c26-4e5f-a11c-ab0165c6ad70 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:00.935982 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ffd855-9c26-4e5f-a11c-ab0165c6ad70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:00.970603 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-22ffd855-9c26-4e5f-a11c-ab0165c6ad70 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:07:00.971806 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-22ffd855-9c26-4e5f-a11c-ab0165c6ad70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:07:00.992497 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 121/237] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:07:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 19:07:01.020451 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e9259c-617a-4eb4-b718-b3bbd495ba11 None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:01.113826 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 117/238] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:07:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 19:07:01.138446 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ffd855-9c26-4e5f-a11c-ab0165c6ad70 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:01.166856 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e9259c-617a-4eb4-b718-b3bbd495ba11 None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:01.229597 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab453a5c-af3f-4cd4-865a-2d91c4debc67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:01.230452 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab453a5c-af3f-4cd4-865a-2d91c4debc67 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:01.230739 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab453a5c-af3f-4cd4-865a-2d91c4debc67 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:01.231014 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab453a5c-af3f-4cd4-865a-2d91c4debc67 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:01.250462 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab453a5c-af3f-4cd4-865a-2d91c4debc67 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:07:01.259930 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application [None req-ab453a5c-af3f-4cd4-865a-2d91c4debc67 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 10 19:07:01.259930 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:07:01.259930 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:07:01.259930 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:07:01.259930 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:07:01.259930 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:07:01.259930 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:07:01.259930 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:07:01.259930 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:07:01.259930 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:07:01.259930 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:07:01.259930 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:07:01.259930 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:07:01.259930 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:07:01.259930 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:07:01.259930 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:07:01.260849 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:07:01.260849 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:07:01.260849 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:07:01.260849 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:07:01.260849 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:07:01.260849 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:07:01.260849 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:07:01.260849 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:07:01.260849 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:07:01.260849 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:07:01.260849 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:07:01.260849 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application with Lock( May 10 19:07:01.260849 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:07:01.260849 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._enter() May 10 19:07:01.260849 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:07:01.260849 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:07:01.261666 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:07:01.261666 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.creator() May 10 19:07:01.261666 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:07:01.261666 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application created_value = creator( May 10 19:07:01.261666 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:07:01.261666 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:07:01.261666 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:07:01.261666 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:07:01.261666 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:07:01.261666 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:07:01.261666 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 10 19:07:01.261666 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application May 10 19:07:01.261666 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 122/239] 10.222.0.70 () {56 vars in 1099 bytes} [Tue May 10 19:07:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 19:07:01.268743 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab453a5c-af3f-4cd4-865a-2d91c4debc67 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:01.294748 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ffd855-9c26-4e5f-a11c-ab0165c6ad70 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:01.339548 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a847825-76f9-490f-a53f-e07e4607c089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:01.340693 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a847825-76f9-490f-a53f-e07e4607c089 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:01.340980 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a847825-76f9-490f-a53f-e07e4607c089 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:01.341254 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a847825-76f9-490f-a53f-e07e4607c089 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:01.342706 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a847825-76f9-490f-a53f-e07e4607c089 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:01.344963 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a847825-76f9-490f-a53f-e07e4607c089 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:01.350880 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 118/240] 10.222.0.70 () {56 vars in 1108 bytes} [Tue May 10 19:07:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:07:01.350880 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afd7bf7-e951-4728-a45d-8725c69b3b09 None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:01.350880 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afd7bf7-e951-4728-a45d-8725c69b3b09 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:01.350880 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afd7bf7-e951-4728-a45d-8725c69b3b09 None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:01.350880 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 119/241] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:07:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:07:01.353999 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afd7bf7-e951-4728-a45d-8725c69b3b09 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:01.398339 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab453a5c-af3f-4cd4-865a-2d91c4debc67 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:01.441375 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2838059-2631-4b36-b744-2f3d0da885b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:01.442520 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2838059-2631-4b36-b744-2f3d0da885b4 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:01.442820 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2838059-2631-4b36-b744-2f3d0da885b4 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:01.443374 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2838059-2631-4b36-b744-2f3d0da885b4 None admin] PATH_INFO: `/v3/roles` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:01.444282 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2838059-2631-4b36-b744-2f3d0da885b4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:07:01.444628 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2838059-2631-4b36-b744-2f3d0da885b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:01.446647 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2838059-2631-4b36-b744-2f3d0da885b4 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:01.454021 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afd7bf7-e951-4728-a45d-8725c69b3b09 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:01.457085 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 123/242] 10.222.0.70 () {56 vars in 1101 bytes} [Tue May 10 19:07:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:07:01.458673 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf447a87-dd73-41b5-9312-4fd5509da8eb None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:01.458964 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf447a87-dd73-41b5-9312-4fd5509da8eb None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:01.459245 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf447a87-dd73-41b5-9312-4fd5509da8eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:01.488343 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-bf447a87-dd73-41b5-9312-4fd5509da8eb None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:07:01.490771 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-bf447a87-dd73-41b5-9312-4fd5509da8eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:07:01.493279 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b0b5ac-71e6-4ccd-ac38-693fe1fe8019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:01.494811 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b0b5ac-71e6-4ccd-ac38-693fe1fe8019 None admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:01.494811 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b0b5ac-71e6-4ccd-ac38-693fe1fe8019 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:01.494811 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b0b5ac-71e6-4ccd-ac38-693fe1fe8019 None admin] PATH_INFO: `/v3/users` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:01.495583 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b0b5ac-71e6-4ccd-ac38-693fe1fe8019 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:01.497242 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b0b5ac-71e6-4ccd-ac38-693fe1fe8019 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:01.520346 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 120/243] 10.222.0.70 () {60 vars in 1132 bytes} [Tue May 10 19:07:01 2022] POST /identity/v3/users => generated 293 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 19:07:01.521932 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b0b5ac-71e6-4ccd-ac38-693fe1fe8019 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:01.565058 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 124/244] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:07:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 19:07:01.591689 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf447a87-dd73-41b5-9312-4fd5509da8eb None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:01.650402 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b0b5ac-71e6-4ccd-ac38-693fe1fe8019 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:01.695271 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1528680-6965-47ce-8c8a-96fbcc57eeb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:01.696705 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1528680-6965-47ce-8c8a-96fbcc57eeb6 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:01.697478 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1528680-6965-47ce-8c8a-96fbcc57eeb6 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:01.698209 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1528680-6965-47ce-8c8a-96fbcc57eeb6 None admin] PATH_INFO: `/v3/users/187e812c10ea4f99990d929f031ecbe6` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:01.700177 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf447a87-dd73-41b5-9312-4fd5509da8eb None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:01.717091 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1528680-6965-47ce-8c8a-96fbcc57eeb6 None admin] RBAC: Authorizing `identity:get_user(user_id=187e812c10ea4f99990d929f031ecbe6)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:01.719325 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1528680-6965-47ce-8c8a-96fbcc57eeb6 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:01.721583 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 121/245] 10.222.0.70 () {56 vars in 1177 bytes} [Tue May 10 19:07:01 2022] GET /identity/v3/users/187e812c10ea4f99990d929f031ecbe6 => generated 297 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:07:01.727426 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1528680-6965-47ce-8c8a-96fbcc57eeb6 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:01.737895 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa7f1af-9a94-44da-be88-52cea1b02f20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:01.738684 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa7f1af-9a94-44da-be88-52cea1b02f20 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:01.739041 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa7f1af-9a94-44da-be88-52cea1b02f20 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:01.740160 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa7f1af-9a94-44da-be88-52cea1b02f20 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:01.751312 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa7f1af-9a94-44da-be88-52cea1b02f20 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:07:01.759321 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application [None req-9fa7f1af-9a94-44da-be88-52cea1b02f20 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 19:07:01.759321 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:07:01.759321 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:07:01.759321 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:07:01.759321 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:07:01.759321 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:07:01.759321 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:07:01.759321 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:07:01.759321 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:07:01.759321 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:07:01.759321 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:07:01.759321 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:07:01.759321 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:07:01.759321 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:07:01.759321 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:07:01.759321 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:07:01.760237 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:07:01.760237 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:07:01.760237 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:07:01.760237 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:07:01.760237 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:07:01.760237 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:07:01.760237 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:07:01.760237 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:07:01.760237 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:07:01.760237 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:07:01.760237 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:07:01.760237 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application with Lock( May 10 19:07:01.760237 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:07:01.760237 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._enter() May 10 19:07:01.760237 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:07:01.760237 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:07:01.761081 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:07:01.761081 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.creator() May 10 19:07:01.761081 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:07:01.761081 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application created_value = creator( May 10 19:07:01.761081 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:07:01.761081 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:07:01.761081 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:07:01.761081 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:07:01.761081 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:07:01.761081 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:07:01.761081 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 19:07:01.761081 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application May 10 19:07:01.761081 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 125/246] 10.222.0.70 () {56 vars in 1099 bytes} [Tue May 10 19:07:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 19:07:01.767007 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa7f1af-9a94-44da-be88-52cea1b02f20 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:01.854005 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1528680-6965-47ce-8c8a-96fbcc57eeb6 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:01.881693 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa7f1af-9a94-44da-be88-52cea1b02f20 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:01.909591 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df5b3b5-055d-444f-87ea-8d3e857adb79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:01.910603 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df5b3b5-055d-444f-87ea-8d3e857adb79 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:01.911106 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df5b3b5-055d-444f-87ea-8d3e857adb79 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:01.911843 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df5b3b5-055d-444f-87ea-8d3e857adb79 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:01.937952 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dd54ea-ab0b-4ec7-8383-72e4559fe07b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:01.939308 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dd54ea-ab0b-4ec7-8383-72e4559fe07b None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:01.939820 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dd54ea-ab0b-4ec7-8383-72e4559fe07b None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:01.940309 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dd54ea-ab0b-4ec7-8383-72e4559fe07b None admin] PATH_INFO: `/v3/roles` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:01.941334 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dd54ea-ab0b-4ec7-8383-72e4559fe07b None admin] RBAC: Adding query filter params (name=member) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:07:01.942281 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dd54ea-ab0b-4ec7-8383-72e4559fe07b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:01.944469 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dd54ea-ab0b-4ec7-8383-72e4559fe07b None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:01.958249 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 126/247] 10.222.0.70 () {56 vars in 1101 bytes} [Tue May 10 19:07:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:07:01.964012 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dd54ea-ab0b-4ec7-8383-72e4559fe07b None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:02.010137 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df5b3b5-055d-444f-87ea-8d3e857adb79 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:02.011598 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df5b3b5-055d-444f-87ea-8d3e857adb79 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:02.077754 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dd54ea-ab0b-4ec7-8383-72e4559fe07b None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:02.118440 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c12015-4e3a-4cac-8b59-23ee45d9260b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:02.119424 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c12015-4e3a-4cac-8b59-23ee45d9260b None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:02.119774 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c12015-4e3a-4cac-8b59-23ee45d9260b None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:02.120213 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c12015-4e3a-4cac-8b59-23ee45d9260b None admin] PATH_INFO: `/v3/users/f364656bffa6413f9434e7cbc0df6fb5` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:02.121434 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c12015-4e3a-4cac-8b59-23ee45d9260b None admin] RBAC: Authorizing `identity:get_user(user_id=f364656bffa6413f9434e7cbc0df6fb5)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:02.122878 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c12015-4e3a-4cac-8b59-23ee45d9260b None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:02.128565 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 127/248] 10.222.0.70 () {56 vars in 1177 bytes} [Tue May 10 19:07:01 2022] GET /identity/v3/users/f364656bffa6413f9434e7cbc0df6fb5 => generated 297 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:07:02.130669 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf3c91b-4f61-41a6-87e9-c872b390275f None None] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:02.131522 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 122/249] 10.222.0.70 () {58 vars in 1282 bytes} [Tue May 10 19:07:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 10 19:07:02.131966 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf3c91b-4f61-41a6-87e9-c872b390275f None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:02.132493 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf3c91b-4f61-41a6-87e9-c872b390275f None None] PATH_INFO: `/` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:02.134239 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 128/250] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:07:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:07:02.138618 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df5b3b5-055d-444f-87ea-8d3e857adb79 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:02.141362 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8579c0d6-f8a3-49ee-98cc-79af9f14e7b0 None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:02.141362 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8579c0d6-f8a3-49ee-98cc-79af9f14e7b0 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:02.141362 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8579c0d6-f8a3-49ee-98cc-79af9f14e7b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:02.158580 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-8579c0d6-f8a3-49ee-98cc-79af9f14e7b0 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:07:02.160099 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-8579c0d6-f8a3-49ee-98cc-79af9f14e7b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:07:02.249226 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 129/251] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:07:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 19:07:02.250083 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8579c0d6-f8a3-49ee-98cc-79af9f14e7b0 None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:02.262202 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df5b3b5-055d-444f-87ea-8d3e857adb79 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:02.306587 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7703810-14d0-46e3-b12e-421411f90e4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:02.308235 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7703810-14d0-46e3-b12e-421411f90e4b None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:02.308723 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7703810-14d0-46e3-b12e-421411f90e4b None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:02.309466 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7703810-14d0-46e3-b12e-421411f90e4b None admin] PATH_INFO: `/v3/projects/e0df39feccc3439b965b22d514a229be` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:02.311036 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7703810-14d0-46e3-b12e-421411f90e4b None admin] RBAC: Authorizing `identity:get_project(project_id=e0df39feccc3439b965b22d514a229be)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:02.313433 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7703810-14d0-46e3-b12e-421411f90e4b None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:02.316585 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 123/252] 10.222.0.70 () {56 vars in 1186 bytes} [Tue May 10 19:07:02 2022] GET /identity/v3/projects/e0df39feccc3439b965b22d514a229be => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:07:02.318274 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7703810-14d0-46e3-b12e-421411f90e4b None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:02.358913 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8579c0d6-f8a3-49ee-98cc-79af9f14e7b0 None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:02.397096 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de44405-91fd-4fa0-9d2e-47e41baf290a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:02.397397 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de44405-91fd-4fa0-9d2e-47e41baf290a None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:02.397843 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de44405-91fd-4fa0-9d2e-47e41baf290a None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:02.398191 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de44405-91fd-4fa0-9d2e-47e41baf290a None admin] PATH_INFO: `/v3/projects/e0df39feccc3439b965b22d514a229be` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:02.399461 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de44405-91fd-4fa0-9d2e-47e41baf290a None admin] RBAC: Authorizing `identity:get_project(project_id=e0df39feccc3439b965b22d514a229be)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:02.401034 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de44405-91fd-4fa0-9d2e-47e41baf290a None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:02.407487 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 130/253] 10.222.0.70 () {56 vars in 1186 bytes} [Tue May 10 19:07:02 2022] GET /identity/v3/projects/e0df39feccc3439b965b22d514a229be => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:07:02.407487 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de44405-91fd-4fa0-9d2e-47e41baf290a None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:02.449754 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7703810-14d0-46e3-b12e-421411f90e4b None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:02.514636 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15a943a-f2b6-43ba-8179-42eeff5cb2a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:02.515449 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15a943a-f2b6-43ba-8179-42eeff5cb2a0 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:02.515731 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15a943a-f2b6-43ba-8179-42eeff5cb2a0 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:02.516005 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15a943a-f2b6-43ba-8179-42eeff5cb2a0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:02.535488 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15a943a-f2b6-43ba-8179-42eeff5cb2a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:07:02.543269 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-e15a943a-f2b6-43ba-8179-42eeff5cb2a0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 19:07:02.543269 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:07:02.543269 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:07:02.543269 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:07:02.543269 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:07:02.543269 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:07:02.543269 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:07:02.543269 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:07:02.543269 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:07:02.543269 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:07:02.543269 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:07:02.543269 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:07:02.543269 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:07:02.543269 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:07:02.543269 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:07:02.543269 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:07:02.544157 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:07:02.544157 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:07:02.544157 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:07:02.544157 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:07:02.544157 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:07:02.544157 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:07:02.544157 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:07:02.544157 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:07:02.544157 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:07:02.544157 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:07:02.544157 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:07:02.544157 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( May 10 19:07:02.544157 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:07:02.544157 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() May 10 19:07:02.544157 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:07:02.544157 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:07:02.544996 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:07:02.544996 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() May 10 19:07:02.544996 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:07:02.544996 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( May 10 19:07:02.544996 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:07:02.544996 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:07:02.544996 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:07:02.544996 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:07:02.544996 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:07:02.544996 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:07:02.544996 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 19:07:02.544996 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:07:02.546285 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 124/254] 10.222.0.70 () {56 vars in 1096 bytes} [Tue May 10 19:07:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:07:02.546465 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15a943a-f2b6-43ba-8179-42eeff5cb2a0 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:02.554351 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de44405-91fd-4fa0-9d2e-47e41baf290a None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:02.608468 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1d30fa-90a0-4a49-9926-976bc23ba46d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:02.609763 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1d30fa-90a0-4a49-9926-976bc23ba46d None admin] REQUEST_METHOD: `PUT` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:02.610242 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1d30fa-90a0-4a49-9926-976bc23ba46d None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:02.610708 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1d30fa-90a0-4a49-9926-976bc23ba46d None admin] PATH_INFO: `/v3/projects/e0df39feccc3439b965b22d514a229be/users/f364656bffa6413f9434e7cbc0df6fb5/roles/5c07cf5bfbd3427db18428aa50420962` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:02.612915 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1d30fa-90a0-4a49-9926-976bc23ba46d None admin] RBAC: Authorizing `identity:create_grant(project_id=e0df39feccc3439b965b22d514a229be, user_id=f364656bffa6413f9434e7cbc0df6fb5, role_id=5c07cf5bfbd3427db18428aa50420962)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:02.614674 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1d30fa-90a0-4a49-9926-976bc23ba46d None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:02.635580 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 131/255] 10.222.0.70 () {58 vars in 1439 bytes} [Tue May 10 19:07:02 2022] PUT /identity/v3/projects/e0df39feccc3439b965b22d514a229be/users/f364656bffa6413f9434e7cbc0df6fb5/roles/5c07cf5bfbd3427db18428aa50420962 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:07:02.638129 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1d30fa-90a0-4a49-9926-976bc23ba46d None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:02.769793 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15a943a-f2b6-43ba-8179-42eeff5cb2a0 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:02.830746 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e585bf-95aa-4bc9-9cf9-860772f0e094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:02.831428 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e585bf-95aa-4bc9-9cf9-860772f0e094 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:02.831712 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e585bf-95aa-4bc9-9cf9-860772f0e094 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:02.831987 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e585bf-95aa-4bc9-9cf9-860772f0e094 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:02.833222 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e585bf-95aa-4bc9-9cf9-860772f0e094 None admin] RBAC: Adding query filter params (role.id=93fda71e71a04ccb862ff5177646d5b5, scope.project.id=e0df39feccc3439b965b22d514a229be, user.id=187e812c10ea4f99990d929f031ecbe6) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:07:02.833535 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e585bf-95aa-4bc9-9cf9-860772f0e094 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:02.835030 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e585bf-95aa-4bc9-9cf9-860772f0e094 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:02.848072 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 125/256] 10.222.0.70 () {56 vars in 1374 bytes} [Tue May 10 19:07:02 2022] GET /identity/v3/role_assignments?user.id=187e812c10ea4f99990d929f031ecbe6&scope.project.id=e0df39feccc3439b965b22d514a229be&role.id=93fda71e71a04ccb862ff5177646d5b5 => generated 259 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:07:02.850075 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2010114-cc07-400f-9920-d389d5a51437 None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:02.850365 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2010114-cc07-400f-9920-d389d5a51437 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:02.850641 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2010114-cc07-400f-9920-d389d5a51437 None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:02.852029 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 126/257] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:07:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:07:02.858390 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e4d864-0d5a-44b3-9cb1-8ea3c9d38fab None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:02.859008 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e4d864-0d5a-44b3-9cb1-8ea3c9d38fab None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:02.859008 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e4d864-0d5a-44b3-9cb1-8ea3c9d38fab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:02.872172 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1d30fa-90a0-4a49-9926-976bc23ba46d None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:02.876451 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-c3e4d864-0d5a-44b3-9cb1-8ea3c9d38fab None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:07:02.878789 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-c3e4d864-0d5a-44b3-9cb1-8ea3c9d38fab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:07:02.913378 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9b9d4c-6cf9-407c-9e22-1975d7059528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:02.914746 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9b9d4c-6cf9-407c-9e22-1975d7059528 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:02.915179 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9b9d4c-6cf9-407c-9e22-1975d7059528 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:02.915621 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9b9d4c-6cf9-407c-9e22-1975d7059528 None admin] PATH_INFO: `/v3/roles` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:02.916555 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9b9d4c-6cf9-407c-9e22-1975d7059528 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:07:02.917005 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9b9d4c-6cf9-407c-9e22-1975d7059528 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:02.918551 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9b9d4c-6cf9-407c-9e22-1975d7059528 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:02.928620 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 132/258] 10.222.0.70 () {56 vars in 1099 bytes} [Tue May 10 19:07:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:07:02.937453 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9b9d4c-6cf9-407c-9e22-1975d7059528 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:02.952682 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 127/259] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:07:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 19:07:02.991533 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e4d864-0d5a-44b3-9cb1-8ea3c9d38fab None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:03.058217 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9b9d4c-6cf9-407c-9e22-1975d7059528 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:03.093810 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a34d77-aa70-4a2c-966c-4259bd58c827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:03.100451 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a34d77-aa70-4a2c-966c-4259bd58c827 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:03.100451 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a34d77-aa70-4a2c-966c-4259bd58c827 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:03.100451 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a34d77-aa70-4a2c-966c-4259bd58c827 None admin] PATH_INFO: `/v3/users/8dab2b5634fd49a4aa4558661b5af9b0` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:03.100451 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a34d77-aa70-4a2c-966c-4259bd58c827 None admin] RBAC: Authorizing `identity:get_user(user_id=8dab2b5634fd49a4aa4558661b5af9b0)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:03.100451 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a34d77-aa70-4a2c-966c-4259bd58c827 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:03.100451 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 133/260] 10.222.0.70 () {56 vars in 1177 bytes} [Tue May 10 19:07:02 2022] GET /identity/v3/users/8dab2b5634fd49a4aa4558661b5af9b0 => generated 283 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:07:03.105638 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a34d77-aa70-4a2c-966c-4259bd58c827 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:03.144553 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e4d864-0d5a-44b3-9cb1-8ea3c9d38fab None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:03.205230 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf223036-f60f-4c15-9051-826d05557c1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:03.206419 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf223036-f60f-4c15-9051-826d05557c1d None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:03.206923 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf223036-f60f-4c15-9051-826d05557c1d None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:03.207391 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf223036-f60f-4c15-9051-826d05557c1d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:03.207957 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a34d77-aa70-4a2c-966c-4259bd58c827 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:03.225618 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf223036-f60f-4c15-9051-826d05557c1d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:07:03.238828 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-bf223036-f60f-4c15-9051-826d05557c1d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 19:07:03.238828 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:07:03.238828 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:07:03.238828 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:07:03.238828 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:07:03.238828 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:07:03.238828 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:07:03.238828 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:07:03.238828 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:07:03.238828 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:07:03.238828 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:07:03.238828 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:07:03.238828 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:07:03.238828 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:07:03.238828 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:07:03.238828 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:07:03.240335 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:07:03.240335 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:07:03.240335 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:07:03.240335 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:07:03.240335 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:07:03.240335 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:07:03.240335 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:07:03.240335 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:07:03.240335 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:07:03.240335 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:07:03.240335 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:07:03.240335 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( May 10 19:07:03.240335 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:07:03.240335 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() May 10 19:07:03.240335 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:07:03.240335 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:07:03.241178 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:07:03.241178 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() May 10 19:07:03.241178 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:07:03.241178 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( May 10 19:07:03.241178 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:07:03.241178 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:07:03.241178 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:07:03.241178 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:07:03.241178 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:07:03.241178 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:07:03.241178 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 19:07:03.241178 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:07:03.242907 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da05ab2-6e53-4b6b-9e09-3973a2522554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:03.243566 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da05ab2-6e53-4b6b-9e09-3973a2522554 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:03.243854 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da05ab2-6e53-4b6b-9e09-3973a2522554 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:03.244141 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da05ab2-6e53-4b6b-9e09-3973a2522554 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:03.244714 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 128/261] 10.222.0.70 () {56 vars in 1114 bytes} [Tue May 10 19:07:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 19:07:03.249887 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf223036-f60f-4c15-9051-826d05557c1d None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:03.316843 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da05ab2-6e53-4b6b-9e09-3973a2522554 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:03.316843 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da05ab2-6e53-4b6b-9e09-3973a2522554 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:03.370732 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf223036-f60f-4c15-9051-826d05557c1d None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:03.413822 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 134/262] 10.222.0.70 () {58 vars in 1282 bytes} [Tue May 10 19:07:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 10 19:07:03.414786 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757f8b4c-cc5e-4f70-993c-909005ae909a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:03.415694 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757f8b4c-cc5e-4f70-993c-909005ae909a None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:03.416175 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757f8b4c-cc5e-4f70-993c-909005ae909a None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:03.416693 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757f8b4c-cc5e-4f70-993c-909005ae909a None admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:03.417639 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757f8b4c-cc5e-4f70-993c-909005ae909a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:07:03.418139 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757f8b4c-cc5e-4f70-993c-909005ae909a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:03.419219 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da05ab2-6e53-4b6b-9e09-3973a2522554 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:03.419962 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757f8b4c-cc5e-4f70-993c-909005ae909a None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:03.436604 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 129/263] 10.222.0.70 () {56 vars in 1111 bytes} [Tue May 10 19:07:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:07:03.442060 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757f8b4c-cc5e-4f70-993c-909005ae909a None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:03.517456 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da05ab2-6e53-4b6b-9e09-3973a2522554 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:03.553319 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd25bd87-e5a7-4101-acac-a7b3d70c6881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:03.554191 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd25bd87-e5a7-4101-acac-a7b3d70c6881 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:03.554473 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd25bd87-e5a7-4101-acac-a7b3d70c6881 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:03.554750 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd25bd87-e5a7-4101-acac-a7b3d70c6881 None admin] PATH_INFO: `/v3/projects/e0df39feccc3439b965b22d514a229be` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:03.555950 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd25bd87-e5a7-4101-acac-a7b3d70c6881 None admin] RBAC: Authorizing `identity:get_project(project_id=e0df39feccc3439b965b22d514a229be)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:03.557438 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd25bd87-e5a7-4101-acac-a7b3d70c6881 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:03.559465 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 135/264] 10.222.0.70 () {56 vars in 1186 bytes} [Tue May 10 19:07:03 2022] GET /identity/v3/projects/e0df39feccc3439b965b22d514a229be => generated 302 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:07:03.565319 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd25bd87-e5a7-4101-acac-a7b3d70c6881 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:03.598006 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757f8b4c-cc5e-4f70-993c-909005ae909a None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:03.650544 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12136456-4f23-45e4-8493-db5fcf4d885e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:03.651798 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12136456-4f23-45e4-8493-db5fcf4d885e None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:03.652282 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12136456-4f23-45e4-8493-db5fcf4d885e None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:03.652814 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12136456-4f23-45e4-8493-db5fcf4d885e None admin] PATH_INFO: `/v3/users/8dab2b5634fd49a4aa4558661b5af9b0` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:03.657142 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12136456-4f23-45e4-8493-db5fcf4d885e None admin] RBAC: Authorizing `identity:get_user(user_id=8dab2b5634fd49a4aa4558661b5af9b0)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:03.658828 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12136456-4f23-45e4-8493-db5fcf4d885e None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:03.661708 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 130/265] 10.222.0.70 () {56 vars in 1177 bytes} [Tue May 10 19:07:03 2022] GET /identity/v3/users/8dab2b5634fd49a4aa4558661b5af9b0 => generated 283 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:07:03.666655 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12136456-4f23-45e4-8493-db5fcf4d885e None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:03.668271 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd25bd87-e5a7-4101-acac-a7b3d70c6881 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:03.704470 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dd25b0-3eda-4769-9b3e-ec8dc264e301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:03.704988 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dd25b0-3eda-4769-9b3e-ec8dc264e301 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:03.705277 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dd25b0-3eda-4769-9b3e-ec8dc264e301 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:03.705552 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dd25b0-3eda-4769-9b3e-ec8dc264e301 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:03.706383 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dd25b0-3eda-4769-9b3e-ec8dc264e301 None admin] RBAC: Adding query filter params (role.id=634ba284303b4626b5a0402772c68f5c, scope.project.id=e0df39feccc3439b965b22d514a229be, user.id=8dab2b5634fd49a4aa4558661b5af9b0) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:07:03.706691 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dd25b0-3eda-4769-9b3e-ec8dc264e301 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:03.708502 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dd25b0-3eda-4769-9b3e-ec8dc264e301 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:03.714617 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 136/266] 10.222.0.70 () {56 vars in 1374 bytes} [Tue May 10 19:07:03 2022] GET /identity/v3/role_assignments?user.id=8dab2b5634fd49a4aa4558661b5af9b0&scope.project.id=e0df39feccc3439b965b22d514a229be&role.id=634ba284303b4626b5a0402772c68f5c => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:07:03.819921 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12136456-4f23-45e4-8493-db5fcf4d885e None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:03.865679 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b0568b-6f07-4e90-a046-3cb760ff44f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:03.866299 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b0568b-6f07-4e90-a046-3cb760ff44f7 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:03.866512 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b0568b-6f07-4e90-a046-3cb760ff44f7 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:03.866783 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b0568b-6f07-4e90-a046-3cb760ff44f7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:03.981662 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b0568b-6f07-4e90-a046-3cb760ff44f7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:03.983190 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b0568b-6f07-4e90-a046-3cb760ff44f7 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:04.110741 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 131/267] 10.222.0.70 () {58 vars in 1282 bytes} [Tue May 10 19:07:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 10 19:07:04.116639 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dd25b0-3eda-4769-9b3e-ec8dc264e301 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:04.254597 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dd25b0-3eda-4769-9b3e-ec8dc264e301 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:04.292290 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4726e061-7e64-40c3-a7af-866227889d70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:04.293203 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4726e061-7e64-40c3-a7af-866227889d70 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:04.293485 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4726e061-7e64-40c3-a7af-866227889d70 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:04.293760 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4726e061-7e64-40c3-a7af-866227889d70 None admin] PATH_INFO: `/v3/projects/e0df39feccc3439b965b22d514a229be` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:04.294957 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4726e061-7e64-40c3-a7af-866227889d70 None admin] RBAC: Authorizing `identity:get_project(project_id=e0df39feccc3439b965b22d514a229be)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:04.296453 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4726e061-7e64-40c3-a7af-866227889d70 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:04.298437 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 137/268] 10.222.0.70 () {56 vars in 1186 bytes} [Tue May 10 19:07:04 2022] GET /identity/v3/projects/e0df39feccc3439b965b22d514a229be => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:07:04.304002 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b0568b-6f07-4e90-a046-3cb760ff44f7 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:04.441276 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b0568b-6f07-4e90-a046-3cb760ff44f7 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:04.481815 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb981060-776d-48f1-9262-4368b5a48ca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:04.482473 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb981060-776d-48f1-9262-4368b5a48ca5 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:04.482759 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb981060-776d-48f1-9262-4368b5a48ca5 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:04.483031 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb981060-776d-48f1-9262-4368b5a48ca5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:04.483862 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb981060-776d-48f1-9262-4368b5a48ca5 None admin] RBAC: Adding query filter params (role.id=49187695e1bf4c15980bb68c83ca61de, scope.project.id=e0df39feccc3439b965b22d514a229be, user.id=8dab2b5634fd49a4aa4558661b5af9b0) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:07:04.484170 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb981060-776d-48f1-9262-4368b5a48ca5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:04.485631 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb981060-776d-48f1-9262-4368b5a48ca5 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:04.491971 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 132/269] 10.222.0.70 () {56 vars in 1374 bytes} [Tue May 10 19:07:04 2022] GET /identity/v3/role_assignments?user.id=8dab2b5634fd49a4aa4558661b5af9b0&scope.project.id=e0df39feccc3439b965b22d514a229be&role.id=49187695e1bf4c15980bb68c83ca61de => generated 608 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:07:05.110019 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37a5433-520a-459d-ad77-2d6658383f3b None None] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:05.110310 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37a5433-520a-459d-ad77-2d6658383f3b None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:05.110587 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37a5433-520a-459d-ad77-2d6658383f3b None None] PATH_INFO: `/` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:05.112185 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 138/270] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:07:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:07:05.121074 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50d3228-9942-4e6e-b1ed-344ba0324588 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:05.121531 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50d3228-9942-4e6e-b1ed-344ba0324588 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:05.121608 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50d3228-9942-4e6e-b1ed-344ba0324588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:05.139559 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-e50d3228-9942-4e6e-b1ed-344ba0324588 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:07:05.140795 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-e50d3228-9942-4e6e-b1ed-344ba0324588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:07:05.218347 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 133/271] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:07:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 19:07:05.231507 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ac200a-b1ab-4408-b09b-f53ed87ed243 None None] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:05.231969 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ac200a-b1ab-4408-b09b-f53ed87ed243 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:05.232070 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ac200a-b1ab-4408-b09b-f53ed87ed243 None None] PATH_INFO: `/` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:05.233467 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 139/272] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:07:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:07:05.239345 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c689599a-d1a7-42fb-a382-473a6e24406d None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:05.239639 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c689599a-d1a7-42fb-a382-473a6e24406d None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:05.239918 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c689599a-d1a7-42fb-a382-473a6e24406d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:05.247139 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ac200a-b1ab-4408-b09b-f53ed87ed243 None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:05.259084 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-c689599a-d1a7-42fb-a382-473a6e24406d None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:07:05.260277 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-c689599a-d1a7-42fb-a382-473a6e24406d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:07:05.338884 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 134/273] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:07:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 19:07:05.356602 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c689599a-d1a7-42fb-a382-473a6e24406d None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:05.357038 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ac200a-b1ab-4408-b09b-f53ed87ed243 None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:05.391611 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd26cf4-593c-44ac-9101-ae5854c1ff67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:05.392785 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd26cf4-593c-44ac-9101-ae5854c1ff67 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:05.393276 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd26cf4-593c-44ac-9101-ae5854c1ff67 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:05.393752 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd26cf4-593c-44ac-9101-ae5854c1ff67 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:05.395146 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd26cf4-593c-44ac-9101-ae5854c1ff67 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:05.397377 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd26cf4-593c-44ac-9101-ae5854c1ff67 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:05.399494 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 140/274] 10.222.0.70 () {56 vars in 1108 bytes} [Tue May 10 19:07:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:07:05.404875 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd26cf4-593c-44ac-9101-ae5854c1ff67 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:05.461151 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c689599a-d1a7-42fb-a382-473a6e24406d None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:05.497616 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69d6187-6065-4643-a2a7-4eed1876c046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:05.498364 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69d6187-6065-4643-a2a7-4eed1876c046 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:05.498646 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69d6187-6065-4643-a2a7-4eed1876c046 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:05.498918 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69d6187-6065-4643-a2a7-4eed1876c046 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:05.509709 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd26cf4-593c-44ac-9101-ae5854c1ff67 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:05.510428 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69d6187-6065-4643-a2a7-4eed1876c046 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:07:05.518246 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-b69d6187-6065-4643-a2a7-4eed1876c046 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 19:07:05.518246 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:07:05.518246 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:07:05.518246 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:07:05.518246 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:07:05.518246 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:07:05.518246 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:07:05.518246 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:07:05.518246 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:07:05.518246 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:07:05.518246 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:07:05.518246 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:07:05.518246 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:07:05.518246 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:07:05.518246 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:07:05.518246 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:07:05.519170 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:07:05.519170 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:07:05.519170 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:07:05.519170 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:07:05.519170 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:07:05.519170 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:07:05.519170 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:07:05.519170 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:07:05.519170 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:07:05.519170 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:07:05.519170 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:07:05.519170 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( May 10 19:07:05.519170 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:07:05.519170 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() May 10 19:07:05.519170 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:07:05.519170 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:07:05.519994 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:07:05.519994 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() May 10 19:07:05.519994 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:07:05.519994 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( May 10 19:07:05.519994 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:07:05.519994 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:07:05.519994 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:07:05.519994 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:07:05.519994 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:07:05.519994 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:07:05.519994 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 19:07:05.519994 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:07:05.524862 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 135/275] 10.222.0.70 () {56 vars in 1099 bytes} [Tue May 10 19:07:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:07:05.525650 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69d6187-6065-4643-a2a7-4eed1876c046 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:05.548468 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518292df-0137-466b-bec4-617eeb661f25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:05.549486 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518292df-0137-466b-bec4-617eeb661f25 None admin] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:05.549975 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518292df-0137-466b-bec4-617eeb661f25 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:05.550453 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518292df-0137-466b-bec4-617eeb661f25 None admin] PATH_INFO: `/v3/users` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:05.551355 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518292df-0137-466b-bec4-617eeb661f25 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:05.553620 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518292df-0137-466b-bec4-617eeb661f25 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:05.581446 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 141/276] 10.222.0.70 () {60 vars in 1132 bytes} [Tue May 10 19:07:05 2022] POST /identity/v3/users => generated 293 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 19:07:05.646718 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69d6187-6065-4643-a2a7-4eed1876c046 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:05.676662 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692c1d59-3a8f-4950-aa37-3ef280643b01 None None] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:05.677016 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692c1d59-3a8f-4950-aa37-3ef280643b01 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:05.677254 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692c1d59-3a8f-4950-aa37-3ef280643b01 None None] PATH_INFO: `/` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:05.682528 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 142/277] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:07:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 19:07:05.684711 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5cfa4a-6ee2-4205-9c7e-0f55e80ef955 None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:05.685351 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5cfa4a-6ee2-4205-9c7e-0f55e80ef955 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:05.685925 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5cfa4a-6ee2-4205-9c7e-0f55e80ef955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:05.687614 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a555fc-823c-4d26-8df7-6c8e27b04fb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:05.688370 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a555fc-823c-4d26-8df7-6c8e27b04fb9 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:05.688757 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a555fc-823c-4d26-8df7-6c8e27b04fb9 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:05.689033 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a555fc-823c-4d26-8df7-6c8e27b04fb9 None admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:05.690001 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a555fc-823c-4d26-8df7-6c8e27b04fb9 None admin] RBAC: Adding query filter params (name=member) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:07:05.690315 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a555fc-823c-4d26-8df7-6c8e27b04fb9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:05.691823 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a555fc-823c-4d26-8df7-6c8e27b04fb9 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:05.702369 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 136/278] 10.222.0.70 () {56 vars in 1101 bytes} [Tue May 10 19:07:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:07:05.707830 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a555fc-823c-4d26-8df7-6c8e27b04fb9 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:05.708346 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-6f5cfa4a-6ee2-4205-9c7e-0f55e80ef955 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:07:05.709963 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-6f5cfa4a-6ee2-4205-9c7e-0f55e80ef955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:07:05.802534 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 143/279] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:07:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 19:07:05.826036 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5cfa4a-6ee2-4205-9c7e-0f55e80ef955 None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:05.837899 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a555fc-823c-4d26-8df7-6c8e27b04fb9 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:05.875541 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8118ce-e073-4f0b-adaf-88175a0dea9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:05.876453 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8118ce-e073-4f0b-adaf-88175a0dea9d None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:05.876738 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8118ce-e073-4f0b-adaf-88175a0dea9d None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:05.877015 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8118ce-e073-4f0b-adaf-88175a0dea9d None admin] PATH_INFO: `/v3/users/1fb9355fddc64fe5926001180f7bfbc0` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:05.892352 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8118ce-e073-4f0b-adaf-88175a0dea9d None admin] RBAC: Authorizing `identity:get_user(user_id=1fb9355fddc64fe5926001180f7bfbc0)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:05.893855 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8118ce-e073-4f0b-adaf-88175a0dea9d None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:05.895980 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 137/280] 10.222.0.70 () {56 vars in 1177 bytes} [Tue May 10 19:07:05 2022] GET /identity/v3/users/1fb9355fddc64fe5926001180f7bfbc0 => generated 293 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:07:05.902652 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8118ce-e073-4f0b-adaf-88175a0dea9d None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:05.950711 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5cfa4a-6ee2-4205-9c7e-0f55e80ef955 None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:05.995909 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6935f1-ed2e-472a-9895-7eb2d514c850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:05.996805 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6935f1-ed2e-472a-9895-7eb2d514c850 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:05.997025 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6935f1-ed2e-472a-9895-7eb2d514c850 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:05.997350 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6935f1-ed2e-472a-9895-7eb2d514c850 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:06.007976 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6935f1-ed2e-472a-9895-7eb2d514c850 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:07:06.015851 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application [None req-2b6935f1-ed2e-472a-9895-7eb2d514c850 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 19:07:06.015851 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:07:06.015851 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:07:06.015851 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:07:06.015851 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:07:06.015851 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:07:06.015851 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:07:06.015851 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:07:06.015851 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:07:06.015851 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:07:06.015851 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:07:06.015851 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:07:06.015851 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:07:06.015851 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:07:06.015851 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:07:06.015851 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:07:06.016784 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:07:06.016784 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:07:06.016784 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:07:06.016784 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:07:06.016784 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:07:06.016784 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:07:06.016784 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:07:06.016784 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:07:06.016784 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:07:06.016784 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:07:06.016784 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:07:06.016784 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application with Lock( May 10 19:07:06.016784 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:07:06.016784 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._enter() May 10 19:07:06.016784 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:07:06.016784 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:07:06.017573 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:07:06.017573 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.creator() May 10 19:07:06.017573 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:07:06.017573 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application created_value = creator( May 10 19:07:06.017573 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:07:06.017573 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:07:06.017573 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:07:06.017573 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:07:06.017573 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:07:06.017573 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:07:06.017573 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 19:07:06.017573 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application May 10 19:07:06.020610 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 144/281] 10.222.0.70 () {56 vars in 1099 bytes} [Tue May 10 19:07:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 19:07:06.021939 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954ca254-b0a7-4302-b640-c0e5466122bf None None] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:06.022221 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954ca254-b0a7-4302-b640-c0e5466122bf None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:06.022495 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954ca254-b0a7-4302-b640-c0e5466122bf None None] PATH_INFO: `/` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:06.023788 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 145/282] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:07:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:07:06.025829 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8118ce-e073-4f0b-adaf-88175a0dea9d None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:06.026457 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954ca254-b0a7-4302-b640-c0e5466122bf None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:06.069161 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64c76f8-23d0-47fe-ad76-52f0de04fbe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:06.070057 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64c76f8-23d0-47fe-ad76-52f0de04fbe7 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:06.070346 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64c76f8-23d0-47fe-ad76-52f0de04fbe7 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:06.070923 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64c76f8-23d0-47fe-ad76-52f0de04fbe7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:06.071769 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64c76f8-23d0-47fe-ad76-52f0de04fbe7 None admin] RBAC: Adding query filter params (role.id=5c07cf5bfbd3427db18428aa50420962, user.id=1fb9355fddc64fe5926001180f7bfbc0, scope.system=all) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:07:06.072248 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64c76f8-23d0-47fe-ad76-52f0de04fbe7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:06.074363 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64c76f8-23d0-47fe-ad76-52f0de04fbe7 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:06.080815 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 138/283] 10.222.0.70 () {56 vars in 1308 bytes} [Tue May 10 19:07:05 2022] GET /identity/v3/role_assignments?user.id=1fb9355fddc64fe5926001180f7bfbc0&scope.system=all&role.id=5c07cf5bfbd3427db18428aa50420962 => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:07:06.084568 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c296292a-ce9c-49e2-a284-ddabe2b6dfb6 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:06.084892 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c296292a-ce9c-49e2-a284-ddabe2b6dfb6 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:06.085172 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c296292a-ce9c-49e2-a284-ddabe2b6dfb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:06.116008 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-c296292a-ce9c-49e2-a284-ddabe2b6dfb6 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:07:06.122385 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-c296292a-ce9c-49e2-a284-ddabe2b6dfb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:07:06.173043 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954ca254-b0a7-4302-b640-c0e5466122bf None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:06.237473 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fed2d6f-913d-4a24-b905-d8e6a99ab40b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:06.238239 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fed2d6f-913d-4a24-b905-d8e6a99ab40b None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:06.238422 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fed2d6f-913d-4a24-b905-d8e6a99ab40b None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:06.238696 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fed2d6f-913d-4a24-b905-d8e6a99ab40b None admin] PATH_INFO: `/v3/roles` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:06.239996 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fed2d6f-913d-4a24-b905-d8e6a99ab40b None admin] RBAC: Adding query filter params (name=member) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:07:06.240301 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fed2d6f-913d-4a24-b905-d8e6a99ab40b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:06.241754 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fed2d6f-913d-4a24-b905-d8e6a99ab40b None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:06.254344 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 139/284] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:07:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 19:07:06.258621 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 146/285] 10.222.0.70 () {56 vars in 1101 bytes} [Tue May 10 19:07:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:07:06.264780 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c296292a-ce9c-49e2-a284-ddabe2b6dfb6 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:06.310258 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fed2d6f-913d-4a24-b905-d8e6a99ab40b None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:06.390978 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c296292a-ce9c-49e2-a284-ddabe2b6dfb6 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:06.433919 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dbca6d-0aa3-4c61-9442-e65b847fb57f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:06.435801 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dbca6d-0aa3-4c61-9442-e65b847fb57f None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:06.440198 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dbca6d-0aa3-4c61-9442-e65b847fb57f None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:06.440673 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dbca6d-0aa3-4c61-9442-e65b847fb57f None admin] PATH_INFO: `/v3/users/f364656bffa6413f9434e7cbc0df6fb5` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:06.444127 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dbca6d-0aa3-4c61-9442-e65b847fb57f None admin] RBAC: Authorizing `identity:get_user(user_id=f364656bffa6413f9434e7cbc0df6fb5)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:06.445751 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dbca6d-0aa3-4c61-9442-e65b847fb57f None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:06.447852 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 140/286] 10.222.0.70 () {56 vars in 1177 bytes} [Tue May 10 19:07:06 2022] GET /identity/v3/users/f364656bffa6413f9434e7cbc0df6fb5 => generated 297 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:07:06.452889 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dbca6d-0aa3-4c61-9442-e65b847fb57f None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:06.490233 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fed2d6f-913d-4a24-b905-d8e6a99ab40b None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:06.552476 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c326c1b-bcc8-411d-a0fe-4401bc0b85a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:06.553563 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c326c1b-bcc8-411d-a0fe-4401bc0b85a1 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:06.554005 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c326c1b-bcc8-411d-a0fe-4401bc0b85a1 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:06.554415 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c326c1b-bcc8-411d-a0fe-4401bc0b85a1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:06.576568 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c326c1b-bcc8-411d-a0fe-4401bc0b85a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:07:06.584892 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application [None req-5c326c1b-bcc8-411d-a0fe-4401bc0b85a1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 10 19:07:06.584892 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:07:06.584892 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:07:06.584892 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:07:06.584892 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:07:06.584892 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:07:06.584892 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:07:06.584892 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:07:06.584892 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:07:06.584892 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:07:06.584892 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:07:06.584892 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:07:06.584892 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:07:06.584892 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:07:06.584892 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:07:06.584892 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:07:06.585977 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:07:06.585977 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:07:06.585977 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:07:06.585977 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:07:06.585977 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:07:06.585977 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:07:06.585977 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:07:06.585977 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:07:06.585977 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:07:06.585977 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:07:06.585977 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:07:06.585977 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application with Lock( May 10 19:07:06.585977 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:07:06.585977 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._enter() May 10 19:07:06.585977 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:07:06.585977 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:07:06.586967 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:07:06.586967 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.creator() May 10 19:07:06.586967 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:07:06.586967 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application created_value = creator( May 10 19:07:06.586967 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:07:06.586967 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:07:06.586967 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:07:06.586967 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:07:06.586967 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:07:06.586967 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:07:06.586967 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 10 19:07:06.586967 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application May 10 19:07:06.589360 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 147/287] 10.222.0.70 () {56 vars in 1099 bytes} [Tue May 10 19:07:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 19:07:06.595814 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c326c1b-bcc8-411d-a0fe-4401bc0b85a1 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:06.613524 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dbca6d-0aa3-4c61-9442-e65b847fb57f None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:06.684409 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f756b3-84f2-4d34-81d8-386fda747e5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:06.685415 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f756b3-84f2-4d34-81d8-386fda747e5b None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:06.686211 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f756b3-84f2-4d34-81d8-386fda747e5b None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:06.687541 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f756b3-84f2-4d34-81d8-386fda747e5b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:06.774549 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c326c1b-bcc8-411d-a0fe-4401bc0b85a1 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:06.810282 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899a7b1d-b67e-4ef7-9a23-ddb1c16bc132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:06.811124 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899a7b1d-b67e-4ef7-9a23-ddb1c16bc132 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:06.811412 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899a7b1d-b67e-4ef7-9a23-ddb1c16bc132 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:06.812198 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899a7b1d-b67e-4ef7-9a23-ddb1c16bc132 None admin] PATH_INFO: `/v3/roles` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:06.812982 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899a7b1d-b67e-4ef7-9a23-ddb1c16bc132 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:07:06.813447 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899a7b1d-b67e-4ef7-9a23-ddb1c16bc132 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:06.814835 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899a7b1d-b67e-4ef7-9a23-ddb1c16bc132 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:06.817031 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f756b3-84f2-4d34-81d8-386fda747e5b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:06.819078 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f756b3-84f2-4d34-81d8-386fda747e5b None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:06.824268 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 148/288] 10.222.0.70 () {56 vars in 1101 bytes} [Tue May 10 19:07:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:07:06.830862 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899a7b1d-b67e-4ef7-9a23-ddb1c16bc132 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:06.988298 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899a7b1d-b67e-4ef7-9a23-ddb1c16bc132 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:07.006813 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 141/289] 10.222.0.70 () {58 vars in 1282 bytes} [Tue May 10 19:07:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 554 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 10 19:07:07.017398 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f756b3-84f2-4d34-81d8-386fda747e5b None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:07.038693 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ba611b-e38c-43be-91bf-70fd0b3f2e4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:07.039571 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ba611b-e38c-43be-91bf-70fd0b3f2e4e None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:07.039855 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ba611b-e38c-43be-91bf-70fd0b3f2e4e None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:07.040127 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ba611b-e38c-43be-91bf-70fd0b3f2e4e None admin] PATH_INFO: `/v3/users/187e812c10ea4f99990d929f031ecbe6` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:07.042674 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ba611b-e38c-43be-91bf-70fd0b3f2e4e None admin] RBAC: Authorizing `identity:get_user(user_id=187e812c10ea4f99990d929f031ecbe6)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:07.044127 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ba611b-e38c-43be-91bf-70fd0b3f2e4e None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:07.047370 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 149/290] 10.222.0.70 () {56 vars in 1177 bytes} [Tue May 10 19:07:06 2022] GET /identity/v3/users/187e812c10ea4f99990d929f031ecbe6 => generated 297 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:07:07.053645 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ba611b-e38c-43be-91bf-70fd0b3f2e4e None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:07.182348 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f756b3-84f2-4d34-81d8-386fda747e5b None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:07.221340 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ba611b-e38c-43be-91bf-70fd0b3f2e4e None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:07.237591 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f87bae-4164-46e2-9c83-9e77c305be36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:07.238463 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f87bae-4164-46e2-9c83-9e77c305be36 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:07.238739 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f87bae-4164-46e2-9c83-9e77c305be36 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:07.239010 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f87bae-4164-46e2-9c83-9e77c305be36 None admin] PATH_INFO: `/v3/projects/e0df39feccc3439b965b22d514a229be` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:07.240690 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f87bae-4164-46e2-9c83-9e77c305be36 None admin] RBAC: Authorizing `identity:get_project(project_id=e0df39feccc3439b965b22d514a229be)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:07.242131 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f87bae-4164-46e2-9c83-9e77c305be36 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:07.243813 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 142/291] 10.222.0.70 () {56 vars in 1186 bytes} [Tue May 10 19:07:07 2022] GET /identity/v3/projects/e0df39feccc3439b965b22d514a229be => generated 302 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:07:07.251695 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f87bae-4164-46e2-9c83-9e77c305be36 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:07.287749 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df1436d-e3cf-4558-93c4-5f3c7a99ee92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:07.288657 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df1436d-e3cf-4558-93c4-5f3c7a99ee92 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:07.288942 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df1436d-e3cf-4558-93c4-5f3c7a99ee92 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:07.289218 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df1436d-e3cf-4558-93c4-5f3c7a99ee92 None admin] PATH_INFO: `/v3/projects/e0df39feccc3439b965b22d514a229be` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:07.291117 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df1436d-e3cf-4558-93c4-5f3c7a99ee92 None admin] RBAC: Authorizing `identity:get_project(project_id=e0df39feccc3439b965b22d514a229be)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:07.293712 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df1436d-e3cf-4558-93c4-5f3c7a99ee92 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:07.295875 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 150/292] 10.222.0.70 () {56 vars in 1186 bytes} [Tue May 10 19:07:07 2022] GET /identity/v3/projects/e0df39feccc3439b965b22d514a229be => generated 302 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:07:07.307503 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df1436d-e3cf-4558-93c4-5f3c7a99ee92 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:07.429648 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f87bae-4164-46e2-9c83-9e77c305be36 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:07.467436 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df1436d-e3cf-4558-93c4-5f3c7a99ee92 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:07.476857 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adb3782-2268-4978-94ef-7ef147d787b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:07.477449 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adb3782-2268-4978-94ef-7ef147d787b4 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:07.477724 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adb3782-2268-4978-94ef-7ef147d787b4 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:07.477993 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adb3782-2268-4978-94ef-7ef147d787b4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:07.479263 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adb3782-2268-4978-94ef-7ef147d787b4 None admin] RBAC: Adding query filter params (role.id=5c07cf5bfbd3427db18428aa50420962, scope.project.id=e0df39feccc3439b965b22d514a229be, user.id=f364656bffa6413f9434e7cbc0df6fb5) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:07:07.479574 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adb3782-2268-4978-94ef-7ef147d787b4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:07.481046 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adb3782-2268-4978-94ef-7ef147d787b4 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:07.487987 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 143/293] 10.222.0.70 () {56 vars in 1374 bytes} [Tue May 10 19:07:07 2022] GET /identity/v3/role_assignments?user.id=f364656bffa6413f9434e7cbc0df6fb5&scope.project.id=e0df39feccc3439b965b22d514a229be&role.id=5c07cf5bfbd3427db18428aa50420962 => generated 608 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:07:07.520149 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efa70d6-7670-47f8-af0f-688e5150a8cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:07.521185 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efa70d6-7670-47f8-af0f-688e5150a8cd None admin] REQUEST_METHOD: `PUT` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:07.521475 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efa70d6-7670-47f8-af0f-688e5150a8cd None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:07.521754 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efa70d6-7670-47f8-af0f-688e5150a8cd None admin] PATH_INFO: `/v3/projects/e0df39feccc3439b965b22d514a229be/users/187e812c10ea4f99990d929f031ecbe6/roles/93fda71e71a04ccb862ff5177646d5b5` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:07.530182 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efa70d6-7670-47f8-af0f-688e5150a8cd None admin] RBAC: Authorizing `identity:create_grant(project_id=e0df39feccc3439b965b22d514a229be, user_id=187e812c10ea4f99990d929f031ecbe6, role_id=93fda71e71a04ccb862ff5177646d5b5)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:07.531647 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efa70d6-7670-47f8-af0f-688e5150a8cd None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:07.551233 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 151/294] 10.222.0.70 () {58 vars in 1439 bytes} [Tue May 10 19:07:07 2022] PUT /identity/v3/projects/e0df39feccc3439b965b22d514a229be/users/187e812c10ea4f99990d929f031ecbe6/roles/93fda71e71a04ccb862ff5177646d5b5 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:07:08.240527 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213221a3-e161-4173-b2fc-aa0735960687 None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:08.241024 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213221a3-e161-4173-b2fc-aa0735960687 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:08.241024 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213221a3-e161-4173-b2fc-aa0735960687 None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:08.242684 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 144/295] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:07:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:07:08.248066 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9541ed11-9c44-4c86-b027-c7d1de539cc1 None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:08.248355 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9541ed11-9c44-4c86-b027-c7d1de539cc1 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:08.248662 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9541ed11-9c44-4c86-b027-c7d1de539cc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:08.265953 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-9541ed11-9c44-4c86-b027-c7d1de539cc1 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:07:08.267131 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-9541ed11-9c44-4c86-b027-c7d1de539cc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:07:08.286652 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a5fffc-eef8-4a95-b307-5634ae6f9782 None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:08.286946 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a5fffc-eef8-4a95-b307-5634ae6f9782 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:08.287188 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a5fffc-eef8-4a95-b307-5634ae6f9782 None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:08.288846 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 145/296] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:07:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 19:07:08.294346 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a144648d-85c0-42eb-b294-cb4af0f9e699 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:08.294627 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a144648d-85c0-42eb-b294-cb4af0f9e699 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:08.294901 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a144648d-85c0-42eb-b294-cb4af0f9e699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:08.313372 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-a144648d-85c0-42eb-b294-cb4af0f9e699 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:07:08.315112 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-a144648d-85c0-42eb-b294-cb4af0f9e699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:07:08.342688 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 152/297] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:07:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 19:07:08.365645 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9541ed11-9c44-4c86-b027-c7d1de539cc1 None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:08.394566 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 146/298] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:07:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 19:07:08.417649 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a144648d-85c0-42eb-b294-cb4af0f9e699 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:08.465578 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9541ed11-9c44-4c86-b027-c7d1de539cc1 None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:08.502831 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a89e2f-03fe-4962-a566-22f0bb28873b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:08.503996 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a89e2f-03fe-4962-a566-22f0bb28873b None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:08.504523 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a89e2f-03fe-4962-a566-22f0bb28873b None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:08.505065 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a89e2f-03fe-4962-a566-22f0bb28873b None admin] PATH_INFO: `/v3/domains/default` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:08.506658 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a89e2f-03fe-4962-a566-22f0bb28873b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:08.508448 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a89e2f-03fe-4962-a566-22f0bb28873b None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:08.510775 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 153/299] 10.222.0.70 () {56 vars in 1108 bytes} [Tue May 10 19:07:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:07:08.517461 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a89e2f-03fe-4962-a566-22f0bb28873b None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:08.540773 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a144648d-85c0-42eb-b294-cb4af0f9e699 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:08.575051 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80781926-6b00-4a65-8a0e-4068bd1ccea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:08.575869 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80781926-6b00-4a65-8a0e-4068bd1ccea7 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:08.576130 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80781926-6b00-4a65-8a0e-4068bd1ccea7 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:08.576405 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80781926-6b00-4a65-8a0e-4068bd1ccea7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:08.587903 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80781926-6b00-4a65-8a0e-4068bd1ccea7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:07:08.595583 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-80781926-6b00-4a65-8a0e-4068bd1ccea7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 10 19:07:08.595583 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:07:08.595583 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:07:08.595583 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:07:08.595583 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:07:08.595583 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:07:08.595583 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:07:08.595583 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:07:08.595583 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:07:08.595583 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:07:08.595583 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:07:08.595583 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:07:08.595583 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:07:08.595583 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:07:08.595583 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:07:08.595583 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:07:08.596538 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:07:08.596538 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:07:08.596538 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:07:08.596538 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:07:08.596538 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:07:08.596538 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:07:08.596538 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:07:08.596538 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:07:08.596538 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:07:08.596538 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:07:08.596538 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:07:08.596538 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( May 10 19:07:08.596538 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:07:08.596538 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() May 10 19:07:08.596538 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:07:08.596538 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:07:08.597939 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:07:08.597939 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() May 10 19:07:08.597939 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:07:08.597939 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( May 10 19:07:08.597939 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:07:08.597939 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:07:08.597939 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:07:08.597939 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:07:08.597939 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:07:08.597939 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:07:08.597939 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 10 19:07:08.597939 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:07:08.597939 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 147/300] 10.222.0.70 () {56 vars in 1099 bytes} [Tue May 10 19:07:08 2022] GET /identity/v3/roles/reader => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 19:07:08.602566 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80781926-6b00-4a65-8a0e-4068bd1ccea7 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:08.626556 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a89e2f-03fe-4962-a566-22f0bb28873b None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:08.661092 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e401d8e4-a3b3-441f-9b5b-08d42da86c8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:08.662196 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e401d8e4-a3b3-441f-9b5b-08d42da86c8d None admin] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:08.662675 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e401d8e4-a3b3-441f-9b5b-08d42da86c8d None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:08.663139 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e401d8e4-a3b3-441f-9b5b-08d42da86c8d None admin] PATH_INFO: `/v3/groups` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:08.664035 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e401d8e4-a3b3-441f-9b5b-08d42da86c8d None admin] RBAC: Authorizing `identity:create_group()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:08.665723 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e401d8e4-a3b3-441f-9b5b-08d42da86c8d None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:08.691788 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 154/301] 10.222.0.70 () {60 vars in 1134 bytes} [Tue May 10 19:07:08 2022] POST /identity/v3/groups => generated 229 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:07:08.698247 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aecde3-9ed6-445a-9455-0222293a83b8 None None] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:08.698536 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aecde3-9ed6-445a-9455-0222293a83b8 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:08.698811 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aecde3-9ed6-445a-9455-0222293a83b8 None None] PATH_INFO: `/` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:08.704895 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 155/302] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:07:08 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:07:08.710804 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e3177b-deb3-4f3b-9c66-300d6197958b None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:08.711142 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e3177b-deb3-4f3b-9c66-300d6197958b None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:08.711422 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e3177b-deb3-4f3b-9c66-300d6197958b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:08.718284 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80781926-6b00-4a65-8a0e-4068bd1ccea7 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:08.734693 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-47e3177b-deb3-4f3b-9c66-300d6197958b None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:07:08.736354 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-47e3177b-deb3-4f3b-9c66-300d6197958b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:07:08.762572 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e3dbb5-6cb0-446f-96b1-75869c596001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:08.763198 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e3dbb5-6cb0-446f-96b1-75869c596001 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:08.763475 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e3dbb5-6cb0-446f-96b1-75869c596001 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:08.763744 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e3dbb5-6cb0-446f-96b1-75869c596001 None admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:08.764548 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e3dbb5-6cb0-446f-96b1-75869c596001 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:07:08.764855 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e3dbb5-6cb0-446f-96b1-75869c596001 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:08.766313 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e3dbb5-6cb0-446f-96b1-75869c596001 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:08.779642 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 148/303] 10.222.0.70 () {56 vars in 1101 bytes} [Tue May 10 19:07:08 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:07:08.785085 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e3dbb5-6cb0-446f-96b1-75869c596001 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:08.838921 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 156/304] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:07:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 19:07:08.862458 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e3177b-deb3-4f3b-9c66-300d6197958b None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:08.892541 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e3dbb5-6cb0-446f-96b1-75869c596001 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:08.936859 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3996658-830e-4453-bcdf-ff163dda96ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:08.937752 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3996658-830e-4453-bcdf-ff163dda96ca None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:08.938040 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3996658-830e-4453-bcdf-ff163dda96ca None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:08.938310 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3996658-830e-4453-bcdf-ff163dda96ca None admin] PATH_INFO: `/v3/users/1ba02b1150eb40f0a5fa6bc327009143` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:08.957289 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3996658-830e-4453-bcdf-ff163dda96ca None admin] RBAC: Authorizing `identity:get_user(user_id=1ba02b1150eb40f0a5fa6bc327009143)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:08.962632 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3996658-830e-4453-bcdf-ff163dda96ca None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:08.964810 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 149/305] 10.222.0.70 () {56 vars in 1177 bytes} [Tue May 10 19:07:08 2022] GET /identity/v3/users/1ba02b1150eb40f0a5fa6bc327009143 => generated 293 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:07:08.971538 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3996658-830e-4453-bcdf-ff163dda96ca None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:08.996459 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e3177b-deb3-4f3b-9c66-300d6197958b None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:09.030849 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bceb622-bc2a-489c-9a3f-2fa825febf18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:09.031943 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bceb622-bc2a-489c-9a3f-2fa825febf18 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:09.032397 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bceb622-bc2a-489c-9a3f-2fa825febf18 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:09.032872 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bceb622-bc2a-489c-9a3f-2fa825febf18 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:09.043886 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bceb622-bc2a-489c-9a3f-2fa825febf18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:07:09.052193 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application [None req-4bceb622-bc2a-489c-9a3f-2fa825febf18 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 19:07:09.052193 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:07:09.052193 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:07:09.052193 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:07:09.052193 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:07:09.052193 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:07:09.052193 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:07:09.052193 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:07:09.052193 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:07:09.052193 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:07:09.052193 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:07:09.052193 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:07:09.052193 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:07:09.052193 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:07:09.052193 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:07:09.052193 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:07:09.053106 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:07:09.053106 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:07:09.053106 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:07:09.053106 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:07:09.053106 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:07:09.053106 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:07:09.053106 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:07:09.053106 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:07:09.053106 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:07:09.053106 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:07:09.053106 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:07:09.053106 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application with Lock( May 10 19:07:09.053106 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:07:09.053106 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._enter() May 10 19:07:09.053106 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:07:09.053106 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:07:09.053896 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:07:09.053896 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.creator() May 10 19:07:09.053896 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:07:09.053896 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application created_value = creator( May 10 19:07:09.053896 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:07:09.053896 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:07:09.053896 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:07:09.053896 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:07:09.053896 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:07:09.053896 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:07:09.053896 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 19:07:09.053896 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application May 10 19:07:09.056304 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 157/306] 10.222.0.70 () {56 vars in 1099 bytes} [Tue May 10 19:07:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:07:09.063377 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bceb622-bc2a-489c-9a3f-2fa825febf18 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:09.094464 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3996658-830e-4453-bcdf-ff163dda96ca None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:09.128669 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79680d2b-9eee-4a76-9c5d-d06db5b162eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:09.129667 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79680d2b-9eee-4a76-9c5d-d06db5b162eb None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:09.130123 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79680d2b-9eee-4a76-9c5d-d06db5b162eb None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:09.130568 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79680d2b-9eee-4a76-9c5d-d06db5b162eb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:09.131565 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79680d2b-9eee-4a76-9c5d-d06db5b162eb None admin] RBAC: Adding query filter params (role.id=93fda71e71a04ccb862ff5177646d5b5, user.id=1ba02b1150eb40f0a5fa6bc327009143, scope.system=all) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:07:09.132045 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79680d2b-9eee-4a76-9c5d-d06db5b162eb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:09.133666 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79680d2b-9eee-4a76-9c5d-d06db5b162eb None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:09.138802 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 150/307] 10.222.0.70 () {56 vars in 1308 bytes} [Tue May 10 19:07:08 2022] GET /identity/v3/role_assignments?user.id=1ba02b1150eb40f0a5fa6bc327009143&scope.system=all&role.id=93fda71e71a04ccb862ff5177646d5b5 => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:07:09.171273 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bceb622-bc2a-489c-9a3f-2fa825febf18 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:09.206201 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eb83b2-c09b-49dc-ac83-01ad5dfaa7e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:09.207194 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eb83b2-c09b-49dc-ac83-01ad5dfaa7e6 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:09.208486 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eb83b2-c09b-49dc-ac83-01ad5dfaa7e6 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:09.208954 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eb83b2-c09b-49dc-ac83-01ad5dfaa7e6 None admin] PATH_INFO: `/v3/roles` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:09.209898 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36eb83b2-c09b-49dc-ac83-01ad5dfaa7e6 None admin] RBAC: Adding query filter params (name=member) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:07:09.210386 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36eb83b2-c09b-49dc-ac83-01ad5dfaa7e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:09.212012 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36eb83b2-c09b-49dc-ac83-01ad5dfaa7e6 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:09.221967 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 158/308] 10.222.0.70 () {56 vars in 1101 bytes} [Tue May 10 19:07:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:07:09.229576 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79680d2b-9eee-4a76-9c5d-d06db5b162eb None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:09.337931 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79680d2b-9eee-4a76-9c5d-d06db5b162eb None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:09.374774 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6907a53e-ff8c-46ad-9571-62369be950b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:09.375664 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6907a53e-ff8c-46ad-9571-62369be950b7 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:09.375944 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6907a53e-ff8c-46ad-9571-62369be950b7 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:09.376219 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6907a53e-ff8c-46ad-9571-62369be950b7 None admin] PATH_INFO: `/v3/users/1fb9355fddc64fe5926001180f7bfbc0` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:09.377435 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6907a53e-ff8c-46ad-9571-62369be950b7 None admin] RBAC: Authorizing `identity:get_user(user_id=1fb9355fddc64fe5926001180f7bfbc0)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:09.378876 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6907a53e-ff8c-46ad-9571-62369be950b7 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:09.381387 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 151/309] 10.222.0.70 () {56 vars in 1177 bytes} [Tue May 10 19:07:09 2022] GET /identity/v3/users/1fb9355fddc64fe5926001180f7bfbc0 => generated 293 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:07:09.386965 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eb83b2-c09b-49dc-ac83-01ad5dfaa7e6 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:09.487820 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eb83b2-c09b-49dc-ac83-01ad5dfaa7e6 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:09.521365 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d33b74-f52d-4697-b0c2-dbb25d2361be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:09.522510 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d33b74-f52d-4697-b0c2-dbb25d2361be None admin] REQUEST_METHOD: `PUT` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:09.522952 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d33b74-f52d-4697-b0c2-dbb25d2361be None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:09.523370 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d33b74-f52d-4697-b0c2-dbb25d2361be None admin] PATH_INFO: `/v3/system/users/1fb9355fddc64fe5926001180f7bfbc0/roles/5c07cf5bfbd3427db18428aa50420962` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:09.525026 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d33b74-f52d-4697-b0c2-dbb25d2361be None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=1fb9355fddc64fe5926001180f7bfbc0, role_id=5c07cf5bfbd3427db18428aa50420962)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:09.526556 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d33b74-f52d-4697-b0c2-dbb25d2361be None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:09.539287 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 159/310] 10.222.0.70 () {58 vars in 1334 bytes} [Tue May 10 19:07:09 2022] PUT /identity/v3/system/users/1fb9355fddc64fe5926001180f7bfbc0/roles/5c07cf5bfbd3427db18428aa50420962 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:07:09.977950 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e2f7dc-d290-4a73-9d6e-990eb66dd910 None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:09.978256 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e2f7dc-d290-4a73-9d6e-990eb66dd910 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:09.978516 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e2f7dc-d290-4a73-9d6e-990eb66dd910 None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:09.980144 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 152/311] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:07:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:07:09.985431 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cd8086-771c-4809-9f8e-e1e9830b03e1 None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:09.985727 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cd8086-771c-4809-9f8e-e1e9830b03e1 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:09.986011 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cd8086-771c-4809-9f8e-e1e9830b03e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:10.003301 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-43cd8086-771c-4809-9f8e-e1e9830b03e1 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:07:10.004528 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-43cd8086-771c-4809-9f8e-e1e9830b03e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:07:10.078412 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 160/312] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:07:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 19:07:10.103663 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e2f7dc-d290-4a73-9d6e-990eb66dd910 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:10.201652 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e2f7dc-d290-4a73-9d6e-990eb66dd910 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:10.234727 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5061c3a3-bf25-4673-90a7-8b0ddc82d6d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:10.235448 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5061c3a3-bf25-4673-90a7-8b0ddc82d6d9 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:10.235727 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5061c3a3-bf25-4673-90a7-8b0ddc82d6d9 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:10.235996 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5061c3a3-bf25-4673-90a7-8b0ddc82d6d9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:10.245929 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5061c3a3-bf25-4673-90a7-8b0ddc82d6d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:07:10.253446 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-5061c3a3-bf25-4673-90a7-8b0ddc82d6d9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 10 19:07:10.253446 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:07:10.253446 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:07:10.253446 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:07:10.253446 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:07:10.253446 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:07:10.253446 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:07:10.253446 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:07:10.253446 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:07:10.253446 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:07:10.253446 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:07:10.253446 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:07:10.253446 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:07:10.253446 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:07:10.253446 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:07:10.253446 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:07:10.254332 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:07:10.254332 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:07:10.254332 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:07:10.254332 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:07:10.254332 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:07:10.254332 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:07:10.254332 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:07:10.254332 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:07:10.254332 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:07:10.254332 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:07:10.254332 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:07:10.254332 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( May 10 19:07:10.254332 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:07:10.254332 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() May 10 19:07:10.254332 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:07:10.254332 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:07:10.255692 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:07:10.255692 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() May 10 19:07:10.255692 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:07:10.255692 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( May 10 19:07:10.255692 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:07:10.255692 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:07:10.255692 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:07:10.255692 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:07:10.255692 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:07:10.255692 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:07:10.255692 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 10 19:07:10.255692 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:07:10.255692 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 153/313] 10.222.0.70 () {56 vars in 1099 bytes} [Tue May 10 19:07:10 2022] GET /identity/v3/roles/reader => generated 84 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:07:10.260925 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cd8086-771c-4809-9f8e-e1e9830b03e1 None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:10.367150 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cd8086-771c-4809-9f8e-e1e9830b03e1 None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:10.403072 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eb09fb-21af-4d02-a339-26e2555349f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:10.404564 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eb09fb-21af-4d02-a339-26e2555349f7 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:10.405050 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eb09fb-21af-4d02-a339-26e2555349f7 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:10.405558 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eb09fb-21af-4d02-a339-26e2555349f7 None admin] PATH_INFO: `/v3/roles` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:10.406503 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5eb09fb-21af-4d02-a339-26e2555349f7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:07:10.407003 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5eb09fb-21af-4d02-a339-26e2555349f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:10.408643 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5eb09fb-21af-4d02-a339-26e2555349f7 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:10.419119 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 161/314] 10.222.0.70 () {56 vars in 1101 bytes} [Tue May 10 19:07:10 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:07:10.424880 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5061c3a3-bf25-4673-90a7-8b0ddc82d6d9 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:10.523715 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5061c3a3-bf25-4673-90a7-8b0ddc82d6d9 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:10.556694 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac130a0-8263-4295-b5e7-f91006151723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:10.557571 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac130a0-8263-4295-b5e7-f91006151723 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:10.557848 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac130a0-8263-4295-b5e7-f91006151723 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:10.558118 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac130a0-8263-4295-b5e7-f91006151723 None admin] PATH_INFO: `/v3/users/187e812c10ea4f99990d929f031ecbe6` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:10.559301 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac130a0-8263-4295-b5e7-f91006151723 None admin] RBAC: Authorizing `identity:get_user(user_id=187e812c10ea4f99990d929f031ecbe6)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:10.560961 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac130a0-8263-4295-b5e7-f91006151723 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:10.562878 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 154/315] 10.222.0.70 () {56 vars in 1177 bytes} [Tue May 10 19:07:10 2022] GET /identity/v3/users/187e812c10ea4f99990d929f031ecbe6 => generated 297 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:07:10.568266 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eb09fb-21af-4d02-a339-26e2555349f7 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:10.672883 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eb09fb-21af-4d02-a339-26e2555349f7 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:10.706789 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe8909b-f4ea-4d33-8a32-b504ac57f3ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:10.708606 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe8909b-f4ea-4d33-8a32-b504ac57f3ce None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:10.709092 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe8909b-f4ea-4d33-8a32-b504ac57f3ce None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:10.709590 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe8909b-f4ea-4d33-8a32-b504ac57f3ce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:10.778489 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe8909b-f4ea-4d33-8a32-b504ac57f3ce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:10.780280 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe8909b-f4ea-4d33-8a32-b504ac57f3ce None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:10.878456 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 162/316] 10.222.0.70 () {58 vars in 1282 bytes} [Tue May 10 19:07:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 19:07:10.883670 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac130a0-8263-4295-b5e7-f91006151723 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:11.019230 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac130a0-8263-4295-b5e7-f91006151723 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:11.053218 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83987fb5-61ee-4e72-b611-034347c35de2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:11.054003 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83987fb5-61ee-4e72-b611-034347c35de2 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:11.054279 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83987fb5-61ee-4e72-b611-034347c35de2 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:11.054545 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83987fb5-61ee-4e72-b611-034347c35de2 None admin] PATH_INFO: `/v3/projects/e0df39feccc3439b965b22d514a229be` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:11.055711 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83987fb5-61ee-4e72-b611-034347c35de2 None admin] RBAC: Authorizing `identity:get_project(project_id=e0df39feccc3439b965b22d514a229be)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:11.057162 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83987fb5-61ee-4e72-b611-034347c35de2 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:11.059128 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 155/317] 10.222.0.70 () {56 vars in 1186 bytes} [Tue May 10 19:07:10 2022] GET /identity/v3/projects/e0df39feccc3439b965b22d514a229be => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:07:11.064949 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe8909b-f4ea-4d33-8a32-b504ac57f3ce None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:11.110397 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fbfd03-62b2-4cf3-ae6b-dc30156e293d None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:11.110726 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fbfd03-62b2-4cf3-ae6b-dc30156e293d None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:11.110964 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fbfd03-62b2-4cf3-ae6b-dc30156e293d None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:11.116271 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 156/318] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:07:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 19:07:11.124443 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2cec7b-8158-4f6d-9dba-2bba50121f0b None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:11.124443 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2cec7b-8158-4f6d-9dba-2bba50121f0b None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:11.124443 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2cec7b-8158-4f6d-9dba-2bba50121f0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:11.148444 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-6a2cec7b-8158-4f6d-9dba-2bba50121f0b None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:07:11.148653 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-6a2cec7b-8158-4f6d-9dba-2bba50121f0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:07:11.202682 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe8909b-f4ea-4d33-8a32-b504ac57f3ce None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:11.237514 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72fa682-14ae-4a4b-9095-bd80f1f7feea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:11.238171 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72fa682-14ae-4a4b-9095-bd80f1f7feea None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:11.238453 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72fa682-14ae-4a4b-9095-bd80f1f7feea None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:11.238724 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72fa682-14ae-4a4b-9095-bd80f1f7feea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:11.239616 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72fa682-14ae-4a4b-9095-bd80f1f7feea None admin] RBAC: Adding query filter params (role.id=93fda71e71a04ccb862ff5177646d5b5, scope.project.id=e0df39feccc3439b965b22d514a229be, user.id=187e812c10ea4f99990d929f031ecbe6) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:07:11.239924 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72fa682-14ae-4a4b-9095-bd80f1f7feea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:11.241418 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72fa682-14ae-4a4b-9095-bd80f1f7feea None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:11.247481 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 163/319] 10.222.0.70 () {56 vars in 1374 bytes} [Tue May 10 19:07:11 2022] GET /identity/v3/role_assignments?user.id=187e812c10ea4f99990d929f031ecbe6&scope.project.id=e0df39feccc3439b965b22d514a229be&role.id=93fda71e71a04ccb862ff5177646d5b5 => generated 608 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:07:11.262822 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 157/320] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:07:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 19:07:11.285311 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72fa682-14ae-4a4b-9095-bd80f1f7feea None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:11.393448 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72fa682-14ae-4a4b-9095-bd80f1f7feea None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:11.433187 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a468716-bcf2-42ca-8b0c-dd3d1abe73a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:11.434012 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a468716-bcf2-42ca-8b0c-dd3d1abe73a2 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:11.434298 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a468716-bcf2-42ca-8b0c-dd3d1abe73a2 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:11.434574 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a468716-bcf2-42ca-8b0c-dd3d1abe73a2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:11.435852 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a468716-bcf2-42ca-8b0c-dd3d1abe73a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:11.437386 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a468716-bcf2-42ca-8b0c-dd3d1abe73a2 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:11.444064 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 164/321] 10.222.0.70 () {56 vars in 1108 bytes} [Tue May 10 19:07:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:07:11.445668 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2cec7b-8158-4f6d-9dba-2bba50121f0b None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:11.552244 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2cec7b-8158-4f6d-9dba-2bba50121f0b None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:11.587198 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7936de7-6832-4e6e-9d7b-fe73894c60f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:11.588112 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7936de7-6832-4e6e-9d7b-fe73894c60f0 None admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:11.588653 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7936de7-6832-4e6e-9d7b-fe73894c60f0 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:11.589075 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7936de7-6832-4e6e-9d7b-fe73894c60f0 None admin] PATH_INFO: `/v3/groups` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:11.589910 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7936de7-6832-4e6e-9d7b-fe73894c60f0 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:11.591499 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7936de7-6832-4e6e-9d7b-fe73894c60f0 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:11.606688 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 158/322] 10.222.0.70 () {60 vars in 1134 bytes} [Tue May 10 19:07:11 2022] POST /identity/v3/groups => generated 226 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:07:11.617297 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74fe60a-a2c4-430c-8b07-245f7a093758 None None] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:11.617663 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74fe60a-a2c4-430c-8b07-245f7a093758 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:11.618055 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74fe60a-a2c4-430c-8b07-245f7a093758 None None] PATH_INFO: `/` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:11.619579 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 165/323] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:07:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:07:11.625826 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2164bb31-d578-4686-9fb0-55df579f638f None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:11.626181 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2164bb31-d578-4686-9fb0-55df579f638f None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:11.626410 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2164bb31-d578-4686-9fb0-55df579f638f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:11.644787 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-2164bb31-d578-4686-9fb0-55df579f638f None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:07:11.645952 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-2164bb31-d578-4686-9fb0-55df579f638f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:07:11.718455 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 159/324] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:07:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 19:07:11.741579 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74fe60a-a2c4-430c-8b07-245f7a093758 None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:11.845762 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74fe60a-a2c4-430c-8b07-245f7a093758 None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:11.882559 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8966c6a5-f373-4c69-8fc7-dfe9ee16a20f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:11.883777 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8966c6a5-f373-4c69-8fc7-dfe9ee16a20f None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:11.884261 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8966c6a5-f373-4c69-8fc7-dfe9ee16a20f None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:11.884813 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8966c6a5-f373-4c69-8fc7-dfe9ee16a20f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:11.888648 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aeb631-d0db-48ef-a30b-f93fdea9cde8 None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:11.888935 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aeb631-d0db-48ef-a30b-f93fdea9cde8 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:11.889213 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aeb631-d0db-48ef-a30b-f93fdea9cde8 None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:11.891032 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 160/325] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:07:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 19:07:11.897179 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f695285d-8ff5-46d9-9b07-78a8551dc921 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:11.897711 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f695285d-8ff5-46d9-9b07-78a8551dc921 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:11.897815 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8966c6a5-f373-4c69-8fc7-dfe9ee16a20f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:07:11.898311 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f695285d-8ff5-46d9-9b07-78a8551dc921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:11.905691 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application [None req-8966c6a5-f373-4c69-8fc7-dfe9ee16a20f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 10 19:07:11.905691 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:07:11.905691 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:07:11.905691 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:07:11.905691 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:07:11.905691 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:07:11.905691 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:07:11.905691 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:07:11.905691 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:07:11.905691 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:07:11.905691 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:07:11.905691 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:07:11.905691 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:07:11.905691 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:07:11.905691 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:07:11.905691 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:07:11.906611 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:07:11.906611 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:07:11.906611 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:07:11.906611 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:07:11.906611 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:07:11.906611 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:07:11.906611 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:07:11.906611 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:07:11.906611 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:07:11.906611 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:07:11.906611 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:07:11.906611 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application with Lock( May 10 19:07:11.906611 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:07:11.906611 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._enter() May 10 19:07:11.906611 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:07:11.906611 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:07:11.907406 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:07:11.907406 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.creator() May 10 19:07:11.907406 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:07:11.907406 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application created_value = creator( May 10 19:07:11.907406 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:07:11.907406 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:07:11.907406 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:07:11.907406 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:07:11.907406 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:07:11.907406 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:07:11.907406 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 10 19:07:11.907406 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application May 10 19:07:11.907406 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 166/326] 10.222.0.70 () {56 vars in 1099 bytes} [Tue May 10 19:07:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:07:11.912763 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8966c6a5-f373-4c69-8fc7-dfe9ee16a20f None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:11.921868 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-f695285d-8ff5-46d9-9b07-78a8551dc921 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:07:11.923071 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-f695285d-8ff5-46d9-9b07-78a8551dc921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:07:12.015479 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 161/327] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:07:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 19:07:12.030342 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8966c6a5-f373-4c69-8fc7-dfe9ee16a20f None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:12.040396 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f695285d-8ff5-46d9-9b07-78a8551dc921 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:12.068302 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c6ef9e-794c-4daa-b7dc-62cb76e1431b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:12.069010 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c6ef9e-794c-4daa-b7dc-62cb76e1431b None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:12.069332 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c6ef9e-794c-4daa-b7dc-62cb76e1431b None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:12.069569 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c6ef9e-794c-4daa-b7dc-62cb76e1431b None admin] PATH_INFO: `/v3/roles` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:12.070317 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c6ef9e-794c-4daa-b7dc-62cb76e1431b None admin] RBAC: Adding query filter params (name=reader) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:07:12.070621 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c6ef9e-794c-4daa-b7dc-62cb76e1431b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:12.072054 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c6ef9e-794c-4daa-b7dc-62cb76e1431b None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:12.081496 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 167/328] 10.222.0.70 () {56 vars in 1101 bytes} [Tue May 10 19:07:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:07:12.088711 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c6ef9e-794c-4daa-b7dc-62cb76e1431b None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:12.165870 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f695285d-8ff5-46d9-9b07-78a8551dc921 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:12.198236 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c6ef9e-794c-4daa-b7dc-62cb76e1431b None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:12.210013 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ab29fd-391d-44cb-917a-ec55bbb4658d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:12.210737 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ab29fd-391d-44cb-917a-ec55bbb4658d None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:12.211020 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ab29fd-391d-44cb-917a-ec55bbb4658d None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:12.211285 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ab29fd-391d-44cb-917a-ec55bbb4658d None admin] PATH_INFO: `/v3/roles/member` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:12.224580 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ab29fd-391d-44cb-917a-ec55bbb4658d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:07:12.234894 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-b9ab29fd-391d-44cb-917a-ec55bbb4658d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 19:07:12.234894 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:07:12.234894 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:07:12.234894 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:07:12.234894 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:07:12.234894 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:07:12.234894 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:07:12.234894 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:07:12.234894 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:07:12.234894 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:07:12.234894 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:07:12.234894 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:07:12.234894 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:07:12.234894 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:07:12.234894 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:07:12.234894 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:07:12.235819 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:07:12.235819 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:07:12.235819 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:07:12.235819 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:07:12.235819 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:07:12.235819 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:07:12.235819 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:07:12.235819 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:07:12.235819 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:07:12.235819 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:07:12.235819 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:07:12.235819 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( May 10 19:07:12.235819 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:07:12.235819 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() May 10 19:07:12.235819 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:07:12.235819 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:07:12.236691 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:07:12.236691 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() May 10 19:07:12.236691 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:07:12.236691 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( May 10 19:07:12.236691 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:07:12.236691 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:07:12.236691 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:07:12.236691 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:07:12.236691 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:07:12.236691 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:07:12.236691 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 19:07:12.236691 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:07:12.240555 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 162/329] 10.222.0.70 () {56 vars in 1099 bytes} [Tue May 10 19:07:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 19:07:12.242292 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf38191-123f-472c-b168-afe279b189bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:12.242592 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ab29fd-391d-44cb-917a-ec55bbb4658d None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:12.243780 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf38191-123f-472c-b168-afe279b189bd None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:12.244278 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf38191-123f-472c-b168-afe279b189bd None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:12.244808 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf38191-123f-472c-b168-afe279b189bd None admin] PATH_INFO: `/v3/users/1ba02b1150eb40f0a5fa6bc327009143` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:12.246224 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf38191-123f-472c-b168-afe279b189bd None admin] RBAC: Authorizing `identity:get_user(user_id=1ba02b1150eb40f0a5fa6bc327009143)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:12.247897 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf38191-123f-472c-b168-afe279b189bd None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:12.250064 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 168/330] 10.222.0.70 () {56 vars in 1177 bytes} [Tue May 10 19:07:12 2022] GET /identity/v3/users/1ba02b1150eb40f0a5fa6bc327009143 => generated 293 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:07:12.255166 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf38191-123f-472c-b168-afe279b189bd None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:12.344348 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ab29fd-391d-44cb-917a-ec55bbb4658d None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:12.379958 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53119f4-356d-4d49-8cc7-e365bf45adf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:12.381117 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53119f4-356d-4d49-8cc7-e365bf45adf5 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:12.381406 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53119f4-356d-4d49-8cc7-e365bf45adf5 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:12.381684 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53119f4-356d-4d49-8cc7-e365bf45adf5 None admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:12.382443 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53119f4-356d-4d49-8cc7-e365bf45adf5 None admin] RBAC: Adding query filter params (name=member) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:07:12.382751 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53119f4-356d-4d49-8cc7-e365bf45adf5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:12.384157 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53119f4-356d-4d49-8cc7-e365bf45adf5 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:12.394877 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 163/331] 10.222.0.70 () {56 vars in 1101 bytes} [Tue May 10 19:07:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:07:12.400908 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53119f4-356d-4d49-8cc7-e365bf45adf5 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:12.402775 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf38191-123f-472c-b168-afe279b189bd None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:12.437991 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19331790-fe52-4de5-b190-b41a5a9c52d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:12.438868 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19331790-fe52-4de5-b190-b41a5a9c52d2 None admin] REQUEST_METHOD: `PUT` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:12.439147 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19331790-fe52-4de5-b190-b41a5a9c52d2 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:12.439419 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19331790-fe52-4de5-b190-b41a5a9c52d2 None admin] PATH_INFO: `/v3/system/users/1ba02b1150eb40f0a5fa6bc327009143/roles/93fda71e71a04ccb862ff5177646d5b5` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:12.440966 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19331790-fe52-4de5-b190-b41a5a9c52d2 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=1ba02b1150eb40f0a5fa6bc327009143, role_id=93fda71e71a04ccb862ff5177646d5b5)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:12.442903 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19331790-fe52-4de5-b190-b41a5a9c52d2 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:12.453617 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 169/332] 10.222.0.70 () {58 vars in 1334 bytes} [Tue May 10 19:07:12 2022] PUT /identity/v3/system/users/1ba02b1150eb40f0a5fa6bc327009143/roles/93fda71e71a04ccb862ff5177646d5b5 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:07:12.507367 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53119f4-356d-4d49-8cc7-e365bf45adf5 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:12.545038 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a413f98d-bae0-4efc-8345-f3a4ee2a1146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:12.545984 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a413f98d-bae0-4efc-8345-f3a4ee2a1146 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:12.546274 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a413f98d-bae0-4efc-8345-f3a4ee2a1146 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:12.546554 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a413f98d-bae0-4efc-8345-f3a4ee2a1146 None admin] PATH_INFO: `/v3/users/1fb9355fddc64fe5926001180f7bfbc0` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:12.547974 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a413f98d-bae0-4efc-8345-f3a4ee2a1146 None admin] RBAC: Authorizing `identity:get_user(user_id=1fb9355fddc64fe5926001180f7bfbc0)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:12.549586 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a413f98d-bae0-4efc-8345-f3a4ee2a1146 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:12.551789 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 164/333] 10.222.0.70 () {56 vars in 1177 bytes} [Tue May 10 19:07:12 2022] GET /identity/v3/users/1fb9355fddc64fe5926001180f7bfbc0 => generated 293 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:07:12.557371 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19331790-fe52-4de5-b190-b41a5a9c52d2 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:12.666604 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19331790-fe52-4de5-b190-b41a5a9c52d2 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:12.708405 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c76d0e7-89b2-452d-ae91-6d342996a7a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:12.709027 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c76d0e7-89b2-452d-ae91-6d342996a7a2 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:12.709314 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c76d0e7-89b2-452d-ae91-6d342996a7a2 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:12.709589 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c76d0e7-89b2-452d-ae91-6d342996a7a2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:12.710422 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c76d0e7-89b2-452d-ae91-6d342996a7a2 None admin] RBAC: Adding query filter params (role.id=5c07cf5bfbd3427db18428aa50420962, user.id=1fb9355fddc64fe5926001180f7bfbc0, scope.system=all) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:07:12.710732 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c76d0e7-89b2-452d-ae91-6d342996a7a2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:12.712188 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c76d0e7-89b2-452d-ae91-6d342996a7a2 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:12.729543 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 170/334] 10.222.0.70 () {56 vars in 1308 bytes} [Tue May 10 19:07:12 2022] GET /identity/v3/role_assignments?user.id=1fb9355fddc64fe5926001180f7bfbc0&scope.system=all&role.id=5c07cf5bfbd3427db18428aa50420962 => generated 510 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:07:14.376622 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9de4c80-6464-43e0-b572-847be82c9639 None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:14.376622 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9de4c80-6464-43e0-b572-847be82c9639 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:14.376622 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9de4c80-6464-43e0-b572-847be82c9639 None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:14.377691 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 165/335] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:07:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:07:14.384061 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771bae2f-5035-4cb6-8abb-a6d2b933ed8c None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:14.386558 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771bae2f-5035-4cb6-8abb-a6d2b933ed8c None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:14.386558 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771bae2f-5035-4cb6-8abb-a6d2b933ed8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:14.408473 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-771bae2f-5035-4cb6-8abb-a6d2b933ed8c None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:07:14.408473 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-771bae2f-5035-4cb6-8abb-a6d2b933ed8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:07:14.494441 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 171/336] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:07:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 19:07:14.532203 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9de4c80-6464-43e0-b572-847be82c9639 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:14.663261 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9de4c80-6464-43e0-b572-847be82c9639 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:14.703917 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451f2ce0-86a9-4c71-b720-14e4454442ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:14.704754 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451f2ce0-86a9-4c71-b720-14e4454442ba None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:14.705042 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451f2ce0-86a9-4c71-b720-14e4454442ba None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:14.705319 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451f2ce0-86a9-4c71-b720-14e4454442ba None admin] PATH_INFO: `/v3/roles/member` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:14.721723 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451f2ce0-86a9-4c71-b720-14e4454442ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:07:14.730003 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-451f2ce0-86a9-4c71-b720-14e4454442ba None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 19:07:14.730003 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:07:14.730003 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:07:14.730003 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:07:14.730003 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:07:14.730003 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:07:14.730003 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:07:14.730003 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:07:14.730003 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:07:14.730003 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:07:14.730003 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:07:14.730003 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:07:14.730003 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:07:14.730003 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:07:14.730003 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:07:14.730003 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:07:14.730924 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:07:14.730924 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:07:14.730924 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:07:14.730924 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:07:14.730924 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:07:14.730924 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:07:14.730924 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:07:14.730924 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:07:14.730924 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:07:14.730924 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:07:14.730924 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:07:14.730924 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( May 10 19:07:14.730924 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:07:14.730924 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() May 10 19:07:14.730924 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:07:14.730924 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:07:14.731741 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:07:14.731741 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() May 10 19:07:14.731741 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:07:14.731741 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( May 10 19:07:14.731741 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:07:14.731741 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:07:14.731741 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:07:14.731741 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:07:14.731741 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:07:14.731741 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:07:14.731741 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 19:07:14.731741 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:07:14.731741 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 166/337] 10.222.0.70 () {56 vars in 1099 bytes} [Tue May 10 19:07:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:07:14.738871 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771bae2f-5035-4cb6-8abb-a6d2b933ed8c None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:14.885072 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771bae2f-5035-4cb6-8abb-a6d2b933ed8c None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:14.932708 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e3c3c9-3d78-4ad9-bcb7-ac3232202ac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:14.933318 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e3c3c9-3d78-4ad9-bcb7-ac3232202ac1 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:14.933601 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e3c3c9-3d78-4ad9-bcb7-ac3232202ac1 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:14.933874 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e3c3c9-3d78-4ad9-bcb7-ac3232202ac1 None admin] PATH_INFO: `/v3/roles` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:14.934629 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e3c3c9-3d78-4ad9-bcb7-ac3232202ac1 None admin] RBAC: Adding query filter params (name=member) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:07:14.934932 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e3c3c9-3d78-4ad9-bcb7-ac3232202ac1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:14.936346 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e3c3c9-3d78-4ad9-bcb7-ac3232202ac1 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:14.949232 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 172/338] 10.222.0.70 () {56 vars in 1101 bytes} [Tue May 10 19:07:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:07:14.959052 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451f2ce0-86a9-4c71-b720-14e4454442ba None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:15.084770 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451f2ce0-86a9-4c71-b720-14e4454442ba None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:15.125595 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abecd77-0c2f-41d1-bf60-4a76cb2287e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:15.126676 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abecd77-0c2f-41d1-bf60-4a76cb2287e4 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:15.127170 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abecd77-0c2f-41d1-bf60-4a76cb2287e4 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:15.127650 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abecd77-0c2f-41d1-bf60-4a76cb2287e4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:15.207669 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abecd77-0c2f-41d1-bf60-4a76cb2287e4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:15.209736 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abecd77-0c2f-41d1-bf60-4a76cb2287e4 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:15.313577 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 167/339] 10.222.0.70 () {58 vars in 1282 bytes} [Tue May 10 19:07:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 19:07:15.319471 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e3c3c9-3d78-4ad9-bcb7-ac3232202ac1 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:15.320515 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd9a227-77ac-45a7-8ef5-e4a120c336fe None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:15.320813 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd9a227-77ac-45a7-8ef5-e4a120c336fe None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:15.321140 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd9a227-77ac-45a7-8ef5-e4a120c336fe None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:15.322499 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 168/340] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:07:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 19:07:15.328276 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a090e9c9-b10e-4ee8-93d3-3843e880936f None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:15.328551 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a090e9c9-b10e-4ee8-93d3-3843e880936f None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:15.328823 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a090e9c9-b10e-4ee8-93d3-3843e880936f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:15.350227 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-a090e9c9-b10e-4ee8-93d3-3843e880936f None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:07:15.351433 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-a090e9c9-b10e-4ee8-93d3-3843e880936f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:07:15.451000 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 169/341] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:07:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 19:07:15.475965 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e3c3c9-3d78-4ad9-bcb7-ac3232202ac1 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:15.483536 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80df2f7b-8d17-46df-ad6a-5da5763922d1 None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:15.484126 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80df2f7b-8d17-46df-ad6a-5da5763922d1 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:15.484674 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80df2f7b-8d17-46df-ad6a-5da5763922d1 None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:15.486230 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 170/342] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:07:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 19:07:15.491568 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed2eb73-20c7-45d4-8cb4-c286681afcda None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:15.492100 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed2eb73-20c7-45d4-8cb4-c286681afcda None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:15.492709 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed2eb73-20c7-45d4-8cb4-c286681afcda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:15.519455 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-fed2eb73-20c7-45d4-8cb4-c286681afcda None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:07:15.521431 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-fed2eb73-20c7-45d4-8cb4-c286681afcda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:07:15.525769 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8423140a-250d-4dfe-a593-71138d9ce067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:15.526040 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8423140a-250d-4dfe-a593-71138d9ce067 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:15.526308 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8423140a-250d-4dfe-a593-71138d9ce067 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:15.526548 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8423140a-250d-4dfe-a593-71138d9ce067 None admin] PATH_INFO: `/v3/projects/b028ff2c5aa54499a9cd429125c28fc7` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:15.529725 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8423140a-250d-4dfe-a593-71138d9ce067 None admin] RBAC: Authorizing `identity:get_project(project_id=b028ff2c5aa54499a9cd429125c28fc7)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:15.531753 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8423140a-250d-4dfe-a593-71138d9ce067 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:15.535402 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 173/343] 10.222.0.70 () {56 vars in 1186 bytes} [Tue May 10 19:07:15 2022] GET /identity/v3/projects/b028ff2c5aa54499a9cd429125c28fc7 => generated 298 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:07:15.535402 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8423140a-250d-4dfe-a593-71138d9ce067 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:15.618145 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 171/344] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:07:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 19:07:15.619980 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a091b86-2083-4213-b7b5-055e2deb3113 None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:15.620585 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a091b86-2083-4213-b7b5-055e2deb3113 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:15.621065 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a091b86-2083-4213-b7b5-055e2deb3113 None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:15.623397 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 172/345] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:07:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:07:15.624317 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a091b86-2083-4213-b7b5-055e2deb3113 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:15.662565 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8423140a-250d-4dfe-a593-71138d9ce067 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:15.708953 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73f71c7-ebc9-4cdc-b05a-dbda7b6686b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:15.709780 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73f71c7-ebc9-4cdc-b05a-dbda7b6686b1 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:15.710116 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73f71c7-ebc9-4cdc-b05a-dbda7b6686b1 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:15.710393 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73f71c7-ebc9-4cdc-b05a-dbda7b6686b1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:15.727073 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73f71c7-ebc9-4cdc-b05a-dbda7b6686b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:07:15.737540 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application [None req-c73f71c7-ebc9-4cdc-b05a-dbda7b6686b1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 19:07:15.737540 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:07:15.737540 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:07:15.737540 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:07:15.737540 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:07:15.737540 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:07:15.737540 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:07:15.737540 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:07:15.737540 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:07:15.737540 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:07:15.737540 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:07:15.737540 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:07:15.737540 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:07:15.737540 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:07:15.737540 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:07:15.737540 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:07:15.738487 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:07:15.738487 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:07:15.738487 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:07:15.738487 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:07:15.738487 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:07:15.738487 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:07:15.738487 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:07:15.738487 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:07:15.738487 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:07:15.738487 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:07:15.738487 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:07:15.738487 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application with Lock( May 10 19:07:15.738487 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:07:15.738487 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._enter() May 10 19:07:15.738487 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:07:15.738487 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:07:15.739465 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:07:15.739465 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.creator() May 10 19:07:15.739465 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:07:15.739465 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application created_value = creator( May 10 19:07:15.739465 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:07:15.739465 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:07:15.739465 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:07:15.739465 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:07:15.739465 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:07:15.739465 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:07:15.739465 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 19:07:15.739465 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application May 10 19:07:15.739465 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 174/346] 10.222.0.70 () {56 vars in 1114 bytes} [Tue May 10 19:07:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:07:15.741056 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78385d7c-f723-4694-acca-b2554f1d0d6b None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:15.744444 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78385d7c-f723-4694-acca-b2554f1d0d6b None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:15.744444 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78385d7c-f723-4694-acca-b2554f1d0d6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:15.749162 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a091b86-2083-4213-b7b5-055e2deb3113 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:15.761977 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-78385d7c-f723-4694-acca-b2554f1d0d6b None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:07:15.763899 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-78385d7c-f723-4694-acca-b2554f1d0d6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:07:15.787205 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50ea021-bb91-4c9f-9439-cf2c511afcfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:15.788165 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50ea021-bb91-4c9f-9439-cf2c511afcfc None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:15.788549 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50ea021-bb91-4c9f-9439-cf2c511afcfc None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:15.788892 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50ea021-bb91-4c9f-9439-cf2c511afcfc None admin] PATH_INFO: `/v3/groups/4a0804b8bd3d4a75ad8387c65b79ba3a` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:15.796099 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50ea021-bb91-4c9f-9439-cf2c511afcfc None admin] RBAC: Authorizing `identity:get_group(group_id=4a0804b8bd3d4a75ad8387c65b79ba3a)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:15.797858 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50ea021-bb91-4c9f-9439-cf2c511afcfc None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:15.799758 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 173/347] 10.222.0.70 () {56 vars in 1180 bytes} [Tue May 10 19:07:15 2022] GET /identity/v3/groups/4a0804b8bd3d4a75ad8387c65b79ba3a => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:07:15.800391 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50ea021-bb91-4c9f-9439-cf2c511afcfc None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:15.856283 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 175/348] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:07:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 19:07:15.858274 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78385d7c-f723-4694-acca-b2554f1d0d6b None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:15.907308 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50ea021-bb91-4c9f-9439-cf2c511afcfc None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:15.946407 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab42a26e-1c73-48b8-98f1-fbee940a5482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:15.947380 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab42a26e-1c73-48b8-98f1-fbee940a5482 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:15.947927 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab42a26e-1c73-48b8-98f1-fbee940a5482 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:15.948057 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab42a26e-1c73-48b8-98f1-fbee940a5482 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:15.973805 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab42a26e-1c73-48b8-98f1-fbee940a5482 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:07:15.978471 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78385d7c-f723-4694-acca-b2554f1d0d6b None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:15.981398 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-ab42a26e-1c73-48b8-98f1-fbee940a5482 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 10 19:07:15.981398 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:07:15.981398 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:07:15.981398 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:07:15.981398 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:07:15.981398 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:07:15.981398 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:07:15.981398 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:07:15.981398 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:07:15.981398 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:07:15.981398 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:07:15.981398 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:07:15.981398 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:07:15.981398 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:07:15.981398 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:07:15.981398 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:07:15.982419 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:07:15.982419 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:07:15.982419 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:07:15.982419 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:07:15.982419 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:07:15.982419 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:07:15.982419 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:07:15.982419 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:07:15.982419 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:07:15.982419 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:07:15.982419 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:07:15.982419 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( May 10 19:07:15.982419 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:07:15.982419 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() May 10 19:07:15.982419 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:07:15.982419 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:07:15.983222 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:07:15.983222 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() May 10 19:07:15.983222 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:07:15.983222 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( May 10 19:07:15.983222 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:07:15.983222 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:07:15.983222 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:07:15.983222 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:07:15.983222 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:07:15.983222 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:07:15.983222 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 10 19:07:15.983222 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:07:15.985948 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 174/349] 10.222.0.70 () {56 vars in 1099 bytes} [Tue May 10 19:07:15 2022] GET /identity/v3/roles/reader => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:07:15.986917 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab42a26e-1c73-48b8-98f1-fbee940a5482 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:16.021724 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6376a3-2a39-4ea8-aef5-432306bd4d1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:16.022772 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6376a3-2a39-4ea8-aef5-432306bd4d1b None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:16.023127 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6376a3-2a39-4ea8-aef5-432306bd4d1b None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:16.023498 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6376a3-2a39-4ea8-aef5-432306bd4d1b None admin] PATH_INFO: `/v3/roles` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:16.024509 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6376a3-2a39-4ea8-aef5-432306bd4d1b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:07:16.025202 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6376a3-2a39-4ea8-aef5-432306bd4d1b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:16.026933 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6376a3-2a39-4ea8-aef5-432306bd4d1b None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:16.037756 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 176/350] 10.222.0.70 () {56 vars in 1111 bytes} [Tue May 10 19:07:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:07:16.038426 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6376a3-2a39-4ea8-aef5-432306bd4d1b None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:16.110230 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab42a26e-1c73-48b8-98f1-fbee940a5482 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:16.152139 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af056d0-22ff-46e2-8fd5-37ef70f7b8d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:16.153173 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af056d0-22ff-46e2-8fd5-37ef70f7b8d4 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:16.153614 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af056d0-22ff-46e2-8fd5-37ef70f7b8d4 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:16.154042 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af056d0-22ff-46e2-8fd5-37ef70f7b8d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:16.155029 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af056d0-22ff-46e2-8fd5-37ef70f7b8d4 None admin] RBAC: Adding query filter params (group.id=4a0804b8bd3d4a75ad8387c65b79ba3a, role.id=5c07cf5bfbd3427db18428aa50420962, scope.project.id=b028ff2c5aa54499a9cd429125c28fc7) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:07:16.155508 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af056d0-22ff-46e2-8fd5-37ef70f7b8d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:16.156157 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6376a3-2a39-4ea8-aef5-432306bd4d1b None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:16.157313 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af056d0-22ff-46e2-8fd5-37ef70f7b8d4 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:16.163469 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 175/351] 10.222.0.70 () {56 vars in 1376 bytes} [Tue May 10 19:07:15 2022] GET /identity/v3/role_assignments?group.id=4a0804b8bd3d4a75ad8387c65b79ba3a&scope.project.id=b028ff2c5aa54499a9cd429125c28fc7&role.id=5c07cf5bfbd3427db18428aa50420962 => generated 260 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:07:16.164537 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af056d0-22ff-46e2-8fd5-37ef70f7b8d4 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:16.191566 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5aecefd-fbdb-4caa-856b-f978c6287f81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:16.193280 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aecefd-fbdb-4caa-856b-f978c6287f81 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:16.193759 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aecefd-fbdb-4caa-856b-f978c6287f81 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:16.194220 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aecefd-fbdb-4caa-856b-f978c6287f81 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:16.205680 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5aecefd-fbdb-4caa-856b-f978c6287f81 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:07:16.215071 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application [None req-b5aecefd-fbdb-4caa-856b-f978c6287f81 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 19:07:16.215071 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:07:16.215071 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:07:16.215071 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:07:16.215071 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:07:16.215071 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:07:16.215071 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:07:16.215071 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:07:16.215071 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:07:16.215071 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:07:16.215071 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:07:16.215071 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:07:16.215071 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:07:16.215071 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:07:16.215071 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:07:16.215071 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:07:16.216076 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:07:16.216076 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:07:16.216076 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:07:16.216076 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:07:16.216076 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:07:16.216076 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:07:16.216076 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:07:16.216076 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:07:16.216076 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:07:16.216076 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:07:16.216076 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:07:16.216076 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application with Lock( May 10 19:07:16.216076 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:07:16.216076 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._enter() May 10 19:07:16.216076 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:07:16.216076 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:07:16.216945 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:07:16.216945 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.creator() May 10 19:07:16.216945 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:07:16.216945 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application created_value = creator( May 10 19:07:16.216945 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:07:16.216945 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:07:16.216945 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:07:16.216945 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:07:16.216945 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:07:16.216945 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:07:16.216945 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 19:07:16.216945 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application May 10 19:07:16.219837 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 177/352] 10.222.0.70 () {56 vars in 1099 bytes} [Tue May 10 19:07:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:07:16.220880 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5aecefd-fbdb-4caa-856b-f978c6287f81 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:16.272521 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af056d0-22ff-46e2-8fd5-37ef70f7b8d4 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:16.307570 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c923ea74-a260-4b61-a3fc-692febf49559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:16.308381 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c923ea74-a260-4b61-a3fc-692febf49559 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:16.308785 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c923ea74-a260-4b61-a3fc-692febf49559 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:16.309131 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c923ea74-a260-4b61-a3fc-692febf49559 None admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:16.309947 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c923ea74-a260-4b61-a3fc-692febf49559 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:07:16.310332 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c923ea74-a260-4b61-a3fc-692febf49559 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:16.311782 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c923ea74-a260-4b61-a3fc-692febf49559 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:16.320863 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 176/353] 10.222.0.70 () {56 vars in 1101 bytes} [Tue May 10 19:07:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:07:16.321809 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c923ea74-a260-4b61-a3fc-692febf49559 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:16.327215 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5aecefd-fbdb-4caa-856b-f978c6287f81 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:16.366411 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850533ea-b2f7-466f-a4cb-bf914e308a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:16.367464 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850533ea-b2f7-466f-a4cb-bf914e308a2b None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:16.367996 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850533ea-b2f7-466f-a4cb-bf914e308a2b None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:16.368489 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850533ea-b2f7-466f-a4cb-bf914e308a2b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:16.439608 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c923ea74-a260-4b61-a3fc-692febf49559 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:16.445189 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850533ea-b2f7-466f-a4cb-bf914e308a2b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:16.446965 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850533ea-b2f7-466f-a4cb-bf914e308a2b None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:16.478787 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9d18cb-91f5-4dba-9ac1-a0fe06837dad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:16.479354 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9d18cb-91f5-4dba-9ac1-a0fe06837dad None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:16.479617 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9d18cb-91f5-4dba-9ac1-a0fe06837dad None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:16.479822 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9d18cb-91f5-4dba-9ac1-a0fe06837dad None admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:16.480638 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9d18cb-91f5-4dba-9ac1-a0fe06837dad None admin] RBAC: Adding query filter params (name=member) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:07:16.480909 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9d18cb-91f5-4dba-9ac1-a0fe06837dad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:16.482312 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9d18cb-91f5-4dba-9ac1-a0fe06837dad None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:16.491503 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 177/354] 10.222.0.70 () {56 vars in 1101 bytes} [Tue May 10 19:07:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:07:16.492406 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9d18cb-91f5-4dba-9ac1-a0fe06837dad None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:16.551662 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 178/355] 10.222.0.70 () {58 vars in 1282 bytes} [Tue May 10 19:07:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 19:07:16.553362 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850533ea-b2f7-466f-a4cb-bf914e308a2b None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:16.596927 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9d18cb-91f5-4dba-9ac1-a0fe06837dad None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:16.636938 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0529e263-9a43-4669-ad6d-ea4a0cdc767f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:16.637829 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0529e263-9a43-4669-ad6d-ea4a0cdc767f None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:16.638107 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0529e263-9a43-4669-ad6d-ea4a0cdc767f None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:16.638376 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0529e263-9a43-4669-ad6d-ea4a0cdc767f None admin] PATH_INFO: `/v3/users/1ba02b1150eb40f0a5fa6bc327009143` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:16.639698 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0529e263-9a43-4669-ad6d-ea4a0cdc767f None admin] RBAC: Authorizing `identity:get_user(user_id=1ba02b1150eb40f0a5fa6bc327009143)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:16.641171 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0529e263-9a43-4669-ad6d-ea4a0cdc767f None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:16.647977 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 178/356] 10.222.0.70 () {56 vars in 1177 bytes} [Tue May 10 19:07:16 2022] GET /identity/v3/users/1ba02b1150eb40f0a5fa6bc327009143 => generated 293 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:07:16.647977 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0529e263-9a43-4669-ad6d-ea4a0cdc767f None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:16.669220 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850533ea-b2f7-466f-a4cb-bf914e308a2b None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:16.715436 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bad6623-f36c-4fa7-bc9d-baa14a11eb78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:16.716439 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bad6623-f36c-4fa7-bc9d-baa14a11eb78 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:16.716920 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bad6623-f36c-4fa7-bc9d-baa14a11eb78 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:16.717540 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bad6623-f36c-4fa7-bc9d-baa14a11eb78 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:16.755801 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0529e263-9a43-4669-ad6d-ea4a0cdc767f None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:16.792393 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c28ea3f-0ddb-4ea1-9ad2-476f071db9fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:16.793312 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c28ea3f-0ddb-4ea1-9ad2-476f071db9fe None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:16.793597 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c28ea3f-0ddb-4ea1-9ad2-476f071db9fe None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:16.793912 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c28ea3f-0ddb-4ea1-9ad2-476f071db9fe None admin] PATH_INFO: `/v3/projects/b028ff2c5aa54499a9cd429125c28fc7` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:16.795114 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c28ea3f-0ddb-4ea1-9ad2-476f071db9fe None admin] RBAC: Authorizing `identity:get_project(project_id=b028ff2c5aa54499a9cd429125c28fc7)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:16.796625 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c28ea3f-0ddb-4ea1-9ad2-476f071db9fe None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:16.798482 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 179/357] 10.222.0.70 () {56 vars in 1186 bytes} [Tue May 10 19:07:16 2022] GET /identity/v3/projects/b028ff2c5aa54499a9cd429125c28fc7 => generated 298 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:07:16.799480 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbfb7b8-3e03-4636-8a1f-f0526842e4ef None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:16.799784 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbfb7b8-3e03-4636-8a1f-f0526842e4ef None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:16.800066 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbfb7b8-3e03-4636-8a1f-f0526842e4ef None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:16.801737 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 180/358] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:07:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:07:16.802389 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbfb7b8-3e03-4636-8a1f-f0526842e4ef None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:16.804434 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bad6623-f36c-4fa7-bc9d-baa14a11eb78 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:16.806119 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bad6623-f36c-4fa7-bc9d-baa14a11eb78 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:16.922213 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 179/359] 10.222.0.70 () {58 vars in 1282 bytes} [Tue May 10 19:07:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 19:07:16.923065 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bad6623-f36c-4fa7-bc9d-baa14a11eb78 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:16.931875 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbfb7b8-3e03-4636-8a1f-f0526842e4ef None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:16.978855 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcaea9e-4b21-43a3-a86d-f608b9338dfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:16.980088 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcaea9e-4b21-43a3-a86d-f608b9338dfd None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:16.980600 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcaea9e-4b21-43a3-a86d-f608b9338dfd None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:16.981206 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcaea9e-4b21-43a3-a86d-f608b9338dfd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:16.982534 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcaea9e-4b21-43a3-a86d-f608b9338dfd None admin] RBAC: Adding query filter params (role.id=93fda71e71a04ccb862ff5177646d5b5, user.id=1ba02b1150eb40f0a5fa6bc327009143, scope.system=all) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:07:16.983039 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcaea9e-4b21-43a3-a86d-f608b9338dfd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:16.985113 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcaea9e-4b21-43a3-a86d-f608b9338dfd None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:17.004940 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 181/360] 10.222.0.70 () {56 vars in 1308 bytes} [Tue May 10 19:07:16 2022] GET /identity/v3/role_assignments?user.id=1ba02b1150eb40f0a5fa6bc327009143&scope.system=all&role.id=93fda71e71a04ccb862ff5177646d5b5 => generated 510 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:07:17.007650 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79174d36-e0dd-4267-8159-a5f68d6d406b None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:17.007650 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79174d36-e0dd-4267-8159-a5f68d6d406b None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:17.007857 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79174d36-e0dd-4267-8159-a5f68d6d406b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:17.037248 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-79174d36-e0dd-4267-8159-a5f68d6d406b None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:07:17.038488 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-79174d36-e0dd-4267-8159-a5f68d6d406b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:07:17.062087 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bad6623-f36c-4fa7-bc9d-baa14a11eb78 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:17.120797 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41972fd-4e36-42ca-bfb9-a28fcdc0a558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:17.121678 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41972fd-4e36-42ca-bfb9-a28fcdc0a558 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:17.121961 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41972fd-4e36-42ca-bfb9-a28fcdc0a558 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:17.123371 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41972fd-4e36-42ca-bfb9-a28fcdc0a558 None admin] PATH_INFO: `/v3/groups/4a0804b8bd3d4a75ad8387c65b79ba3a` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:17.125014 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41972fd-4e36-42ca-bfb9-a28fcdc0a558 None admin] RBAC: Authorizing `identity:get_group(group_id=4a0804b8bd3d4a75ad8387c65b79ba3a)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:17.126697 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41972fd-4e36-42ca-bfb9-a28fcdc0a558 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:17.130198 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 180/361] 10.222.0.70 () {56 vars in 1180 bytes} [Tue May 10 19:07:16 2022] GET /identity/v3/groups/4a0804b8bd3d4a75ad8387c65b79ba3a => generated 226 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:07:17.134024 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41972fd-4e36-42ca-bfb9-a28fcdc0a558 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:17.157028 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 182/362] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:07:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 19:07:17.158683 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881783e3-f92b-495d-9cb3-fe0db956f7ef None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:17.158970 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881783e3-f92b-495d-9cb3-fe0db956f7ef None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:17.159243 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881783e3-f92b-495d-9cb3-fe0db956f7ef None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:17.161492 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 183/363] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:07:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:07:17.162430 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881783e3-f92b-495d-9cb3-fe0db956f7ef None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:17.282274 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41972fd-4e36-42ca-bfb9-a28fcdc0a558 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:17.283814 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881783e3-f92b-495d-9cb3-fe0db956f7ef None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:17.326004 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a55e12-95e8-44f9-9398-e1ecf9438cc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:17.327401 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a55e12-95e8-44f9-9398-e1ecf9438cc8 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:17.327936 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a55e12-95e8-44f9-9398-e1ecf9438cc8 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:17.328511 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a55e12-95e8-44f9-9398-e1ecf9438cc8 None admin] PATH_INFO: `/v3/projects/e0df39feccc3439b965b22d514a229be` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:17.329955 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72943556-ee9e-4771-979b-c50cd4c01bde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:17.330212 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a55e12-95e8-44f9-9398-e1ecf9438cc8 None admin] RBAC: Authorizing `identity:get_project(project_id=e0df39feccc3439b965b22d514a229be)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:17.330788 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72943556-ee9e-4771-979b-c50cd4c01bde None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:17.331144 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72943556-ee9e-4771-979b-c50cd4c01bde None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:17.331565 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72943556-ee9e-4771-979b-c50cd4c01bde None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:17.332285 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a55e12-95e8-44f9-9398-e1ecf9438cc8 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:17.332861 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72943556-ee9e-4771-979b-c50cd4c01bde None admin] RBAC: Adding query filter params (group.id=4a0804b8bd3d4a75ad8387c65b79ba3a, role.id=49187695e1bf4c15980bb68c83ca61de, scope.project.id=b028ff2c5aa54499a9cd429125c28fc7) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:07:17.333281 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72943556-ee9e-4771-979b-c50cd4c01bde None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:17.334814 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 181/364] 10.222.0.70 () {56 vars in 1186 bytes} [Tue May 10 19:07:17 2022] GET /identity/v3/projects/e0df39feccc3439b965b22d514a229be => generated 302 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:07:17.334930 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72943556-ee9e-4771-979b-c50cd4c01bde None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:17.340785 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa66bfd-1678-496e-8584-8306612c5577 None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:17.341298 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa66bfd-1678-496e-8584-8306612c5577 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:17.341476 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 184/365] 10.222.0.70 () {56 vars in 1376 bytes} [Tue May 10 19:07:17 2022] GET /identity/v3/role_assignments?group.id=4a0804b8bd3d4a75ad8387c65b79ba3a&scope.project.id=b028ff2c5aa54499a9cd429125c28fc7&role.id=49187695e1bf4c15980bb68c83ca61de => generated 260 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:07:17.341872 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa66bfd-1678-496e-8584-8306612c5577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:17.342448 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72943556-ee9e-4771-979b-c50cd4c01bde None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:17.369995 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-caa66bfd-1678-496e-8584-8306612c5577 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:07:17.371309 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-caa66bfd-1678-496e-8584-8306612c5577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:07:17.465744 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 182/366] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:07:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 19:07:17.466944 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa66bfd-1678-496e-8584-8306612c5577 None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:17.467971 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72943556-ee9e-4771-979b-c50cd4c01bde None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:17.530267 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e943d949-ebf7-4abf-aaa2-013e34dc50f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:17.531277 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e943d949-ebf7-4abf-aaa2-013e34dc50f3 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:17.531634 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e943d949-ebf7-4abf-aaa2-013e34dc50f3 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:17.531985 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e943d949-ebf7-4abf-aaa2-013e34dc50f3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:17.543512 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e943d949-ebf7-4abf-aaa2-013e34dc50f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:07:17.552722 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-e943d949-ebf7-4abf-aaa2-013e34dc50f3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 19:07:17.552722 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:07:17.552722 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:07:17.552722 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:07:17.552722 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:07:17.552722 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:07:17.552722 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:07:17.552722 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:07:17.552722 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:07:17.552722 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:07:17.552722 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:07:17.552722 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:07:17.552722 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:07:17.552722 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:07:17.552722 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:07:17.552722 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:07:17.553908 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:07:17.553908 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:07:17.553908 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:07:17.553908 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:07:17.553908 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:07:17.553908 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:07:17.553908 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:07:17.553908 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:07:17.553908 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:07:17.553908 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:07:17.553908 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:07:17.553908 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( May 10 19:07:17.553908 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:07:17.553908 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() May 10 19:07:17.553908 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:07:17.553908 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:07:17.554942 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:07:17.554942 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() May 10 19:07:17.554942 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:07:17.554942 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( May 10 19:07:17.554942 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:07:17.554942 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:07:17.554942 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:07:17.554942 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:07:17.554942 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:07:17.554942 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:07:17.554942 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 19:07:17.554942 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:07:17.556828 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 185/367] 10.222.0.70 () {56 vars in 1114 bytes} [Tue May 10 19:07:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:07:17.557155 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e943d949-ebf7-4abf-aaa2-013e34dc50f3 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:17.611238 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa66bfd-1678-496e-8584-8306612c5577 None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:17.651246 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d5b158-278f-4075-9c5f-c7afb4eb1ce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:17.652580 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d5b158-278f-4075-9c5f-c7afb4eb1ce4 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:17.653095 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d5b158-278f-4075-9c5f-c7afb4eb1ce4 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:17.653586 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d5b158-278f-4075-9c5f-c7afb4eb1ce4 None admin] PATH_INFO: `/v3/groups/4a0804b8bd3d4a75ad8387c65b79ba3a` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:17.655122 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d5b158-278f-4075-9c5f-c7afb4eb1ce4 None admin] RBAC: Authorizing `identity:get_group(group_id=4a0804b8bd3d4a75ad8387c65b79ba3a)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:17.656896 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d5b158-278f-4075-9c5f-c7afb4eb1ce4 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:17.659096 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 183/368] 10.222.0.70 () {56 vars in 1180 bytes} [Tue May 10 19:07:17 2022] GET /identity/v3/groups/4a0804b8bd3d4a75ad8387c65b79ba3a => generated 226 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:07:17.660193 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d5b158-278f-4075-9c5f-c7afb4eb1ce4 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:17.693058 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e943d949-ebf7-4abf-aaa2-013e34dc50f3 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:17.734916 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b572bc8a-c90a-45b6-94bf-ded81bcf95eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:17.736071 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b572bc8a-c90a-45b6-94bf-ded81bcf95eb None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:17.736598 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b572bc8a-c90a-45b6-94bf-ded81bcf95eb None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:17.737089 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b572bc8a-c90a-45b6-94bf-ded81bcf95eb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:17.747612 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b572bc8a-c90a-45b6-94bf-ded81bcf95eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:07:17.756403 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-b572bc8a-c90a-45b6-94bf-ded81bcf95eb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 19:07:17.756403 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:07:17.756403 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:07:17.756403 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:07:17.756403 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:07:17.756403 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:07:17.756403 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:07:17.756403 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:07:17.756403 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:07:17.756403 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:07:17.756403 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:07:17.756403 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:07:17.756403 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:07:17.756403 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:07:17.756403 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:07:17.756403 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:07:17.758166 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:07:17.758166 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:07:17.758166 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:07:17.758166 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:07:17.758166 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:07:17.758166 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:07:17.758166 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:07:17.758166 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:07:17.758166 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:07:17.758166 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:07:17.758166 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:07:17.758166 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( May 10 19:07:17.758166 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:07:17.758166 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() May 10 19:07:17.758166 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:07:17.758166 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:07:17.758978 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:07:17.758978 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() May 10 19:07:17.758978 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:07:17.758978 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( May 10 19:07:17.758978 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:07:17.758978 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:07:17.758978 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:07:17.758978 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:07:17.758978 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:07:17.758978 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:07:17.758978 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 19:07:17.758978 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:07:17.761911 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 186/369] 10.222.0.70 () {56 vars in 1096 bytes} [Tue May 10 19:07:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:07:17.762940 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b572bc8a-c90a-45b6-94bf-ded81bcf95eb None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:17.777454 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d5b158-278f-4075-9c5f-c7afb4eb1ce4 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:17.817414 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb72ad0-5881-4a1b-823b-996ef52a079c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:17.818520 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb72ad0-5881-4a1b-823b-996ef52a079c None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:17.819004 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb72ad0-5881-4a1b-823b-996ef52a079c None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:17.819485 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb72ad0-5881-4a1b-823b-996ef52a079c None admin] PATH_INFO: `/v3/roles` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:17.821246 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb72ad0-5881-4a1b-823b-996ef52a079c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:07:17.821771 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb72ad0-5881-4a1b-823b-996ef52a079c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:17.823509 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb72ad0-5881-4a1b-823b-996ef52a079c None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:17.832267 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 184/370] 10.222.0.70 () {56 vars in 1111 bytes} [Tue May 10 19:07:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:07:17.833719 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb72ad0-5881-4a1b-823b-996ef52a079c None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:17.884898 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b572bc8a-c90a-45b6-94bf-ded81bcf95eb None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:17.918548 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c2a62d-87fb-4c8f-a8bc-70690d017fa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:17.919213 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c2a62d-87fb-4c8f-a8bc-70690d017fa6 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:17.919500 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c2a62d-87fb-4c8f-a8bc-70690d017fa6 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:17.919778 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c2a62d-87fb-4c8f-a8bc-70690d017fa6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:17.920641 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c2a62d-87fb-4c8f-a8bc-70690d017fa6 None admin] RBAC: Adding query filter params (group.id=4a0804b8bd3d4a75ad8387c65b79ba3a, role.id=5c07cf5bfbd3427db18428aa50420962, scope.project.id=e0df39feccc3439b965b22d514a229be) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:07:17.920957 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c2a62d-87fb-4c8f-a8bc-70690d017fa6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:17.922404 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c2a62d-87fb-4c8f-a8bc-70690d017fa6 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:17.928443 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 187/371] 10.222.0.70 () {56 vars in 1376 bytes} [Tue May 10 19:07:17 2022] GET /identity/v3/role_assignments?group.id=4a0804b8bd3d4a75ad8387c65b79ba3a&scope.project.id=e0df39feccc3439b965b22d514a229be&role.id=5c07cf5bfbd3427db18428aa50420962 => generated 260 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:07:17.929179 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c2a62d-87fb-4c8f-a8bc-70690d017fa6 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:17.939040 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb72ad0-5881-4a1b-823b-996ef52a079c None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:17.978998 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36348bd5-983a-4531-890d-715e84eeeca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:17.980068 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36348bd5-983a-4531-890d-715e84eeeca1 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:17.980652 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36348bd5-983a-4531-890d-715e84eeeca1 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:17.981141 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36348bd5-983a-4531-890d-715e84eeeca1 None admin] PATH_INFO: `/v3/roles` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:17.982134 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36348bd5-983a-4531-890d-715e84eeeca1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:07:17.982693 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36348bd5-983a-4531-890d-715e84eeeca1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:17.984307 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36348bd5-983a-4531-890d-715e84eeeca1 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:17.993808 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 185/372] 10.222.0.70 () {56 vars in 1099 bytes} [Tue May 10 19:07:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:07:17.999805 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36348bd5-983a-4531-890d-715e84eeeca1 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:18.036750 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c2a62d-87fb-4c8f-a8bc-70690d017fa6 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:18.070746 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac94ed0a-6768-401a-8c66-0fc2584bf70f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:18.071426 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac94ed0a-6768-401a-8c66-0fc2584bf70f None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:18.071697 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac94ed0a-6768-401a-8c66-0fc2584bf70f None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:18.072049 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac94ed0a-6768-401a-8c66-0fc2584bf70f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:18.109552 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36348bd5-983a-4531-890d-715e84eeeca1 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:18.142041 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac94ed0a-6768-401a-8c66-0fc2584bf70f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:18.143443 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac94ed0a-6768-401a-8c66-0fc2584bf70f None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:18.145529 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ef16ba-9909-40a6-aa72-80da641fc6e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:18.146455 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ef16ba-9909-40a6-aa72-80da641fc6e9 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:18.146937 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ef16ba-9909-40a6-aa72-80da641fc6e9 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:18.147431 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ef16ba-9909-40a6-aa72-80da641fc6e9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:18.218401 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ef16ba-9909-40a6-aa72-80da641fc6e9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:18.220266 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ef16ba-9909-40a6-aa72-80da641fc6e9 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:18.248722 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 188/373] 10.222.0.70 () {58 vars in 1282 bytes} [Tue May 10 19:07:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 19:07:18.254264 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac94ed0a-6768-401a-8c66-0fc2584bf70f None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:18.328478 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 186/374] 10.222.0.70 () {58 vars in 1282 bytes} [Tue May 10 19:07:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 10 19:07:18.330252 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ef16ba-9909-40a6-aa72-80da641fc6e9 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:18.360654 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac94ed0a-6768-401a-8c66-0fc2584bf70f None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:18.398460 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7983f767-8187-4784-9282-99c85e35398c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:18.399256 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7983f767-8187-4784-9282-99c85e35398c None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:18.399540 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7983f767-8187-4784-9282-99c85e35398c None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:18.399816 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7983f767-8187-4784-9282-99c85e35398c None admin] PATH_INFO: `/v3/projects/e0df39feccc3439b965b22d514a229be` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:18.401269 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7983f767-8187-4784-9282-99c85e35398c None admin] RBAC: Authorizing `identity:get_project(project_id=e0df39feccc3439b965b22d514a229be)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:18.402536 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7983f767-8187-4784-9282-99c85e35398c None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:18.408560 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 189/375] 10.222.0.70 () {56 vars in 1186 bytes} [Tue May 10 19:07:18 2022] GET /identity/v3/projects/e0df39feccc3439b965b22d514a229be => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:07:18.410119 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7983f767-8187-4784-9282-99c85e35398c None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:18.435647 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ef16ba-9909-40a6-aa72-80da641fc6e9 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:18.471990 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847ab963-6050-4555-85dd-b3c500427b46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:18.473745 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847ab963-6050-4555-85dd-b3c500427b46 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:18.474244 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847ab963-6050-4555-85dd-b3c500427b46 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:18.474712 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847ab963-6050-4555-85dd-b3c500427b46 None admin] PATH_INFO: `/v3/projects/a7c5828bc7be44a6adb3e9898a8f18d8` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:18.476124 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847ab963-6050-4555-85dd-b3c500427b46 None admin] RBAC: Authorizing `identity:get_project(project_id=a7c5828bc7be44a6adb3e9898a8f18d8)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:18.477798 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847ab963-6050-4555-85dd-b3c500427b46 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:18.480008 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 187/376] 10.222.0.70 () {56 vars in 1186 bytes} [Tue May 10 19:07:18 2022] GET /identity/v3/projects/a7c5828bc7be44a6adb3e9898a8f18d8 => generated 344 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:07:18.485444 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847ab963-6050-4555-85dd-b3c500427b46 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:18.511057 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7983f767-8187-4784-9282-99c85e35398c None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:18.545435 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e913d3-b167-4e22-a89b-45856a7c11cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:18.546301 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e913d3-b167-4e22-a89b-45856a7c11cc None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:18.546583 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e913d3-b167-4e22-a89b-45856a7c11cc None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:18.546855 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e913d3-b167-4e22-a89b-45856a7c11cc None admin] PATH_INFO: `/v3/groups/4a0804b8bd3d4a75ad8387c65b79ba3a` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:18.548205 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e913d3-b167-4e22-a89b-45856a7c11cc None admin] RBAC: Authorizing `identity:get_group(group_id=4a0804b8bd3d4a75ad8387c65b79ba3a)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:18.549702 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e913d3-b167-4e22-a89b-45856a7c11cc None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:18.556217 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 190/377] 10.222.0.70 () {56 vars in 1180 bytes} [Tue May 10 19:07:18 2022] GET /identity/v3/groups/4a0804b8bd3d4a75ad8387c65b79ba3a => generated 226 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:07:18.558245 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e913d3-b167-4e22-a89b-45856a7c11cc None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:18.589898 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847ab963-6050-4555-85dd-b3c500427b46 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:18.624785 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91287b7-92ce-434e-b439-25a75683f28c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:18.626456 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91287b7-92ce-434e-b439-25a75683f28c None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:18.626940 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91287b7-92ce-434e-b439-25a75683f28c None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:18.627426 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91287b7-92ce-434e-b439-25a75683f28c None admin] PATH_INFO: `/v3/groups/754974433ea84f44829671eb58fe3a9c` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:18.634415 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91287b7-92ce-434e-b439-25a75683f28c None admin] RBAC: Authorizing `identity:get_group(group_id=754974433ea84f44829671eb58fe3a9c)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:18.636106 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91287b7-92ce-434e-b439-25a75683f28c None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:18.638336 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 188/378] 10.222.0.70 () {56 vars in 1180 bytes} [Tue May 10 19:07:18 2022] GET /identity/v3/groups/754974433ea84f44829671eb58fe3a9c => generated 229 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:07:18.644133 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91287b7-92ce-434e-b439-25a75683f28c None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:18.658473 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e913d3-b167-4e22-a89b-45856a7c11cc None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:18.695190 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b976e0ea-ee95-40d4-a3a3-3b94026734c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:18.695852 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b976e0ea-ee95-40d4-a3a3-3b94026734c7 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:18.696132 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b976e0ea-ee95-40d4-a3a3-3b94026734c7 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:18.696404 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b976e0ea-ee95-40d4-a3a3-3b94026734c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:18.697265 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b976e0ea-ee95-40d4-a3a3-3b94026734c7 None admin] RBAC: Adding query filter params (group.id=4a0804b8bd3d4a75ad8387c65b79ba3a, role.id=49187695e1bf4c15980bb68c83ca61de, scope.project.id=e0df39feccc3439b965b22d514a229be) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:07:18.697760 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b976e0ea-ee95-40d4-a3a3-3b94026734c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:18.699524 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b976e0ea-ee95-40d4-a3a3-3b94026734c7 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:18.712567 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 191/379] 10.222.0.70 () {56 vars in 1376 bytes} [Tue May 10 19:07:18 2022] GET /identity/v3/role_assignments?group.id=4a0804b8bd3d4a75ad8387c65b79ba3a&scope.project.id=e0df39feccc3439b965b22d514a229be&role.id=49187695e1bf4c15980bb68c83ca61de => generated 260 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:07:18.759133 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91287b7-92ce-434e-b439-25a75683f28c None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:18.798501 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4925bd29-1775-47d9-aa6f-c2ea30242b53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:18.799611 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4925bd29-1775-47d9-aa6f-c2ea30242b53 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:18.800188 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4925bd29-1775-47d9-aa6f-c2ea30242b53 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:18.800687 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4925bd29-1775-47d9-aa6f-c2ea30242b53 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:18.802364 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4925bd29-1775-47d9-aa6f-c2ea30242b53 None admin] RBAC: Adding query filter params (group.id=754974433ea84f44829671eb58fe3a9c, role.id=634ba284303b4626b5a0402772c68f5c, scope.project.id=a7c5828bc7be44a6adb3e9898a8f18d8) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:07:18.802905 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4925bd29-1775-47d9-aa6f-c2ea30242b53 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:18.804700 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4925bd29-1775-47d9-aa6f-c2ea30242b53 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:18.811810 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 189/380] 10.222.0.70 () {56 vars in 1376 bytes} [Tue May 10 19:07:18 2022] GET /identity/v3/role_assignments?group.id=754974433ea84f44829671eb58fe3a9c&scope.project.id=a7c5828bc7be44a6adb3e9898a8f18d8&role.id=634ba284303b4626b5a0402772c68f5c => generated 260 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:07:19.013996 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d47435-8bc8-42e8-9bea-28f98af4ad00 None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:19.014325 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d47435-8bc8-42e8-9bea-28f98af4ad00 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:19.014554 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d47435-8bc8-42e8-9bea-28f98af4ad00 None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:19.016181 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 192/381] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:07:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:07:19.022132 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959bdb1e-5784-44ac-802a-7d7765885445 None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:19.022423 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959bdb1e-5784-44ac-802a-7d7765885445 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:19.022698 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959bdb1e-5784-44ac-802a-7d7765885445 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:19.045962 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-959bdb1e-5784-44ac-802a-7d7765885445 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:07:19.047146 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-959bdb1e-5784-44ac-802a-7d7765885445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:07:19.135026 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 190/382] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:07:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 19:07:19.168552 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d47435-8bc8-42e8-9bea-28f98af4ad00 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:19.314168 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d47435-8bc8-42e8-9bea-28f98af4ad00 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:19.359871 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6567c79-fcdc-4e42-bbc5-1c77a851223c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:19.360701 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6567c79-fcdc-4e42-bbc5-1c77a851223c None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:19.360985 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6567c79-fcdc-4e42-bbc5-1c77a851223c None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:19.361261 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6567c79-fcdc-4e42-bbc5-1c77a851223c None admin] PATH_INFO: `/v3/roles/member` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:19.377581 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6567c79-fcdc-4e42-bbc5-1c77a851223c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:07:19.385869 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-c6567c79-fcdc-4e42-bbc5-1c77a851223c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 19:07:19.385869 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:07:19.385869 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:07:19.385869 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:07:19.385869 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:07:19.385869 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:07:19.385869 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:07:19.385869 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:07:19.385869 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:07:19.385869 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:07:19.385869 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:07:19.385869 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:07:19.385869 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:07:19.385869 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:07:19.385869 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:07:19.385869 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:07:19.386791 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:07:19.386791 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:07:19.386791 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:07:19.386791 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:07:19.386791 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:07:19.386791 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:07:19.386791 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:07:19.386791 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:07:19.386791 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:07:19.386791 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:07:19.386791 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:07:19.386791 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( May 10 19:07:19.386791 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:07:19.386791 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() May 10 19:07:19.386791 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:07:19.386791 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:07:19.387583 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:07:19.387583 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() May 10 19:07:19.387583 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:07:19.387583 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( May 10 19:07:19.387583 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:07:19.387583 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:07:19.387583 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:07:19.387583 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:07:19.387583 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:07:19.387583 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:07:19.387583 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 19:07:19.387583 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:07:19.387583 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 193/383] 10.222.0.70 () {56 vars in 1099 bytes} [Tue May 10 19:07:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:07:19.394511 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959bdb1e-5784-44ac-802a-7d7765885445 None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:19.521462 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959bdb1e-5784-44ac-802a-7d7765885445 None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:19.555570 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5bd872-54d1-4013-82b7-23a0549cc683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:19.556241 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5bd872-54d1-4013-82b7-23a0549cc683 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:19.556562 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5bd872-54d1-4013-82b7-23a0549cc683 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:19.556837 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5bd872-54d1-4013-82b7-23a0549cc683 None admin] PATH_INFO: `/v3/roles` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:19.557580 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5bd872-54d1-4013-82b7-23a0549cc683 None admin] RBAC: Adding query filter params (name=member) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:07:19.557881 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5bd872-54d1-4013-82b7-23a0549cc683 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:19.559259 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5bd872-54d1-4013-82b7-23a0549cc683 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:19.571845 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 191/384] 10.222.0.70 () {56 vars in 1101 bytes} [Tue May 10 19:07:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:07:19.577378 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6567c79-fcdc-4e42-bbc5-1c77a851223c None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:19.717359 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6567c79-fcdc-4e42-bbc5-1c77a851223c None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:19.754597 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218f5399-410b-4803-b902-2532c0c6d858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:19.755514 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218f5399-410b-4803-b902-2532c0c6d858 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:19.755845 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218f5399-410b-4803-b902-2532c0c6d858 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:19.756125 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218f5399-410b-4803-b902-2532c0c6d858 None admin] PATH_INFO: `/v3/groups/4a0804b8bd3d4a75ad8387c65b79ba3a` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:19.757342 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218f5399-410b-4803-b902-2532c0c6d858 None admin] RBAC: Authorizing `identity:get_group(group_id=4a0804b8bd3d4a75ad8387c65b79ba3a)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:19.758795 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218f5399-410b-4803-b902-2532c0c6d858 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:19.761558 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 194/385] 10.222.0.70 () {56 vars in 1180 bytes} [Tue May 10 19:07:19 2022] GET /identity/v3/groups/4a0804b8bd3d4a75ad8387c65b79ba3a => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:07:19.766831 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5bd872-54d1-4013-82b7-23a0549cc683 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:19.874842 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5bd872-54d1-4013-82b7-23a0549cc683 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:19.908623 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628f14fd-a87b-45e8-9237-98ec8bbc3db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:19.909731 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628f14fd-a87b-45e8-9237-98ec8bbc3db0 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:19.910176 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628f14fd-a87b-45e8-9237-98ec8bbc3db0 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:19.910659 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628f14fd-a87b-45e8-9237-98ec8bbc3db0 None admin] PATH_INFO: `/v3/projects/b028ff2c5aa54499a9cd429125c28fc7` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:19.912001 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628f14fd-a87b-45e8-9237-98ec8bbc3db0 None admin] RBAC: Authorizing `identity:get_project(project_id=b028ff2c5aa54499a9cd429125c28fc7)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:19.913607 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628f14fd-a87b-45e8-9237-98ec8bbc3db0 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:19.915730 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 192/386] 10.222.0.70 () {56 vars in 1186 bytes} [Tue May 10 19:07:19 2022] GET /identity/v3/projects/b028ff2c5aa54499a9cd429125c28fc7 => generated 298 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:07:19.921580 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218f5399-410b-4803-b902-2532c0c6d858 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:20.037215 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218f5399-410b-4803-b902-2532c0c6d858 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:20.075819 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c10cca-7f80-4504-8075-e9f7b30878ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:20.076759 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c10cca-7f80-4504-8075-e9f7b30878ed None admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:20.077043 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c10cca-7f80-4504-8075-e9f7b30878ed None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:20.077366 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c10cca-7f80-4504-8075-e9f7b30878ed None admin] PATH_INFO: `/v3/projects/b028ff2c5aa54499a9cd429125c28fc7/groups/4a0804b8bd3d4a75ad8387c65b79ba3a/roles/5c07cf5bfbd3427db18428aa50420962` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:20.079358 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c10cca-7f80-4504-8075-e9f7b30878ed None admin] RBAC: Authorizing `identity:create_grant(project_id=b028ff2c5aa54499a9cd429125c28fc7, group_id=4a0804b8bd3d4a75ad8387c65b79ba3a, role_id=5c07cf5bfbd3427db18428aa50420962)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:20.080887 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c10cca-7f80-4504-8075-e9f7b30878ed None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:20.108285 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 195/387] 10.222.0.70 () {58 vars in 1442 bytes} [Tue May 10 19:07:19 2022] PUT /identity/v3/projects/b028ff2c5aa54499a9cd429125c28fc7/groups/4a0804b8bd3d4a75ad8387c65b79ba3a/roles/5c07cf5bfbd3427db18428aa50420962 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:07:20.562780 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc4cd6f-3578-4cf2-a600-cb4796923720 None None] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:20.563471 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc4cd6f-3578-4cf2-a600-cb4796923720 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:20.563948 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc4cd6f-3578-4cf2-a600-cb4796923720 None None] PATH_INFO: `/` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:20.565804 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 193/388] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:07:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:07:20.571504 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c910e2e0-72e8-426b-a684-cbb818e1df55 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:20.571798 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c910e2e0-72e8-426b-a684-cbb818e1df55 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:20.572081 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c910e2e0-72e8-426b-a684-cbb818e1df55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:20.593394 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-c910e2e0-72e8-426b-a684-cbb818e1df55 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:07:20.594631 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-c910e2e0-72e8-426b-a684-cbb818e1df55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:07:20.672541 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 196/389] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:07:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 19:07:20.705964 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc4cd6f-3578-4cf2-a600-cb4796923720 None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:20.815642 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc4cd6f-3578-4cf2-a600-cb4796923720 None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:20.855623 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823b5bc1-898e-4f9f-9089-ec55ef833ceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:20.856453 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823b5bc1-898e-4f9f-9089-ec55ef833ceb None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:20.856742 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823b5bc1-898e-4f9f-9089-ec55ef833ceb None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:20.857016 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823b5bc1-898e-4f9f-9089-ec55ef833ceb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:20.869198 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823b5bc1-898e-4f9f-9089-ec55ef833ceb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:07:20.877445 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application [None req-823b5bc1-898e-4f9f-9089-ec55ef833ceb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 19:07:20.877445 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:07:20.877445 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:07:20.877445 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:07:20.877445 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:07:20.877445 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:07:20.877445 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:07:20.877445 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:07:20.877445 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:07:20.877445 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:07:20.877445 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:07:20.877445 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:07:20.877445 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:07:20.877445 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:07:20.877445 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:07:20.877445 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:07:20.878342 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:07:20.878342 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:07:20.878342 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:07:20.878342 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:07:20.878342 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:07:20.878342 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:07:20.878342 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:07:20.878342 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:07:20.878342 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:07:20.878342 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:07:20.878342 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:07:20.878342 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application with Lock( May 10 19:07:20.878342 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:07:20.878342 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._enter() May 10 19:07:20.878342 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:07:20.878342 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:07:20.879668 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:07:20.879668 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.creator() May 10 19:07:20.879668 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:07:20.879668 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application created_value = creator( May 10 19:07:20.879668 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:07:20.879668 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:07:20.879668 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:07:20.879668 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:07:20.879668 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:07:20.879668 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:07:20.879668 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 19:07:20.879668 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application May 10 19:07:20.879668 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 194/390] 10.222.0.70 () {56 vars in 1114 bytes} [Tue May 10 19:07:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:07:20.885161 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c910e2e0-72e8-426b-a684-cbb818e1df55 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:21.001065 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c910e2e0-72e8-426b-a684-cbb818e1df55 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:21.039426 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5a2a84-cffe-4ae4-9ff1-157699c3b653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:21.040102 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5a2a84-cffe-4ae4-9ff1-157699c3b653 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:21.040386 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5a2a84-cffe-4ae4-9ff1-157699c3b653 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:21.040686 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5a2a84-cffe-4ae4-9ff1-157699c3b653 None admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:21.041431 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5a2a84-cffe-4ae4-9ff1-157699c3b653 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:07:21.041738 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5a2a84-cffe-4ae4-9ff1-157699c3b653 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:21.043116 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5a2a84-cffe-4ae4-9ff1-157699c3b653 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:21.051892 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 197/391] 10.222.0.70 () {56 vars in 1111 bytes} [Tue May 10 19:07:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:07:21.057481 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823b5bc1-898e-4f9f-9089-ec55ef833ceb None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:21.197795 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823b5bc1-898e-4f9f-9089-ec55ef833ceb None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:21.209538 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f95fe4c-b818-421d-bae2-c36cec54be0f None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:21.209838 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f95fe4c-b818-421d-bae2-c36cec54be0f None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:21.210093 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f95fe4c-b818-421d-bae2-c36cec54be0f None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:21.211728 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 198/392] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:07:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:07:21.217304 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf5b632-cade-4b13-9eac-f48f62d14447 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:21.217588 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf5b632-cade-4b13-9eac-f48f62d14447 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:21.217866 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf5b632-cade-4b13-9eac-f48f62d14447 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:21.235581 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2e6f57-8d81-462f-adb7-5d3aa3af9b2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:21.236460 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2e6f57-8d81-462f-adb7-5d3aa3af9b2f None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:21.236748 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2e6f57-8d81-462f-adb7-5d3aa3af9b2f None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:21.237023 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2e6f57-8d81-462f-adb7-5d3aa3af9b2f None admin] PATH_INFO: `/v3/groups/4a0804b8bd3d4a75ad8387c65b79ba3a` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:21.238188 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2e6f57-8d81-462f-adb7-5d3aa3af9b2f None admin] RBAC: Authorizing `identity:get_group(group_id=4a0804b8bd3d4a75ad8387c65b79ba3a)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:21.240173 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2e6f57-8d81-462f-adb7-5d3aa3af9b2f None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:21.242146 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 195/393] 10.222.0.70 () {56 vars in 1180 bytes} [Tue May 10 19:07:21 2022] GET /identity/v3/groups/4a0804b8bd3d4a75ad8387c65b79ba3a => generated 226 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:07:21.249329 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2e6f57-8d81-462f-adb7-5d3aa3af9b2f None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:21.253429 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-5cf5b632-cade-4b13-9eac-f48f62d14447 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:07:21.255224 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-5cf5b632-cade-4b13-9eac-f48f62d14447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:07:21.353230 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 199/394] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:07:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 19:07:21.379456 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf5b632-cade-4b13-9eac-f48f62d14447 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:21.392102 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2e6f57-8d81-462f-adb7-5d3aa3af9b2f None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:21.440471 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426df96b-7c18-4317-80c2-6004609ee76c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:21.440471 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426df96b-7c18-4317-80c2-6004609ee76c None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:21.440471 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426df96b-7c18-4317-80c2-6004609ee76c None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:21.440471 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426df96b-7c18-4317-80c2-6004609ee76c None admin] PATH_INFO: `/v3/projects/b028ff2c5aa54499a9cd429125c28fc7` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:21.440913 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426df96b-7c18-4317-80c2-6004609ee76c None admin] RBAC: Authorizing `identity:get_project(project_id=b028ff2c5aa54499a9cd429125c28fc7)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:21.440913 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426df96b-7c18-4317-80c2-6004609ee76c None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:21.442604 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 196/395] 10.222.0.70 () {56 vars in 1186 bytes} [Tue May 10 19:07:21 2022] GET /identity/v3/projects/b028ff2c5aa54499a9cd429125c28fc7 => generated 298 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:07:21.453609 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426df96b-7c18-4317-80c2-6004609ee76c None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:21.513471 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf5b632-cade-4b13-9eac-f48f62d14447 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:21.552021 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cfd59a-8335-409a-a6dd-1e0af18b0b2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:21.553211 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cfd59a-8335-409a-a6dd-1e0af18b0b2e None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:21.553715 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cfd59a-8335-409a-a6dd-1e0af18b0b2e None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:21.554210 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cfd59a-8335-409a-a6dd-1e0af18b0b2e None admin] PATH_INFO: `/v3/roles/member` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:21.566337 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cfd59a-8335-409a-a6dd-1e0af18b0b2e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:07:21.573828 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426df96b-7c18-4317-80c2-6004609ee76c None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:21.575720 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-c0cfd59a-8335-409a-a6dd-1e0af18b0b2e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 19:07:21.575720 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:07:21.575720 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:07:21.575720 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:07:21.575720 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:07:21.575720 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:07:21.575720 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:07:21.575720 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:07:21.575720 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:07:21.575720 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:07:21.575720 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:07:21.575720 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:07:21.575720 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:07:21.575720 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:07:21.575720 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:07:21.575720 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:07:21.576693 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:07:21.576693 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:07:21.576693 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:07:21.576693 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:07:21.576693 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:07:21.576693 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:07:21.576693 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:07:21.576693 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:07:21.576693 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:07:21.576693 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:07:21.576693 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:07:21.576693 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( May 10 19:07:21.576693 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:07:21.576693 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() May 10 19:07:21.576693 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:07:21.576693 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:07:21.577539 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:07:21.577539 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() May 10 19:07:21.577539 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:07:21.577539 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( May 10 19:07:21.577539 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:07:21.577539 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:07:21.577539 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:07:21.577539 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:07:21.577539 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:07:21.577539 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:07:21.577539 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 19:07:21.577539 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:07:21.580007 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 200/396] 10.222.0.70 () {56 vars in 1099 bytes} [Tue May 10 19:07:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:07:21.602828 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cfd59a-8335-409a-a6dd-1e0af18b0b2e None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:21.615882 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99bf90d-97c5-41d0-8d2f-0ca99c571a6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:21.616799 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99bf90d-97c5-41d0-8d2f-0ca99c571a6e None admin] REQUEST_METHOD: `PUT` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:21.617075 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99bf90d-97c5-41d0-8d2f-0ca99c571a6e None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:21.617343 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99bf90d-97c5-41d0-8d2f-0ca99c571a6e None admin] PATH_INFO: `/v3/projects/b028ff2c5aa54499a9cd429125c28fc7/groups/4a0804b8bd3d4a75ad8387c65b79ba3a/roles/49187695e1bf4c15980bb68c83ca61de` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:21.619546 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99bf90d-97c5-41d0-8d2f-0ca99c571a6e None admin] RBAC: Authorizing `identity:create_grant(project_id=b028ff2c5aa54499a9cd429125c28fc7, group_id=4a0804b8bd3d4a75ad8387c65b79ba3a, role_id=49187695e1bf4c15980bb68c83ca61de)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:21.624463 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99bf90d-97c5-41d0-8d2f-0ca99c571a6e None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:21.637509 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 197/397] 10.222.0.70 () {58 vars in 1442 bytes} [Tue May 10 19:07:21 2022] PUT /identity/v3/projects/b028ff2c5aa54499a9cd429125c28fc7/groups/4a0804b8bd3d4a75ad8387c65b79ba3a/roles/49187695e1bf4c15980bb68c83ca61de => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 19:07:21.763477 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cfd59a-8335-409a-a6dd-1e0af18b0b2e None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:21.812226 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525db8a7-0d02-4a14-8c50-1ee878232983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:21.812944 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525db8a7-0d02-4a14-8c50-1ee878232983 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:21.813225 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525db8a7-0d02-4a14-8c50-1ee878232983 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:21.813499 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525db8a7-0d02-4a14-8c50-1ee878232983 None admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:21.814271 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525db8a7-0d02-4a14-8c50-1ee878232983 None admin] RBAC: Adding query filter params (name=member) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:07:21.814579 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525db8a7-0d02-4a14-8c50-1ee878232983 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:21.815992 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525db8a7-0d02-4a14-8c50-1ee878232983 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:21.835366 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 201/398] 10.222.0.70 () {56 vars in 1101 bytes} [Tue May 10 19:07:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:07:21.837195 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de791bda-470c-4627-95c1-498454323483 None None] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:21.837616 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de791bda-470c-4627-95c1-498454323483 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:21.837813 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de791bda-470c-4627-95c1-498454323483 None None] PATH_INFO: `/` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:21.839377 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 198/399] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:07:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 19:07:21.845284 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525db8a7-0d02-4a14-8c50-1ee878232983 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:21.850700 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dee49ea-5973-4d5d-b78d-2a97007117e8 None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:21.850982 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dee49ea-5973-4d5d-b78d-2a97007117e8 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:21.851255 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dee49ea-5973-4d5d-b78d-2a97007117e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:21.868768 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-5dee49ea-5973-4d5d-b78d-2a97007117e8 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:07:21.869992 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-5dee49ea-5973-4d5d-b78d-2a97007117e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:07:22.000213 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 199/400] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:07:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 19:07:22.008324 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525db8a7-0d02-4a14-8c50-1ee878232983 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:22.013415 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e741bf0-9746-41dd-af93-a10e0f689a35 None None] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:22.013755 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e741bf0-9746-41dd-af93-a10e0f689a35 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:22.013988 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e741bf0-9746-41dd-af93-a10e0f689a35 None None] PATH_INFO: `/` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:22.015591 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 200/401] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:07:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:07:22.021692 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57778544-46df-4eba-9eaf-d6062373ad15 None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:22.021978 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57778544-46df-4eba-9eaf-d6062373ad15 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:22.022257 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57778544-46df-4eba-9eaf-d6062373ad15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:22.041698 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-57778544-46df-4eba-9eaf-d6062373ad15 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:07:22.042870 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-57778544-46df-4eba-9eaf-d6062373ad15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:07:22.059574 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b764521-30b7-45be-abb3-d65cc2843978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:22.061456 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b764521-30b7-45be-abb3-d65cc2843978 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:22.062057 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b764521-30b7-45be-abb3-d65cc2843978 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:22.062528 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b764521-30b7-45be-abb3-d65cc2843978 None admin] PATH_INFO: `/v3/groups/4a0804b8bd3d4a75ad8387c65b79ba3a` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:22.065147 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b764521-30b7-45be-abb3-d65cc2843978 None admin] RBAC: Authorizing `identity:get_group(group_id=4a0804b8bd3d4a75ad8387c65b79ba3a)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:22.067000 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b764521-30b7-45be-abb3-d65cc2843978 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:22.069942 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 202/402] 10.222.0.70 () {56 vars in 1180 bytes} [Tue May 10 19:07:21 2022] GET /identity/v3/groups/4a0804b8bd3d4a75ad8387c65b79ba3a => generated 226 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:07:22.071439 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b764521-30b7-45be-abb3-d65cc2843978 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:22.125061 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 201/403] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:07:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 19:07:22.125913 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57778544-46df-4eba-9eaf-d6062373ad15 None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:22.197856 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b764521-30b7-45be-abb3-d65cc2843978 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:22.241236 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8397c2cd-825c-41ac-8270-0c98cd2ffb0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:22.242689 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8397c2cd-825c-41ac-8270-0c98cd2ffb0a None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:22.243336 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8397c2cd-825c-41ac-8270-0c98cd2ffb0a None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:22.244116 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8397c2cd-825c-41ac-8270-0c98cd2ffb0a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:22.257795 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8397c2cd-825c-41ac-8270-0c98cd2ffb0a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:07:22.261813 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57778544-46df-4eba-9eaf-d6062373ad15 None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:22.266137 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-8397c2cd-825c-41ac-8270-0c98cd2ffb0a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 19:07:22.266137 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:07:22.266137 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:07:22.266137 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:07:22.266137 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:07:22.266137 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:07:22.266137 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:07:22.266137 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:07:22.266137 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:07:22.266137 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:07:22.266137 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:07:22.266137 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:07:22.266137 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:07:22.266137 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:07:22.266137 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:07:22.266137 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:07:22.267070 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:07:22.267070 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:07:22.267070 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:07:22.267070 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:07:22.267070 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:07:22.267070 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:07:22.267070 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:07:22.267070 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:07:22.267070 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:07:22.267070 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:07:22.267070 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:07:22.267070 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( May 10 19:07:22.267070 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:07:22.267070 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() May 10 19:07:22.267070 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:07:22.267070 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:07:22.267871 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:07:22.267871 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() May 10 19:07:22.267871 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:07:22.267871 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( May 10 19:07:22.267871 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:07:22.267871 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:07:22.267871 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:07:22.267871 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:07:22.267871 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:07:22.267871 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:07:22.267871 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 19:07:22.267871 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:07:22.267871 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 203/404] 10.222.0.70 () {56 vars in 1114 bytes} [Tue May 10 19:07:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:07:22.268567 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8397c2cd-825c-41ac-8270-0c98cd2ffb0a None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:22.307103 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2976c2c6-b351-4e56-9b6f-7b9bd0163ba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:22.309139 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2976c2c6-b351-4e56-9b6f-7b9bd0163ba9 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:22.309610 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2976c2c6-b351-4e56-9b6f-7b9bd0163ba9 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:22.310068 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2976c2c6-b351-4e56-9b6f-7b9bd0163ba9 None admin] PATH_INFO: `/v3/projects/e0df39feccc3439b965b22d514a229be` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:22.311445 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2976c2c6-b351-4e56-9b6f-7b9bd0163ba9 None admin] RBAC: Authorizing `identity:get_project(project_id=e0df39feccc3439b965b22d514a229be)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:22.313320 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2976c2c6-b351-4e56-9b6f-7b9bd0163ba9 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:22.315405 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 202/405] 10.222.0.70 () {56 vars in 1186 bytes} [Tue May 10 19:07:22 2022] GET /identity/v3/projects/e0df39feccc3439b965b22d514a229be => generated 302 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:07:22.316250 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2976c2c6-b351-4e56-9b6f-7b9bd0163ba9 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:22.388659 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8397c2cd-825c-41ac-8270-0c98cd2ffb0a None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:22.429650 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2976c2c6-b351-4e56-9b6f-7b9bd0163ba9 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:22.434016 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5496ed79-fc4a-4a2d-847d-5071647d9868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:22.434896 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5496ed79-fc4a-4a2d-847d-5071647d9868 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:22.435251 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5496ed79-fc4a-4a2d-847d-5071647d9868 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:22.435596 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5496ed79-fc4a-4a2d-847d-5071647d9868 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:22.447218 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5496ed79-fc4a-4a2d-847d-5071647d9868 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:07:22.455185 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-5496ed79-fc4a-4a2d-847d-5071647d9868 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 19:07:22.455185 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:07:22.455185 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:07:22.455185 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:07:22.455185 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:07:22.455185 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:07:22.455185 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:07:22.455185 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:07:22.455185 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:07:22.455185 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:07:22.455185 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:07:22.455185 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:07:22.455185 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:07:22.455185 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:07:22.455185 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:07:22.455185 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:07:22.456113 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:07:22.456113 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:07:22.456113 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:07:22.456113 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:07:22.456113 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:07:22.456113 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:07:22.456113 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:07:22.456113 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:07:22.456113 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:07:22.456113 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:07:22.456113 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:07:22.456113 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( May 10 19:07:22.456113 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:07:22.456113 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() May 10 19:07:22.456113 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:07:22.456113 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:07:22.456980 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:07:22.456980 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() May 10 19:07:22.456980 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:07:22.456980 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( May 10 19:07:22.456980 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:07:22.456980 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:07:22.456980 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:07:22.456980 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:07:22.456980 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:07:22.456980 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:07:22.456980 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 19:07:22.456980 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:07:22.458423 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 204/406] 10.222.0.70 () {56 vars in 1096 bytes} [Tue May 10 19:07:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:07:22.459655 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5496ed79-fc4a-4a2d-847d-5071647d9868 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:22.481554 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d3c4ee-3c6c-40de-b98c-d8bd4232b5c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:22.482540 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d3c4ee-3c6c-40de-b98c-d8bd4232b5c7 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:22.483037 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d3c4ee-3c6c-40de-b98c-d8bd4232b5c7 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:22.483767 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d3c4ee-3c6c-40de-b98c-d8bd4232b5c7 None admin] PATH_INFO: `/v3/roles` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:22.484919 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d3c4ee-3c6c-40de-b98c-d8bd4232b5c7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:07:22.485400 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d3c4ee-3c6c-40de-b98c-d8bd4232b5c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:22.486983 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d3c4ee-3c6c-40de-b98c-d8bd4232b5c7 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:22.496013 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 203/407] 10.222.0.70 () {56 vars in 1111 bytes} [Tue May 10 19:07:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:07:22.497163 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d3c4ee-3c6c-40de-b98c-d8bd4232b5c7 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:22.566886 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5496ed79-fc4a-4a2d-847d-5071647d9868 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:22.600598 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d3c4ee-3c6c-40de-b98c-d8bd4232b5c7 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:22.602593 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205ccdb6-c3e5-4eb2-abd5-89e3cdf0880a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:22.603710 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205ccdb6-c3e5-4eb2-abd5-89e3cdf0880a None admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:22.604570 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205ccdb6-c3e5-4eb2-abd5-89e3cdf0880a None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:22.604988 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205ccdb6-c3e5-4eb2-abd5-89e3cdf0880a None admin] PATH_INFO: `/v3/projects/e0df39feccc3439b965b22d514a229be/groups/4a0804b8bd3d4a75ad8387c65b79ba3a/roles/5c07cf5bfbd3427db18428aa50420962` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:22.607126 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205ccdb6-c3e5-4eb2-abd5-89e3cdf0880a None admin] RBAC: Authorizing `identity:create_grant(project_id=e0df39feccc3439b965b22d514a229be, group_id=4a0804b8bd3d4a75ad8387c65b79ba3a, role_id=5c07cf5bfbd3427db18428aa50420962)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:22.608941 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205ccdb6-c3e5-4eb2-abd5-89e3cdf0880a None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:22.627190 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 205/408] 10.222.0.70 () {58 vars in 1442 bytes} [Tue May 10 19:07:22 2022] PUT /identity/v3/projects/e0df39feccc3439b965b22d514a229be/groups/4a0804b8bd3d4a75ad8387c65b79ba3a/roles/5c07cf5bfbd3427db18428aa50420962 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:07:22.628855 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205ccdb6-c3e5-4eb2-abd5-89e3cdf0880a None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:22.655942 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5547e52c-d376-48eb-bdc9-7cc7c27beb27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:22.657174 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5547e52c-d376-48eb-bdc9-7cc7c27beb27 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:22.657680 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5547e52c-d376-48eb-bdc9-7cc7c27beb27 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:22.658617 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5547e52c-d376-48eb-bdc9-7cc7c27beb27 None admin] PATH_INFO: `/v3/roles` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:22.659774 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5547e52c-d376-48eb-bdc9-7cc7c27beb27 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:07:22.660571 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5547e52c-d376-48eb-bdc9-7cc7c27beb27 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:22.662327 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5547e52c-d376-48eb-bdc9-7cc7c27beb27 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:22.673190 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 204/409] 10.222.0.70 () {56 vars in 1099 bytes} [Tue May 10 19:07:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:07:22.680728 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5547e52c-d376-48eb-bdc9-7cc7c27beb27 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:22.790996 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5547e52c-d376-48eb-bdc9-7cc7c27beb27 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:22.819290 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205ccdb6-c3e5-4eb2-abd5-89e3cdf0880a None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:22.829889 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1aad231-99d6-45b6-9087-c954436f7df6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:22.831228 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aad231-99d6-45b6-9087-c954436f7df6 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:22.831726 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aad231-99d6-45b6-9087-c954436f7df6 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:22.832837 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aad231-99d6-45b6-9087-c954436f7df6 None admin] PATH_INFO: `/v3/groups/754974433ea84f44829671eb58fe3a9c` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:22.834514 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1aad231-99d6-45b6-9087-c954436f7df6 None admin] RBAC: Authorizing `identity:get_group(group_id=754974433ea84f44829671eb58fe3a9c)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:22.836310 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1aad231-99d6-45b6-9087-c954436f7df6 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:22.838872 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 205/410] 10.222.0.70 () {56 vars in 1180 bytes} [Tue May 10 19:07:22 2022] GET /identity/v3/groups/754974433ea84f44829671eb58fe3a9c => generated 229 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:07:22.845900 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1aad231-99d6-45b6-9087-c954436f7df6 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:22.874836 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa36bb5-1613-482a-bc36-61a726ed7dce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:22.875846 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa36bb5-1613-482a-bc36-61a726ed7dce None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:22.876134 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa36bb5-1613-482a-bc36-61a726ed7dce None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:22.876648 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa36bb5-1613-482a-bc36-61a726ed7dce None admin] PATH_INFO: `/v3/groups/4a0804b8bd3d4a75ad8387c65b79ba3a` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:22.878623 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa36bb5-1613-482a-bc36-61a726ed7dce None admin] RBAC: Authorizing `identity:get_group(group_id=4a0804b8bd3d4a75ad8387c65b79ba3a)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:22.880643 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa36bb5-1613-482a-bc36-61a726ed7dce None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:22.884499 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 206/411] 10.222.0.70 () {56 vars in 1180 bytes} [Tue May 10 19:07:22 2022] GET /identity/v3/groups/4a0804b8bd3d4a75ad8387c65b79ba3a => generated 226 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:07:22.889064 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa36bb5-1613-482a-bc36-61a726ed7dce None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:22.968228 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1aad231-99d6-45b6-9087-c954436f7df6 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:23.006103 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa36bb5-1613-482a-bc36-61a726ed7dce None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:23.007566 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611540a6-bbed-4972-947f-7de830ee03d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:23.008459 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611540a6-bbed-4972-947f-7de830ee03d4 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:23.008753 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611540a6-bbed-4972-947f-7de830ee03d4 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:23.009030 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611540a6-bbed-4972-947f-7de830ee03d4 None admin] PATH_INFO: `/v3/projects/a7c5828bc7be44a6adb3e9898a8f18d8` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:23.010255 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611540a6-bbed-4972-947f-7de830ee03d4 None admin] RBAC: Authorizing `identity:get_project(project_id=a7c5828bc7be44a6adb3e9898a8f18d8)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:23.011704 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611540a6-bbed-4972-947f-7de830ee03d4 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:23.013787 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 206/412] 10.222.0.70 () {56 vars in 1186 bytes} [Tue May 10 19:07:22 2022] GET /identity/v3/projects/a7c5828bc7be44a6adb3e9898a8f18d8 => generated 344 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:07:23.022087 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611540a6-bbed-4972-947f-7de830ee03d4 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:23.062862 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9217eacf-cab6-445d-9862-25655d3391d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:23.063731 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9217eacf-cab6-445d-9862-25655d3391d9 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:23.064013 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9217eacf-cab6-445d-9862-25655d3391d9 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:23.064287 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9217eacf-cab6-445d-9862-25655d3391d9 None admin] PATH_INFO: `/v3/projects/e0df39feccc3439b965b22d514a229be` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:23.068774 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9217eacf-cab6-445d-9862-25655d3391d9 None admin] RBAC: Authorizing `identity:get_project(project_id=e0df39feccc3439b965b22d514a229be)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:23.070303 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9217eacf-cab6-445d-9862-25655d3391d9 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:23.071973 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 207/413] 10.222.0.70 () {56 vars in 1186 bytes} [Tue May 10 19:07:22 2022] GET /identity/v3/projects/e0df39feccc3439b965b22d514a229be => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:07:23.073215 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af67e86a-a33d-47ae-9915-33eacc423802 None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:23.073499 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af67e86a-a33d-47ae-9915-33eacc423802 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:23.073776 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af67e86a-a33d-47ae-9915-33eacc423802 None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:23.075243 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 208/414] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:07:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:07:23.080515 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43879668-838c-427d-86f6-e8fcb076ceaa None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:23.080807 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43879668-838c-427d-86f6-e8fcb076ceaa None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:23.081189 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43879668-838c-427d-86f6-e8fcb076ceaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:23.106742 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-43879668-838c-427d-86f6-e8fcb076ceaa None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:07:23.107942 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-43879668-838c-427d-86f6-e8fcb076ceaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:07:23.151094 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611540a6-bbed-4972-947f-7de830ee03d4 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:23.190555 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43ec804-7c6f-4c47-9666-e0af3c33bcec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:23.191968 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43ec804-7c6f-4c47-9666-e0af3c33bcec None admin] REQUEST_METHOD: `PUT` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:23.192271 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43ec804-7c6f-4c47-9666-e0af3c33bcec None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:23.192582 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43ec804-7c6f-4c47-9666-e0af3c33bcec None admin] PATH_INFO: `/v3/projects/a7c5828bc7be44a6adb3e9898a8f18d8/groups/754974433ea84f44829671eb58fe3a9c/roles/634ba284303b4626b5a0402772c68f5c` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:23.194866 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43ec804-7c6f-4c47-9666-e0af3c33bcec None admin] RBAC: Authorizing `identity:create_grant(project_id=a7c5828bc7be44a6adb3e9898a8f18d8, group_id=754974433ea84f44829671eb58fe3a9c, role_id=634ba284303b4626b5a0402772c68f5c)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:23.195525 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 209/415] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:07:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 19:07:23.196320 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43ec804-7c6f-4c47-9666-e0af3c33bcec None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:23.197298 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43879668-838c-427d-86f6-e8fcb076ceaa None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:23.229709 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 207/416] 10.222.0.70 () {58 vars in 1442 bytes} [Tue May 10 19:07:23 2022] PUT /identity/v3/projects/a7c5828bc7be44a6adb3e9898a8f18d8/groups/754974433ea84f44829671eb58fe3a9c/roles/634ba284303b4626b5a0402772c68f5c => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:07:23.230892 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43ec804-7c6f-4c47-9666-e0af3c33bcec None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:23.337641 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43879668-838c-427d-86f6-e8fcb076ceaa None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:23.358357 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43ec804-7c6f-4c47-9666-e0af3c33bcec None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:23.385108 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d543df7b-0dd8-4d1c-8aba-a264fc9a1321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:23.386016 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d543df7b-0dd8-4d1c-8aba-a264fc9a1321 None admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:23.386471 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d543df7b-0dd8-4d1c-8aba-a264fc9a1321 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:23.386767 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d543df7b-0dd8-4d1c-8aba-a264fc9a1321 None admin] PATH_INFO: `/v3/projects/e0df39feccc3439b965b22d514a229be/groups/4a0804b8bd3d4a75ad8387c65b79ba3a/roles/49187695e1bf4c15980bb68c83ca61de` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:23.389972 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d543df7b-0dd8-4d1c-8aba-a264fc9a1321 None admin] RBAC: Authorizing `identity:create_grant(project_id=e0df39feccc3439b965b22d514a229be, group_id=4a0804b8bd3d4a75ad8387c65b79ba3a, role_id=49187695e1bf4c15980bb68c83ca61de)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:23.391920 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d543df7b-0dd8-4d1c-8aba-a264fc9a1321 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:23.407833 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f5ed54-5945-4e9d-9c5a-be6bb96542ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:23.409302 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f5ed54-5945-4e9d-9c5a-be6bb96542ce None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:23.409856 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f5ed54-5945-4e9d-9c5a-be6bb96542ce None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:23.411030 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f5ed54-5945-4e9d-9c5a-be6bb96542ce None admin] PATH_INFO: `/v3/roles/member` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:23.421486 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 210/417] 10.222.0.70 () {58 vars in 1442 bytes} [Tue May 10 19:07:23 2022] PUT /identity/v3/projects/e0df39feccc3439b965b22d514a229be/groups/4a0804b8bd3d4a75ad8387c65b79ba3a/roles/49187695e1bf4c15980bb68c83ca61de => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:07:23.431868 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f5ed54-5945-4e9d-9c5a-be6bb96542ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:07:23.440825 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application [None req-43f5ed54-5945-4e9d-9c5a-be6bb96542ce None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 19:07:23.440825 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:07:23.440825 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:07:23.440825 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:07:23.440825 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:07:23.440825 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:07:23.440825 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:07:23.440825 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:07:23.440825 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:07:23.440825 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:07:23.440825 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:07:23.440825 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:07:23.440825 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:07:23.440825 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:07:23.440825 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:07:23.440825 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:07:23.441841 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:07:23.441841 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:07:23.441841 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:07:23.441841 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:07:23.441841 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:07:23.441841 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:07:23.441841 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:07:23.441841 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:07:23.441841 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:07:23.441841 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:07:23.441841 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:07:23.441841 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application with Lock( May 10 19:07:23.441841 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:07:23.441841 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._enter() May 10 19:07:23.441841 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:07:23.441841 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:07:23.442649 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:07:23.442649 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.creator() May 10 19:07:23.442649 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:07:23.442649 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application created_value = creator( May 10 19:07:23.442649 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:07:23.442649 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:07:23.442649 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:07:23.442649 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:07:23.442649 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:07:23.442649 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:07:23.442649 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 19:07:23.442649 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application May 10 19:07:23.445726 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 208/418] 10.222.0.70 () {56 vars in 1099 bytes} [Tue May 10 19:07:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:07:23.451748 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d543df7b-0dd8-4d1c-8aba-a264fc9a1321 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:23.587725 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d543df7b-0dd8-4d1c-8aba-a264fc9a1321 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:23.626597 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa08d43-1526-4b54-b536-890a10619de9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:23.627366 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa08d43-1526-4b54-b536-890a10619de9 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:23.627564 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa08d43-1526-4b54-b536-890a10619de9 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:23.627820 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa08d43-1526-4b54-b536-890a10619de9 None admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:23.628603 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa08d43-1526-4b54-b536-890a10619de9 None admin] RBAC: Adding query filter params (name=member) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:07:23.628906 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa08d43-1526-4b54-b536-890a10619de9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:23.630368 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa08d43-1526-4b54-b536-890a10619de9 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:23.641222 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 211/419] 10.222.0.70 () {56 vars in 1101 bytes} [Tue May 10 19:07:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:07:23.647078 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f5ed54-5945-4e9d-9c5a-be6bb96542ce None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:23.772910 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f5ed54-5945-4e9d-9c5a-be6bb96542ce None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:23.809850 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc44f39-bb6b-4a49-9a92-3425b4ea2e07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:23.810878 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc44f39-bb6b-4a49-9a92-3425b4ea2e07 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:23.811383 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc44f39-bb6b-4a49-9a92-3425b4ea2e07 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:23.811855 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc44f39-bb6b-4a49-9a92-3425b4ea2e07 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:23.882500 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc44f39-bb6b-4a49-9a92-3425b4ea2e07 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:23.884711 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc44f39-bb6b-4a49-9a92-3425b4ea2e07 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:23.982717 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 209/420] 10.222.0.70 () {58 vars in 1282 bytes} [Tue May 10 19:07:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 19:07:23.988218 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa08d43-1526-4b54-b536-890a10619de9 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:24.120677 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa08d43-1526-4b54-b536-890a10619de9 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:24.161901 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dade338d-de8d-485d-be3e-cc4d9386f2de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:24.162803 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dade338d-de8d-485d-be3e-cc4d9386f2de None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:24.163091 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dade338d-de8d-485d-be3e-cc4d9386f2de None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:24.163360 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dade338d-de8d-485d-be3e-cc4d9386f2de None admin] PATH_INFO: `/v3/projects/b028ff2c5aa54499a9cd429125c28fc7` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:24.169165 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dade338d-de8d-485d-be3e-cc4d9386f2de None admin] RBAC: Authorizing `identity:get_project(project_id=b028ff2c5aa54499a9cd429125c28fc7)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:24.170607 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dade338d-de8d-485d-be3e-cc4d9386f2de None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:24.172637 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 212/421] 10.222.0.70 () {56 vars in 1186 bytes} [Tue May 10 19:07:23 2022] GET /identity/v3/projects/b028ff2c5aa54499a9cd429125c28fc7 => generated 298 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:07:24.178533 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc44f39-bb6b-4a49-9a92-3425b4ea2e07 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:24.315263 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc44f39-bb6b-4a49-9a92-3425b4ea2e07 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:24.369157 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c547937b-19fb-45b7-94cd-8ce85ba7ad61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:24.370028 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c547937b-19fb-45b7-94cd-8ce85ba7ad61 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:24.370312 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c547937b-19fb-45b7-94cd-8ce85ba7ad61 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:24.370584 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c547937b-19fb-45b7-94cd-8ce85ba7ad61 None admin] PATH_INFO: `/v3/groups/4a0804b8bd3d4a75ad8387c65b79ba3a` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:24.371799 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c547937b-19fb-45b7-94cd-8ce85ba7ad61 None admin] RBAC: Authorizing `identity:get_group(group_id=4a0804b8bd3d4a75ad8387c65b79ba3a)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:24.373280 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c547937b-19fb-45b7-94cd-8ce85ba7ad61 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:24.375212 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 210/422] 10.222.0.70 () {56 vars in 1180 bytes} [Tue May 10 19:07:24 2022] GET /identity/v3/groups/4a0804b8bd3d4a75ad8387c65b79ba3a => generated 226 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:07:24.381530 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dade338d-de8d-485d-be3e-cc4d9386f2de None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:24.531826 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dade338d-de8d-485d-be3e-cc4d9386f2de None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:24.572379 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f100f417-1df4-4e43-9141-47e6abf31738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:24.573080 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f100f417-1df4-4e43-9141-47e6abf31738 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:24.573433 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f100f417-1df4-4e43-9141-47e6abf31738 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:24.573716 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f100f417-1df4-4e43-9141-47e6abf31738 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:24.574545 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f100f417-1df4-4e43-9141-47e6abf31738 None admin] RBAC: Adding query filter params (group.id=4a0804b8bd3d4a75ad8387c65b79ba3a, role.id=5c07cf5bfbd3427db18428aa50420962, scope.project.id=b028ff2c5aa54499a9cd429125c28fc7) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:07:24.574857 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f100f417-1df4-4e43-9141-47e6abf31738 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:24.576300 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f100f417-1df4-4e43-9141-47e6abf31738 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:24.583095 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 213/423] 10.222.0.70 () {56 vars in 1376 bytes} [Tue May 10 19:07:24 2022] GET /identity/v3/role_assignments?group.id=4a0804b8bd3d4a75ad8387c65b79ba3a&scope.project.id=b028ff2c5aa54499a9cd429125c28fc7&role.id=5c07cf5bfbd3427db18428aa50420962 => generated 611 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:07:24.632334 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb46df16-66c7-409c-9fc6-48c90eead0e1 None None] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:24.633046 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb46df16-66c7-409c-9fc6-48c90eead0e1 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:24.633528 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb46df16-66c7-409c-9fc6-48c90eead0e1 None None] PATH_INFO: `/` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:24.635487 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 211/424] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:07:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:07:24.640942 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0286882-ca5f-400c-89d7-0a81a6525580 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:24.641403 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0286882-ca5f-400c-89d7-0a81a6525580 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:24.641502 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0286882-ca5f-400c-89d7-0a81a6525580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:24.674466 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-f0286882-ca5f-400c-89d7-0a81a6525580 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:07:24.675703 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-f0286882-ca5f-400c-89d7-0a81a6525580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:07:24.772815 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 214/425] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:07:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 19:07:24.807268 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb46df16-66c7-409c-9fc6-48c90eead0e1 None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:24.940116 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb46df16-66c7-409c-9fc6-48c90eead0e1 None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:24.975148 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91dbf3a-138b-40df-b5a7-d119881785be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:24.975967 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91dbf3a-138b-40df-b5a7-d119881785be None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:24.976252 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91dbf3a-138b-40df-b5a7-d119881785be None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:24.976561 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91dbf3a-138b-40df-b5a7-d119881785be None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:24.987299 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91dbf3a-138b-40df-b5a7-d119881785be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:07:24.996074 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application [None req-a91dbf3a-138b-40df-b5a7-d119881785be None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 19:07:24.996074 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:07:24.996074 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:07:24.996074 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:07:24.996074 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:07:24.996074 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:07:24.996074 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:07:24.996074 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:07:24.996074 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:07:24.996074 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:07:24.996074 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:07:24.996074 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:07:24.996074 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:07:24.996074 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:07:24.996074 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:07:24.996074 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:07:24.997043 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:07:24.997043 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:07:24.997043 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:07:24.997043 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:07:24.997043 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:07:24.997043 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:07:24.997043 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:07:24.997043 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:07:24.997043 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:07:24.997043 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:07:24.997043 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:07:24.997043 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application with Lock( May 10 19:07:24.997043 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:07:24.997043 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._enter() May 10 19:07:24.997043 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:07:24.997043 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:07:24.997861 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:07:24.997861 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.creator() May 10 19:07:24.997861 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:07:24.997861 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application created_value = creator( May 10 19:07:24.997861 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:07:24.997861 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:07:24.997861 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:07:24.997861 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:07:24.997861 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:07:24.997861 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:07:24.997861 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 19:07:24.997861 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application May 10 19:07:24.997861 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 212/426] 10.222.0.70 () {56 vars in 1114 bytes} [Tue May 10 19:07:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:07:25.003064 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0286882-ca5f-400c-89d7-0a81a6525580 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:25.125657 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0286882-ca5f-400c-89d7-0a81a6525580 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:25.163585 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ad460c-0224-4ee2-939e-19937b933b9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:25.164264 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ad460c-0224-4ee2-939e-19937b933b9f None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:25.164577 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ad460c-0224-4ee2-939e-19937b933b9f None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:25.164853 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ad460c-0224-4ee2-939e-19937b933b9f None admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:25.165602 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ad460c-0224-4ee2-939e-19937b933b9f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:07:25.165906 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ad460c-0224-4ee2-939e-19937b933b9f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:25.167283 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ad460c-0224-4ee2-939e-19937b933b9f None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:25.178938 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 215/427] 10.222.0.70 () {56 vars in 1111 bytes} [Tue May 10 19:07:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:07:25.184056 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91dbf3a-138b-40df-b5a7-d119881785be None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:25.300723 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91dbf3a-138b-40df-b5a7-d119881785be None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:25.344020 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4d5620-babc-40c5-a94d-892e01147098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:25.344703 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4d5620-babc-40c5-a94d-892e01147098 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:25.344988 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4d5620-babc-40c5-a94d-892e01147098 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:25.345304 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4d5620-babc-40c5-a94d-892e01147098 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:25.439161 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4d5620-babc-40c5-a94d-892e01147098 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:25.440708 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4d5620-babc-40c5-a94d-892e01147098 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:25.565055 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 213/428] 10.222.0.70 () {58 vars in 1282 bytes} [Tue May 10 19:07:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 19:07:25.572255 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ad460c-0224-4ee2-939e-19937b933b9f None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:25.628890 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b105b1-e9e3-4352-afd2-b15a74d39c69 None None] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:25.630069 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b105b1-e9e3-4352-afd2-b15a74d39c69 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:25.630446 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b105b1-e9e3-4352-afd2-b15a74d39c69 None None] PATH_INFO: `/` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:25.632182 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 214/429] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:07:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 19:07:25.637275 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec050bf-7afd-4ef3-9711-65edb6ff73e9 None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:25.637666 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec050bf-7afd-4ef3-9711-65edb6ff73e9 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:25.638047 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec050bf-7afd-4ef3-9711-65edb6ff73e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:25.654396 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-3ec050bf-7afd-4ef3-9711-65edb6ff73e9 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:07:25.655729 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-3ec050bf-7afd-4ef3-9711-65edb6ff73e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:07:25.683066 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ad460c-0224-4ee2-939e-19937b933b9f None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:25.724210 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecf705f-f5ad-4cd1-8aef-64c699d885c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:25.725184 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecf705f-f5ad-4cd1-8aef-64c699d885c9 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:25.725760 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecf705f-f5ad-4cd1-8aef-64c699d885c9 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:25.726042 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecf705f-f5ad-4cd1-8aef-64c699d885c9 None admin] PATH_INFO: `/v3/projects/b028ff2c5aa54499a9cd429125c28fc7` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:25.727813 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecf705f-f5ad-4cd1-8aef-64c699d885c9 None admin] RBAC: Authorizing `identity:get_project(project_id=b028ff2c5aa54499a9cd429125c28fc7)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:25.729283 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecf705f-f5ad-4cd1-8aef-64c699d885c9 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:25.731287 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 216/431] 10.222.0.70 () {56 vars in 1186 bytes} [Tue May 10 19:07:25 2022] GET /identity/v3/projects/b028ff2c5aa54499a9cd429125c28fc7 => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:07:25.736109 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecf705f-f5ad-4cd1-8aef-64c699d885c9 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:25.736485 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 215/431] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:07:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 19:07:25.762202 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec050bf-7afd-4ef3-9711-65edb6ff73e9 None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:25.857053 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecf705f-f5ad-4cd1-8aef-64c699d885c9 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:25.868732 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec050bf-7afd-4ef3-9711-65edb6ff73e9 None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:25.903785 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f1b177-48f5-4c04-9d8e-8e7856dbd686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:25.904675 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f1b177-48f5-4c04-9d8e-8e7856dbd686 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:25.904955 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f1b177-48f5-4c04-9d8e-8e7856dbd686 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:25.905226 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f1b177-48f5-4c04-9d8e-8e7856dbd686 None admin] PATH_INFO: `/v3/groups/4a0804b8bd3d4a75ad8387c65b79ba3a` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:25.906165 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9f8e24-ac96-4e2b-8c7a-3f1181c70c6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:25.906430 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f1b177-48f5-4c04-9d8e-8e7856dbd686 None admin] RBAC: Authorizing `identity:get_group(group_id=4a0804b8bd3d4a75ad8387c65b79ba3a)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:25.907145 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9f8e24-ac96-4e2b-8c7a-3f1181c70c6f None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:25.907518 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9f8e24-ac96-4e2b-8c7a-3f1181c70c6f None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:25.907863 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f1b177-48f5-4c04-9d8e-8e7856dbd686 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:25.907976 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9f8e24-ac96-4e2b-8c7a-3f1181c70c6f None admin] PATH_INFO: `/v3/roles/member` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:25.909988 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 217/432] 10.222.0.70 () {56 vars in 1180 bytes} [Tue May 10 19:07:25 2022] GET /identity/v3/groups/4a0804b8bd3d4a75ad8387c65b79ba3a => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:07:25.915191 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f1b177-48f5-4c04-9d8e-8e7856dbd686 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:25.920443 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9f8e24-ac96-4e2b-8c7a-3f1181c70c6f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:07:25.928176 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application [None req-fe9f8e24-ac96-4e2b-8c7a-3f1181c70c6f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 19:07:25.928176 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:07:25.928176 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:07:25.928176 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:07:25.928176 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:07:25.928176 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:07:25.928176 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:07:25.928176 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:07:25.928176 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:07:25.928176 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:07:25.928176 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:07:25.928176 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:07:25.928176 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:07:25.928176 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:07:25.928176 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:07:25.928176 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:07:25.929109 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:07:25.929109 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:07:25.929109 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:07:25.929109 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:07:25.929109 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:07:25.929109 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:07:25.929109 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:07:25.929109 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:07:25.929109 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:07:25.929109 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:07:25.929109 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:07:25.929109 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application with Lock( May 10 19:07:25.929109 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:07:25.929109 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._enter() May 10 19:07:25.929109 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:07:25.929109 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:07:25.930052 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:07:25.930052 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.creator() May 10 19:07:25.930052 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:07:25.930052 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application created_value = creator( May 10 19:07:25.930052 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:07:25.930052 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:07:25.930052 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:07:25.930052 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:07:25.930052 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:07:25.930052 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:07:25.930052 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 19:07:25.930052 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application May 10 19:07:25.930052 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 216/433] 10.222.0.70 () {56 vars in 1099 bytes} [Tue May 10 19:07:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 19:07:25.936564 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9f8e24-ac96-4e2b-8c7a-3f1181c70c6f None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:26.035729 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9f8e24-ac96-4e2b-8c7a-3f1181c70c6f None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:26.036332 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f1b177-48f5-4c04-9d8e-8e7856dbd686 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:26.070261 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7342c4a2-b4f0-4788-9f88-2a3e1c002d60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:26.070491 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4e85e7-e16d-4032-b0c8-57f0b5b37b5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:26.071096 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7342c4a2-b4f0-4788-9f88-2a3e1c002d60 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:26.071294 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4e85e7-e16d-4032-b0c8-57f0b5b37b5e None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:26.071445 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7342c4a2-b4f0-4788-9f88-2a3e1c002d60 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:26.071579 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4e85e7-e16d-4032-b0c8-57f0b5b37b5e None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:26.071855 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4e85e7-e16d-4032-b0c8-57f0b5b37b5e None admin] PATH_INFO: `/v3/roles` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:26.071943 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7342c4a2-b4f0-4788-9f88-2a3e1c002d60 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:26.072658 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4e85e7-e16d-4032-b0c8-57f0b5b37b5e None admin] RBAC: Adding query filter params (name=member) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:07:26.072865 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7342c4a2-b4f0-4788-9f88-2a3e1c002d60 None admin] RBAC: Adding query filter params (group.id=4a0804b8bd3d4a75ad8387c65b79ba3a, role.id=49187695e1bf4c15980bb68c83ca61de, scope.project.id=b028ff2c5aa54499a9cd429125c28fc7) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:07:26.072958 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4e85e7-e16d-4032-b0c8-57f0b5b37b5e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:26.073191 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7342c4a2-b4f0-4788-9f88-2a3e1c002d60 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:26.074392 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4e85e7-e16d-4032-b0c8-57f0b5b37b5e None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:26.074762 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7342c4a2-b4f0-4788-9f88-2a3e1c002d60 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:26.081693 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 218/434] 10.222.0.70 () {56 vars in 1376 bytes} [Tue May 10 19:07:25 2022] GET /identity/v3/role_assignments?group.id=4a0804b8bd3d4a75ad8387c65b79ba3a&scope.project.id=b028ff2c5aa54499a9cd429125c28fc7&role.id=49187695e1bf4c15980bb68c83ca61de => generated 611 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:07:26.083914 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3ece10-c4db-4c98-a7e8-69f37249840d None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:26.084206 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3ece10-c4db-4c98-a7e8-69f37249840d None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:26.084549 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3ece10-c4db-4c98-a7e8-69f37249840d None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:26.086099 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 219/435] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:07:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:07:26.096465 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efa9933-bf68-45df-991a-626bde9a23c6 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:26.096465 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efa9933-bf68-45df-991a-626bde9a23c6 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:26.096465 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efa9933-bf68-45df-991a-626bde9a23c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:26.096790 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 217/436] 10.222.0.70 () {56 vars in 1101 bytes} [Tue May 10 19:07:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:07:26.101785 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4e85e7-e16d-4032-b0c8-57f0b5b37b5e None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:26.115870 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-8efa9933-bf68-45df-991a-626bde9a23c6 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:07:26.117151 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-8efa9933-bf68-45df-991a-626bde9a23c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:07:26.196574 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 220/437] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:07:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 19:07:26.214847 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efa9933-bf68-45df-991a-626bde9a23c6 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:26.218011 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4e85e7-e16d-4032-b0c8-57f0b5b37b5e None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:26.253628 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e1b597-92da-45f9-b65d-89ed29aaab0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:26.254832 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e1b597-92da-45f9-b65d-89ed29aaab0c None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:26.255117 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e1b597-92da-45f9-b65d-89ed29aaab0c None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:26.255391 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e1b597-92da-45f9-b65d-89ed29aaab0c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:26.323989 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efa9933-bf68-45df-991a-626bde9a23c6 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:26.326200 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e1b597-92da-45f9-b65d-89ed29aaab0c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:26.327659 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e1b597-92da-45f9-b65d-89ed29aaab0c None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:26.360461 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a60f94-1491-4e89-a341-60cbfa278ce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:26.361172 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a60f94-1491-4e89-a341-60cbfa278ce2 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:26.361456 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a60f94-1491-4e89-a341-60cbfa278ce2 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:26.361722 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a60f94-1491-4e89-a341-60cbfa278ce2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:26.372198 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a60f94-1491-4e89-a341-60cbfa278ce2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:07:26.379970 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-a8a60f94-1491-4e89-a341-60cbfa278ce2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 19:07:26.379970 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:07:26.379970 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:07:26.379970 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:07:26.379970 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:07:26.379970 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:07:26.379970 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:07:26.379970 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:07:26.379970 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:07:26.379970 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:07:26.379970 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:07:26.379970 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:07:26.379970 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:07:26.379970 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:07:26.379970 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:07:26.379970 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:07:26.380982 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:07:26.380982 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:07:26.380982 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:07:26.380982 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:07:26.380982 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:07:26.380982 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:07:26.380982 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:07:26.380982 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:07:26.380982 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:07:26.380982 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:07:26.380982 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:07:26.380982 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( May 10 19:07:26.380982 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:07:26.380982 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() May 10 19:07:26.380982 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:07:26.380982 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:07:26.381784 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:07:26.381784 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() May 10 19:07:26.381784 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:07:26.381784 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( May 10 19:07:26.381784 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:07:26.381784 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:07:26.381784 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:07:26.381784 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:07:26.381784 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:07:26.381784 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:07:26.381784 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 19:07:26.381784 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:07:26.381784 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 221/438] 10.222.0.70 () {56 vars in 1096 bytes} [Tue May 10 19:07:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 19:07:26.387625 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c949cf66-85ed-4667-8411-49109b562b13 None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:26.387754 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c949cf66-85ed-4667-8411-49109b562b13 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:26.387929 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c949cf66-85ed-4667-8411-49109b562b13 None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:26.389383 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 222/439] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:07:26 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:07:26.390007 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c949cf66-85ed-4667-8411-49109b562b13 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:26.448090 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 218/440] 10.222.0.70 () {58 vars in 1282 bytes} [Tue May 10 19:07:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 10 19:07:26.449480 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3a815b-089d-4e2b-95a9-4eaaf1dde7f7 None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:26.449770 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3a815b-089d-4e2b-95a9-4eaaf1dde7f7 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:26.450039 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3a815b-089d-4e2b-95a9-4eaaf1dde7f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:26.468005 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-bb3a815b-089d-4e2b-95a9-4eaaf1dde7f7 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:07:26.469462 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-bb3a815b-089d-4e2b-95a9-4eaaf1dde7f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:07:26.499413 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c949cf66-85ed-4667-8411-49109b562b13 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:26.531200 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abc110c-fb68-4707-9eda-1acdd203a727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:26.531862 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abc110c-fb68-4707-9eda-1acdd203a727 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:26.532141 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abc110c-fb68-4707-9eda-1acdd203a727 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:26.532414 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abc110c-fb68-4707-9eda-1acdd203a727 None admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:26.533173 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abc110c-fb68-4707-9eda-1acdd203a727 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:07:26.533474 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abc110c-fb68-4707-9eda-1acdd203a727 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:26.534840 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abc110c-fb68-4707-9eda-1acdd203a727 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:26.538789 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 219/441] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:07:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 19:07:26.539605 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3a815b-089d-4e2b-95a9-4eaaf1dde7f7 None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:26.542906 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 223/442] 10.222.0.70 () {56 vars in 1099 bytes} [Tue May 10 19:07:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:07:26.548238 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abc110c-fb68-4707-9eda-1acdd203a727 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:26.633100 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3a815b-089d-4e2b-95a9-4eaaf1dde7f7 None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:26.641718 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abc110c-fb68-4707-9eda-1acdd203a727 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:26.665692 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcd649d-61cd-41bb-8526-b060e64cf1d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:26.666550 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcd649d-61cd-41bb-8526-b060e64cf1d4 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:26.666833 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcd649d-61cd-41bb-8526-b060e64cf1d4 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:26.667095 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcd649d-61cd-41bb-8526-b060e64cf1d4 None admin] PATH_INFO: `/v3/projects/e0df39feccc3439b965b22d514a229be` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:26.668259 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcd649d-61cd-41bb-8526-b060e64cf1d4 None admin] RBAC: Authorizing `identity:get_project(project_id=e0df39feccc3439b965b22d514a229be)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:26.669723 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcd649d-61cd-41bb-8526-b060e64cf1d4 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:26.671376 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 220/443] 10.222.0.70 () {56 vars in 1186 bytes} [Tue May 10 19:07:26 2022] GET /identity/v3/projects/e0df39feccc3439b965b22d514a229be => generated 302 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:07:26.672110 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcd649d-61cd-41bb-8526-b060e64cf1d4 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:26.674401 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19034c23-97e3-4654-9da0-ac60856b1bc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:26.675052 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19034c23-97e3-4654-9da0-ac60856b1bc1 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:26.675339 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19034c23-97e3-4654-9da0-ac60856b1bc1 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:26.675613 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19034c23-97e3-4654-9da0-ac60856b1bc1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:26.742293 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19034c23-97e3-4654-9da0-ac60856b1bc1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:26.743725 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19034c23-97e3-4654-9da0-ac60856b1bc1 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:26.765335 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcd649d-61cd-41bb-8526-b060e64cf1d4 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:26.796821 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c3c6ac-df4e-4ba8-874d-1a5eb8e08754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:26.797716 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c3c6ac-df4e-4ba8-874d-1a5eb8e08754 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:26.798069 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c3c6ac-df4e-4ba8-874d-1a5eb8e08754 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:26.798417 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c3c6ac-df4e-4ba8-874d-1a5eb8e08754 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:26.807983 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c3c6ac-df4e-4ba8-874d-1a5eb8e08754 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:07:26.815921 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application [None req-c1c3c6ac-df4e-4ba8-874d-1a5eb8e08754 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 19:07:26.815921 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:07:26.815921 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:07:26.815921 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:07:26.815921 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:07:26.815921 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:07:26.815921 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:07:26.815921 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:07:26.815921 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:07:26.815921 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:07:26.815921 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:07:26.815921 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:07:26.815921 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:07:26.815921 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:07:26.815921 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:07:26.815921 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:07:26.817334 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:07:26.817334 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:07:26.817334 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:07:26.817334 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:07:26.817334 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:07:26.817334 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:07:26.817334 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:07:26.817334 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:07:26.817334 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:07:26.817334 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:07:26.817334 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:07:26.817334 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application with Lock( May 10 19:07:26.817334 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:07:26.817334 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._enter() May 10 19:07:26.817334 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:07:26.817334 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:07:26.818145 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:07:26.818145 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.creator() May 10 19:07:26.818145 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:07:26.818145 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application created_value = creator( May 10 19:07:26.818145 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:07:26.818145 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:07:26.818145 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:07:26.818145 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:07:26.818145 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:07:26.818145 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:07:26.818145 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 19:07:26.818145 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application May 10 19:07:26.818145 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 221/444] 10.222.0.70 () {56 vars in 1114 bytes} [Tue May 10 19:07:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:07:26.818806 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c3c6ac-df4e-4ba8-874d-1a5eb8e08754 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:26.839945 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 224/445] 10.222.0.70 () {58 vars in 1282 bytes} [Tue May 10 19:07:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 10 19:07:26.840722 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19034c23-97e3-4654-9da0-ac60856b1bc1 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:26.913870 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c3c6ac-df4e-4ba8-874d-1a5eb8e08754 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:26.930710 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19034c23-97e3-4654-9da0-ac60856b1bc1 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:26.944784 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d6da54-92a9-435f-96c4-b2916920ba68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:26.945638 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d6da54-92a9-435f-96c4-b2916920ba68 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:26.945924 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d6da54-92a9-435f-96c4-b2916920ba68 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:26.946198 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d6da54-92a9-435f-96c4-b2916920ba68 None admin] PATH_INFO: `/v3/groups/4a0804b8bd3d4a75ad8387c65b79ba3a` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:26.947359 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d6da54-92a9-435f-96c4-b2916920ba68 None admin] RBAC: Authorizing `identity:get_group(group_id=4a0804b8bd3d4a75ad8387c65b79ba3a)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:26.948880 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d6da54-92a9-435f-96c4-b2916920ba68 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:26.955285 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 222/446] 10.222.0.70 () {56 vars in 1180 bytes} [Tue May 10 19:07:26 2022] GET /identity/v3/groups/4a0804b8bd3d4a75ad8387c65b79ba3a => generated 226 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:07:26.955285 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d6da54-92a9-435f-96c4-b2916920ba68 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:26.968681 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9292bac-7098-4709-bd25-0a9f7d833f85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:26.969345 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9292bac-7098-4709-bd25-0a9f7d833f85 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:26.969626 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9292bac-7098-4709-bd25-0a9f7d833f85 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:26.969899 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9292bac-7098-4709-bd25-0a9f7d833f85 None admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:26.970638 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9292bac-7098-4709-bd25-0a9f7d833f85 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:07:26.970941 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9292bac-7098-4709-bd25-0a9f7d833f85 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:26.972299 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9292bac-7098-4709-bd25-0a9f7d833f85 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:26.979871 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 225/447] 10.222.0.70 () {56 vars in 1111 bytes} [Tue May 10 19:07:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:07:26.980997 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9292bac-7098-4709-bd25-0a9f7d833f85 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:27.044729 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d6da54-92a9-435f-96c4-b2916920ba68 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:27.071455 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9292bac-7098-4709-bd25-0a9f7d833f85 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:27.075965 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ecd13a-6812-4240-b7bb-31ba1ca0a237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:27.076862 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ecd13a-6812-4240-b7bb-31ba1ca0a237 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:27.077141 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ecd13a-6812-4240-b7bb-31ba1ca0a237 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:27.077411 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ecd13a-6812-4240-b7bb-31ba1ca0a237 None admin] PATH_INFO: `/v3/projects/a7c5828bc7be44a6adb3e9898a8f18d8` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:27.078572 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ecd13a-6812-4240-b7bb-31ba1ca0a237 None admin] RBAC: Authorizing `identity:get_project(project_id=a7c5828bc7be44a6adb3e9898a8f18d8)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:27.079996 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ecd13a-6812-4240-b7bb-31ba1ca0a237 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:27.081678 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 223/448] 10.222.0.70 () {56 vars in 1186 bytes} [Tue May 10 19:07:26 2022] GET /identity/v3/projects/a7c5828bc7be44a6adb3e9898a8f18d8 => generated 344 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:07:27.083265 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ecd13a-6812-4240-b7bb-31ba1ca0a237 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:27.105635 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a201de-eb72-40e4-8393-0c0f175a0b36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:27.106284 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a201de-eb72-40e4-8393-0c0f175a0b36 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:27.106572 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a201de-eb72-40e4-8393-0c0f175a0b36 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:27.106850 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a201de-eb72-40e4-8393-0c0f175a0b36 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:27.107673 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a201de-eb72-40e4-8393-0c0f175a0b36 None admin] RBAC: Adding query filter params (group.id=4a0804b8bd3d4a75ad8387c65b79ba3a, role.id=5c07cf5bfbd3427db18428aa50420962, scope.project.id=e0df39feccc3439b965b22d514a229be) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:07:27.107983 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a201de-eb72-40e4-8393-0c0f175a0b36 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:27.109476 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a201de-eb72-40e4-8393-0c0f175a0b36 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:27.115208 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 226/449] 10.222.0.70 () {56 vars in 1376 bytes} [Tue May 10 19:07:26 2022] GET /identity/v3/role_assignments?group.id=4a0804b8bd3d4a75ad8387c65b79ba3a&scope.project.id=e0df39feccc3439b965b22d514a229be&role.id=5c07cf5bfbd3427db18428aa50420962 => generated 611 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:07:27.115793 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a201de-eb72-40e4-8393-0c0f175a0b36 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:27.197057 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ecd13a-6812-4240-b7bb-31ba1ca0a237 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:27.223725 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a201de-eb72-40e4-8393-0c0f175a0b36 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:27.231430 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffbafbd-c5b4-4d9c-ad0e-3392df35febc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:27.232096 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffbafbd-c5b4-4d9c-ad0e-3392df35febc None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:27.232380 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffbafbd-c5b4-4d9c-ad0e-3392df35febc None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:27.232708 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffbafbd-c5b4-4d9c-ad0e-3392df35febc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:27.257678 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44e8546-5725-49c9-be79-471066936922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:27.258802 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44e8546-5725-49c9-be79-471066936922 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:27.259228 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44e8546-5725-49c9-be79-471066936922 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:27.259675 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44e8546-5725-49c9-be79-471066936922 None admin] PATH_INFO: `/v3/groups/754974433ea84f44829671eb58fe3a9c` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:27.261060 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44e8546-5725-49c9-be79-471066936922 None admin] RBAC: Authorizing `identity:get_group(group_id=754974433ea84f44829671eb58fe3a9c)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:27.262681 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44e8546-5725-49c9-be79-471066936922 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:27.264531 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 227/450] 10.222.0.70 () {56 vars in 1180 bytes} [Tue May 10 19:07:27 2022] GET /identity/v3/groups/754974433ea84f44829671eb58fe3a9c => generated 229 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:07:27.270912 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44e8546-5725-49c9-be79-471066936922 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:27.308563 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffbafbd-c5b4-4d9c-ad0e-3392df35febc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:27.310331 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffbafbd-c5b4-4d9c-ad0e-3392df35febc None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:27.385960 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44e8546-5725-49c9-be79-471066936922 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:27.420881 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 224/451] 10.222.0.70 () {58 vars in 1282 bytes} [Tue May 10 19:07:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 19:07:27.426112 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffbafbd-c5b4-4d9c-ad0e-3392df35febc None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:27.427115 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fe2163-f46b-422a-8a4c-a6e7603f8038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:27.427944 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fe2163-f46b-422a-8a4c-a6e7603f8038 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:27.428052 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fe2163-f46b-422a-8a4c-a6e7603f8038 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:27.428326 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fe2163-f46b-422a-8a4c-a6e7603f8038 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:27.429191 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fe2163-f46b-422a-8a4c-a6e7603f8038 None admin] RBAC: Adding query filter params (group.id=754974433ea84f44829671eb58fe3a9c, role.id=634ba284303b4626b5a0402772c68f5c, scope.project.id=a7c5828bc7be44a6adb3e9898a8f18d8) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:07:27.429505 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fe2163-f46b-422a-8a4c-a6e7603f8038 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:27.430952 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fe2163-f46b-422a-8a4c-a6e7603f8038 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:27.438518 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 228/452] 10.222.0.70 () {56 vars in 1376 bytes} [Tue May 10 19:07:27 2022] GET /identity/v3/role_assignments?group.id=754974433ea84f44829671eb58fe3a9c&scope.project.id=a7c5828bc7be44a6adb3e9898a8f18d8&role.id=634ba284303b4626b5a0402772c68f5c => generated 611 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:07:27.539150 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffbafbd-c5b4-4d9c-ad0e-3392df35febc None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:27.574069 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d1e1cf-1a51-4a1e-8a91-d7b6fc8e0dee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:27.574951 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d1e1cf-1a51-4a1e-8a91-d7b6fc8e0dee None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:27.575234 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d1e1cf-1a51-4a1e-8a91-d7b6fc8e0dee None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:27.575508 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d1e1cf-1a51-4a1e-8a91-d7b6fc8e0dee None admin] PATH_INFO: `/v3/projects/e0df39feccc3439b965b22d514a229be` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:27.576781 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d1e1cf-1a51-4a1e-8a91-d7b6fc8e0dee None admin] RBAC: Authorizing `identity:get_project(project_id=e0df39feccc3439b965b22d514a229be)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:27.578256 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d1e1cf-1a51-4a1e-8a91-d7b6fc8e0dee None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:27.580053 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 225/453] 10.222.0.70 () {56 vars in 1186 bytes} [Tue May 10 19:07:27 2022] GET /identity/v3/projects/e0df39feccc3439b965b22d514a229be => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:07:27.586163 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fe2163-f46b-422a-8a4c-a6e7603f8038 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:27.684740 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fe2163-f46b-422a-8a4c-a6e7603f8038 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:27.716147 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e710ca-d887-47b5-ac2b-0678d9128613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:27.717019 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e710ca-d887-47b5-ac2b-0678d9128613 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:27.717306 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e710ca-d887-47b5-ac2b-0678d9128613 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:27.717579 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e710ca-d887-47b5-ac2b-0678d9128613 None admin] PATH_INFO: `/v3/groups/4a0804b8bd3d4a75ad8387c65b79ba3a` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:27.718736 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e710ca-d887-47b5-ac2b-0678d9128613 None admin] RBAC: Authorizing `identity:get_group(group_id=4a0804b8bd3d4a75ad8387c65b79ba3a)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:27.720156 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e710ca-d887-47b5-ac2b-0678d9128613 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:27.721786 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 229/454] 10.222.0.70 () {56 vars in 1180 bytes} [Tue May 10 19:07:27 2022] GET /identity/v3/groups/4a0804b8bd3d4a75ad8387c65b79ba3a => generated 226 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:07:27.728180 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d1e1cf-1a51-4a1e-8a91-d7b6fc8e0dee None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:27.820287 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d1e1cf-1a51-4a1e-8a91-d7b6fc8e0dee None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:27.852139 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab38207d-5bf1-4053-b934-5f5add2e2d11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:27.852799 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab38207d-5bf1-4053-b934-5f5add2e2d11 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:27.853084 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab38207d-5bf1-4053-b934-5f5add2e2d11 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:27.853359 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab38207d-5bf1-4053-b934-5f5add2e2d11 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:27.854169 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab38207d-5bf1-4053-b934-5f5add2e2d11 None admin] RBAC: Adding query filter params (group.id=4a0804b8bd3d4a75ad8387c65b79ba3a, role.id=49187695e1bf4c15980bb68c83ca61de, scope.project.id=e0df39feccc3439b965b22d514a229be) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:07:27.854483 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab38207d-5bf1-4053-b934-5f5add2e2d11 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:27.855895 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab38207d-5bf1-4053-b934-5f5add2e2d11 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:27.861393 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 226/455] 10.222.0.70 () {56 vars in 1376 bytes} [Tue May 10 19:07:27 2022] GET /identity/v3/role_assignments?group.id=4a0804b8bd3d4a75ad8387c65b79ba3a&scope.project.id=e0df39feccc3439b965b22d514a229be&role.id=49187695e1bf4c15980bb68c83ca61de => generated 611 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:07:30.754605 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5b9ccf-6b79-4ae0-b078-42c39fd025a0 None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:30.755269 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5b9ccf-6b79-4ae0-b078-42c39fd025a0 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:30.755269 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5b9ccf-6b79-4ae0-b078-42c39fd025a0 None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:30.756835 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 230/456] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:07:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:07:30.761853 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eaf164-2ffd-4cc6-ae6e-be1f3e830ccb None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:30.762270 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eaf164-2ffd-4cc6-ae6e-be1f3e830ccb None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:30.762420 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eaf164-2ffd-4cc6-ae6e-be1f3e830ccb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:30.786089 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-e2eaf164-2ffd-4cc6-ae6e-be1f3e830ccb None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:07:30.787582 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-e2eaf164-2ffd-4cc6-ae6e-be1f3e830ccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:07:30.879412 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 227/457] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:07:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 19:07:30.920458 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5b9ccf-6b79-4ae0-b078-42c39fd025a0 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:31.033495 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa90aa3-5b50-4dbd-96a1-556c5fb7e31d None None] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:31.034121 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa90aa3-5b50-4dbd-96a1-556c5fb7e31d None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:31.034611 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa90aa3-5b50-4dbd-96a1-556c5fb7e31d None None] PATH_INFO: `/` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:31.037526 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 228/458] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:07:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 19:07:31.041222 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee76de48-bda0-4941-a12f-01befb410e8b None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:31.041752 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee76de48-bda0-4941-a12f-01befb410e8b None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:31.042235 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee76de48-bda0-4941-a12f-01befb410e8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:31.058775 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5b9ccf-6b79-4ae0-b078-42c39fd025a0 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:31.075199 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-ee76de48-bda0-4941-a12f-01befb410e8b None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:07:31.076743 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-ee76de48-bda0-4941-a12f-01befb410e8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:07:31.092171 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e2b8f0-38aa-4af9-88ea-200f9a543445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:31.093233 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e2b8f0-38aa-4af9-88ea-200f9a543445 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:31.093740 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e2b8f0-38aa-4af9-88ea-200f9a543445 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:31.094204 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e2b8f0-38aa-4af9-88ea-200f9a543445 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:31.105335 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e2b8f0-38aa-4af9-88ea-200f9a543445 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:31.107057 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e2b8f0-38aa-4af9-88ea-200f9a543445 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:31.124474 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-21e2b8f0-38aa-4af9-88ea-200f9a543445 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:07:31.124474 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:07:31.124474 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:07:31.124474 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:07:31.124474 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:07:31.124474 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:07:31.124474 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:07:31.124474 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:07:31.124474 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:07:31.124474 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:07:31.124474 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:07:31.124474 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:07:31.124474 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 19:07:31.124474 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 19:07:31.124474 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 19:07:31.125374 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 19:07:31.125374 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:07:31.125374 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:07:31.125374 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:07:31.125374 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:07:31.125374 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:07:31.125374 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:07:31.125374 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:07:31.125374 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( May 10 19:07:31.125374 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:07:31.125374 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() May 10 19:07:31.125374 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:07:31.125374 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:07:31.125374 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:07:31.125374 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() May 10 19:07:31.125374 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:07:31.125374 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( May 10 19:07:31.126252 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 19:07:31.126252 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 19:07:31.126252 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:07:31.126252 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:07:31.128433 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 231/459] 10.222.0.70 () {56 vars in 1108 bytes} [Tue May 10 19:07:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:07:31.133990 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e2b8f0-38aa-4af9-88ea-200f9a543445 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:31.181560 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 229/460] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:07:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 19:07:31.183213 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ef3b80-15bb-48c0-8cde-51678bc5584b None None] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:31.183661 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ef3b80-15bb-48c0-8cde-51678bc5584b None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:31.184095 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ef3b80-15bb-48c0-8cde-51678bc5584b None None] PATH_INFO: `/` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:31.185581 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 230/461] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:07:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:07:31.195924 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa79a5d-3395-4360-8c7f-bc46c2feada0 None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:31.195924 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa79a5d-3395-4360-8c7f-bc46c2feada0 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:31.195924 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa79a5d-3395-4360-8c7f-bc46c2feada0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:31.219633 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-bfa79a5d-3395-4360-8c7f-bc46c2feada0 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:07:31.220860 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-bfa79a5d-3395-4360-8c7f-bc46c2feada0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:07:31.266692 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e2b8f0-38aa-4af9-88ea-200f9a543445 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:31.288387 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 231/462] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:07:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 19:07:31.289533 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa79a5d-3395-4360-8c7f-bc46c2feada0 None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:31.313959 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384fd12e-8a68-4870-8fc6-3f57062590d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:31.314634 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384fd12e-8a68-4870-8fc6-3f57062590d5 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:31.314912 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384fd12e-8a68-4870-8fc6-3f57062590d5 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:31.315182 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384fd12e-8a68-4870-8fc6-3f57062590d5 None admin] PATH_INFO: `/v3/domains` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:31.315962 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384fd12e-8a68-4870-8fc6-3f57062590d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:07:31.316764 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384fd12e-8a68-4870-8fc6-3f57062590d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:31.318129 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384fd12e-8a68-4870-8fc6-3f57062590d5 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:31.341053 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 232/463] 10.222.0.70 () {56 vars in 1109 bytes} [Tue May 10 19:07:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:07:31.341724 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384fd12e-8a68-4870-8fc6-3f57062590d5 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:31.394796 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa79a5d-3395-4360-8c7f-bc46c2feada0 None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:31.429318 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa0daf7-a136-4c13-8fe7-4b119f4c4831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:31.430121 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa0daf7-a136-4c13-8fe7-4b119f4c4831 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:31.430410 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa0daf7-a136-4c13-8fe7-4b119f4c4831 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:31.430689 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa0daf7-a136-4c13-8fe7-4b119f4c4831 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:31.438591 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384fd12e-8a68-4870-8fc6-3f57062590d5 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:31.440816 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa0daf7-a136-4c13-8fe7-4b119f4c4831 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:31.442388 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa0daf7-a136-4c13-8fe7-4b119f4c4831 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:31.459812 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application [None req-faa0daf7-a136-4c13-8fe7-4b119f4c4831 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:07:31.459812 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:07:31.459812 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:07:31.459812 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:07:31.459812 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:07:31.459812 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:07:31.459812 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:07:31.459812 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:07:31.459812 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:07:31.459812 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:07:31.459812 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:07:31.459812 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:07:31.459812 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 19:07:31.459812 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 19:07:31.459812 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 19:07:31.460765 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 19:07:31.460765 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:07:31.460765 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:07:31.460765 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:07:31.460765 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:07:31.460765 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:07:31.460765 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:07:31.460765 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:07:31.460765 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application with Lock( May 10 19:07:31.460765 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:07:31.460765 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._enter() May 10 19:07:31.460765 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:07:31.460765 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:07:31.460765 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:07:31.460765 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.creator() May 10 19:07:31.460765 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:07:31.460765 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application created_value = creator( May 10 19:07:31.466590 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 19:07:31.466590 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 19:07:31.466590 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:07:31.466590 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application May 10 19:07:31.466590 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 232/464] 10.222.0.70 () {56 vars in 1108 bytes} [Tue May 10 19:07:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:07:31.466590 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa0daf7-a136-4c13-8fe7-4b119f4c4831 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:31.473888 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a433fe48-84ab-41cf-bb85-07a0981cb7ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:31.475104 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a433fe48-84ab-41cf-bb85-07a0981cb7ff None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:31.475383 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a433fe48-84ab-41cf-bb85-07a0981cb7ff None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:31.475649 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a433fe48-84ab-41cf-bb85-07a0981cb7ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:31.487284 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a433fe48-84ab-41cf-bb85-07a0981cb7ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:31.488857 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a433fe48-84ab-41cf-bb85-07a0981cb7ff None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:31.507078 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-a433fe48-84ab-41cf-bb85-07a0981cb7ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:07:31.507078 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:07:31.507078 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:07:31.507078 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:07:31.507078 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:07:31.507078 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:07:31.507078 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:07:31.507078 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:07:31.507078 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:07:31.507078 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:07:31.507078 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:07:31.507078 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:07:31.507078 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 19:07:31.507078 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 19:07:31.507078 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 19:07:31.508016 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 19:07:31.508016 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:07:31.508016 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:07:31.508016 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:07:31.508016 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:07:31.508016 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:07:31.508016 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:07:31.508016 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:07:31.508016 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( May 10 19:07:31.508016 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:07:31.508016 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() May 10 19:07:31.508016 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:07:31.508016 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:07:31.508016 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:07:31.508016 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() May 10 19:07:31.508016 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:07:31.508016 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( May 10 19:07:31.508917 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 19:07:31.508917 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 19:07:31.508917 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:07:31.508917 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:07:31.508917 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 233/465] 10.222.0.70 () {56 vars in 1108 bytes} [Tue May 10 19:07:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:07:31.509951 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1732ed9f-3ee0-49f3-ac6e-25bbb3633759 None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:31.510240 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1732ed9f-3ee0-49f3-ac6e-25bbb3633759 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:31.510517 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1732ed9f-3ee0-49f3-ac6e-25bbb3633759 None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:31.516028 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 234/466] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:07:31 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:07:31.516738 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1732ed9f-3ee0-49f3-ac6e-25bbb3633759 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:31.574209 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa0daf7-a136-4c13-8fe7-4b119f4c4831 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:31.613715 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdc0aaf-377c-43c1-ae67-6f56b7ea5ebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:31.614773 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdc0aaf-377c-43c1-ae67-6f56b7ea5ebd None admin] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:31.615252 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdc0aaf-377c-43c1-ae67-6f56b7ea5ebd None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:31.615723 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdc0aaf-377c-43c1-ae67-6f56b7ea5ebd None admin] PATH_INFO: `/v3/users` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:31.616631 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdc0aaf-377c-43c1-ae67-6f56b7ea5ebd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:31.618262 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdc0aaf-377c-43c1-ae67-6f56b7ea5ebd None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:31.618428 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1732ed9f-3ee0-49f3-ac6e-25bbb3633759 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:31.640956 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 233/467] 10.222.0.70 () {60 vars in 1132 bytes} [Tue May 10 19:07:31 2022] POST /identity/v3/users => generated 246 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:07:31.642200 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdc0aaf-377c-43c1-ae67-6f56b7ea5ebd None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:31.655956 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bacca2-6585-4209-9aed-2ea2f78f32e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:31.656723 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bacca2-6585-4209-9aed-2ea2f78f32e9 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:31.656964 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bacca2-6585-4209-9aed-2ea2f78f32e9 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:31.657237 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bacca2-6585-4209-9aed-2ea2f78f32e9 None admin] PATH_INFO: `/v3/domains` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:31.657981 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bacca2-6585-4209-9aed-2ea2f78f32e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:07:31.658282 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bacca2-6585-4209-9aed-2ea2f78f32e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:31.659718 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bacca2-6585-4209-9aed-2ea2f78f32e9 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:31.673573 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 235/468] 10.222.0.70 () {56 vars in 1109 bytes} [Tue May 10 19:07:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:07:31.674819 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e3c8d4-ca2d-4228-9f5d-ba12b7892cb5 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:31.675200 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e3c8d4-ca2d-4228-9f5d-ba12b7892cb5 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:31.675426 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e3c8d4-ca2d-4228-9f5d-ba12b7892cb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:31.693816 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-f4e3c8d4-ca2d-4228-9f5d-ba12b7892cb5 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:07:31.695120 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-f4e3c8d4-ca2d-4228-9f5d-ba12b7892cb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:07:31.776855 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdc0aaf-377c-43c1-ae67-6f56b7ea5ebd None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:31.782048 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 236/469] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:07:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 19:07:31.783103 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e3c8d4-ca2d-4228-9f5d-ba12b7892cb5 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:31.825298 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7ca2d9-c4f0-4192-b4f2-af932b6b2ff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:31.826386 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7ca2d9-c4f0-4192-b4f2-af932b6b2ff7 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:31.826877 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7ca2d9-c4f0-4192-b4f2-af932b6b2ff7 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:31.827343 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7ca2d9-c4f0-4192-b4f2-af932b6b2ff7 None admin] PATH_INFO: `/v3/domains` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:31.828257 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7ca2d9-c4f0-4192-b4f2-af932b6b2ff7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:07:31.828776 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7ca2d9-c4f0-4192-b4f2-af932b6b2ff7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:31.830392 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7ca2d9-c4f0-4192-b4f2-af932b6b2ff7 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:31.849868 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 234/470] 10.222.0.70 () {56 vars in 1109 bytes} [Tue May 10 19:07:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:07:31.851077 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7ca2d9-c4f0-4192-b4f2-af932b6b2ff7 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:31.904708 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e3c8d4-ca2d-4228-9f5d-ba12b7892cb5 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:31.938534 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d15b7c0-b509-447d-8b67-edd86fe7b1c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:31.939565 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d15b7c0-b509-447d-8b67-edd86fe7b1c2 None admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:31.940057 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d15b7c0-b509-447d-8b67-edd86fe7b1c2 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:31.940567 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d15b7c0-b509-447d-8b67-edd86fe7b1c2 None admin] PATH_INFO: `/v3/users` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:31.942037 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d15b7c0-b509-447d-8b67-edd86fe7b1c2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:31.943687 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d15b7c0-b509-447d-8b67-edd86fe7b1c2 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:31.962701 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7ca2d9-c4f0-4192-b4f2-af932b6b2ff7 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:31.967531 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 237/471] 10.222.0.70 () {60 vars in 1132 bytes} [Tue May 10 19:07:31 2022] POST /identity/v3/users => generated 248 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:07:31.968457 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d15b7c0-b509-447d-8b67-edd86fe7b1c2 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:31.999707 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc4b352-270e-46f8-b334-66ebef8981dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:32.000849 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc4b352-270e-46f8-b334-66ebef8981dd None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:32.001286 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc4b352-270e-46f8-b334-66ebef8981dd None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:32.001721 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc4b352-270e-46f8-b334-66ebef8981dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:32.013602 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc4b352-270e-46f8-b334-66ebef8981dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:32.015465 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc4b352-270e-46f8-b334-66ebef8981dd None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:32.036023 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application [None req-3dc4b352-270e-46f8-b334-66ebef8981dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:07:32.036023 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:07:32.036023 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:07:32.036023 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:07:32.036023 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:07:32.036023 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:07:32.036023 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:07:32.036023 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:07:32.036023 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:07:32.036023 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:07:32.036023 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:07:32.036023 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:07:32.036023 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 19:07:32.036023 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 19:07:32.036023 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 19:07:32.037009 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 19:07:32.037009 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:07:32.037009 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:07:32.037009 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:07:32.037009 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:07:32.037009 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:07:32.037009 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:07:32.037009 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:07:32.037009 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application with Lock( May 10 19:07:32.037009 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:07:32.037009 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._enter() May 10 19:07:32.037009 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:07:32.037009 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:07:32.037009 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:07:32.037009 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.creator() May 10 19:07:32.037009 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:07:32.037009 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application created_value = creator( May 10 19:07:32.037886 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 19:07:32.037886 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 19:07:32.037886 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:07:32.037886 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application May 10 19:07:32.040055 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 235/472] 10.222.0.70 () {56 vars in 1108 bytes} [Tue May 10 19:07:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:07:32.041685 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c99e33-603a-436a-ad8e-ec3c79631b44 None None] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:32.042195 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c99e33-603a-436a-ad8e-ec3c79631b44 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:32.042791 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c99e33-603a-436a-ad8e-ec3c79631b44 None None] PATH_INFO: `/` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:32.044716 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 236/473] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:07:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:07:32.047176 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c99e33-603a-436a-ad8e-ec3c79631b44 None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:32.084156 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d15b7c0-b509-447d-8b67-edd86fe7b1c2 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:32.120350 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c6f511-1417-4049-a80c-639f4eb7ce6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:32.121424 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c6f511-1417-4049-a80c-639f4eb7ce6d None admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:32.121424 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c6f511-1417-4049-a80c-639f4eb7ce6d None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:32.121615 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c6f511-1417-4049-a80c-639f4eb7ce6d None admin] PATH_INFO: `/v3/users` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:32.122321 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c6f511-1417-4049-a80c-639f4eb7ce6d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:32.123788 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c6f511-1417-4049-a80c-639f4eb7ce6d None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:32.151449 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 238/474] 10.222.0.70 () {60 vars in 1132 bytes} [Tue May 10 19:07:31 2022] POST /identity/v3/users => generated 248 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:07:32.156569 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb24623b-d446-43fa-954f-57f2233f98e0 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:32.156569 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb24623b-d446-43fa-954f-57f2233f98e0 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:32.156569 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb24623b-d446-43fa-954f-57f2233f98e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:32.183308 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c99e33-603a-436a-ad8e-ec3c79631b44 None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:32.183692 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-cb24623b-d446-43fa-954f-57f2233f98e0 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:07:32.185212 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-cb24623b-d446-43fa-954f-57f2233f98e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:07:32.230371 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da355c66-334d-4394-acd0-eb97a114dc7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:32.231101 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da355c66-334d-4394-acd0-eb97a114dc7b None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:32.231380 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da355c66-334d-4394-acd0-eb97a114dc7b None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:32.231657 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da355c66-334d-4394-acd0-eb97a114dc7b None admin] PATH_INFO: `/v3/domains` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:32.232448 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da355c66-334d-4394-acd0-eb97a114dc7b None admin] RBAC: Adding query filter params (name=Default) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:07:32.232789 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da355c66-334d-4394-acd0-eb97a114dc7b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:32.234188 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da355c66-334d-4394-acd0-eb97a114dc7b None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:32.251046 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 237/475] 10.222.0.70 () {56 vars in 1109 bytes} [Tue May 10 19:07:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:07:32.256591 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da355c66-334d-4394-acd0-eb97a114dc7b None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:32.283953 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 239/476] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:07:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 19:07:32.308515 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb24623b-d446-43fa-954f-57f2233f98e0 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:32.377857 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da355c66-334d-4394-acd0-eb97a114dc7b None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:32.421072 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb24623b-d446-43fa-954f-57f2233f98e0 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:32.421577 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d6d96c-b672-4041-a897-3ed83e57a5d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:32.422252 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d6d96c-b672-4041-a897-3ed83e57a5d5 None admin] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:32.422533 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d6d96c-b672-4041-a897-3ed83e57a5d5 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:32.422806 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d6d96c-b672-4041-a897-3ed83e57a5d5 None admin] PATH_INFO: `/v3/users` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:32.423507 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d6d96c-b672-4041-a897-3ed83e57a5d5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:32.426513 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d6d96c-b672-4041-a897-3ed83e57a5d5 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:32.458700 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 238/477] 10.222.0.70 () {60 vars in 1132 bytes} [Tue May 10 19:07:32 2022] POST /identity/v3/users => generated 249 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 19:07:32.466277 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65290ae2-b13f-458b-9948-4d2b27c17543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:32.467042 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65290ae2-b13f-458b-9948-4d2b27c17543 None admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:32.467329 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65290ae2-b13f-458b-9948-4d2b27c17543 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:32.467607 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65290ae2-b13f-458b-9948-4d2b27c17543 None admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:32.468537 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65290ae2-b13f-458b-9948-4d2b27c17543 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:32.470012 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65290ae2-b13f-458b-9948-4d2b27c17543 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:32.489675 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.sql.core [None req-65290ae2-b13f-458b-9948-4d2b27c17543 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 10 19:07:32.489675 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 10 19:07:32.489675 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [parameters: {'id': '2ac0bdf60bc24b92af01819c7f30ef8f', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 10 19:07:32.489675 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79994) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 10 19:07:32.506475 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-65290ae2-b13f-458b-9948-4d2b27c17543 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 10 19:07:32.506475 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:07:32.506475 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 10 19:07:32.506475 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application self.dialect.do_execute( May 10 19:07:32.506475 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 10 19:07:32.506475 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 10 19:07:32.506475 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 10 19:07:32.506475 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application result = self._query(query) May 10 19:07:32.506475 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 10 19:07:32.506475 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application conn.query(q) May 10 19:07:32.506475 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 10 19:07:32.506475 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 10 19:07:32.506475 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 10 19:07:32.506475 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application result.read() May 10 19:07:32.506475 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 10 19:07:32.507498 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 10 19:07:32.507498 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 10 19:07:32.507498 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application packet.raise_for_error() May 10 19:07:32.507498 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 10 19:07:32.507498 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 10 19:07:32.507498 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 10 19:07:32.507498 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 10 19:07:32.507498 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 10 19:07:32.507498 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:07:32.507498 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 10 19:07:32.507498 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:07:32.507498 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:07:32.507498 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 10 19:07:32.507498 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 10 19:07:32.507498 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role May 10 19:07:32.507498 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return ref.to_dict() May 10 19:07:32.507498 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 10 19:07:32.507498 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application next(self.gen) May 10 19:07:32.508532 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 10 19:07:32.508532 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application yield resource May 10 19:07:32.508532 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 10 19:07:32.508532 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application next(self.gen) May 10 19:07:32.508532 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 10 19:07:32.508532 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application self.session.rollback() May 10 19:07:32.508532 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 10 19:07:32.508532 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application self.force_reraise() May 10 19:07:32.508532 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 10 19:07:32.508532 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise self.value May 10 19:07:32.508532 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 10 19:07:32.508532 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 10 19:07:32.508532 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 10 19:07:32.508532 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application session.commit() May 10 19:07:32.508532 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 10 19:07:32.508532 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 10 19:07:32.508532 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 10 19:07:32.510319 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application self._prepare_impl() May 10 19:07:32.510319 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 10 19:07:32.510319 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application self.session.flush() May 10 19:07:32.510319 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 10 19:07:32.510319 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application self._flush(objects) May 10 19:07:32.510319 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 10 19:07:32.510319 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 10 19:07:32.510319 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 10 19:07:32.510319 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application compat.raise_( May 10 19:07:32.510319 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 10 19:07:32.510319 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception May 10 19:07:32.510319 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 10 19:07:32.510319 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application flush_context.execute() May 10 19:07:32.510319 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 10 19:07:32.510319 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rec.execute(self) May 10 19:07:32.510319 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 10 19:07:32.510319 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 10 19:07:32.512975 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 10 19:07:32.512975 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application _emit_insert_statements( May 10 19:07:32.512975 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 10 19:07:32.512975 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application c = connection._execute_20( May 10 19:07:32.512975 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 10 19:07:32.512975 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 10 19:07:32.512975 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 10 19:07:32.512975 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 10 19:07:32.512975 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 10 19:07:32.512975 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ret = self._execute_context( May 10 19:07:32.512975 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 10 19:07:32.512975 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 10 19:07:32.512975 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 10 19:07:32.512975 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 10 19:07:32.512975 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 10 19:07:32.512975 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception May 10 19:07:32.515095 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 10 19:07:32.515095 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application self.dialect.do_execute( May 10 19:07:32.515095 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 10 19:07:32.515095 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 10 19:07:32.515095 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 10 19:07:32.515095 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application result = self._query(query) May 10 19:07:32.515095 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 10 19:07:32.515095 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application conn.query(q) May 10 19:07:32.515095 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 10 19:07:32.515095 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 10 19:07:32.515095 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 10 19:07:32.515095 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application result.read() May 10 19:07:32.515095 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 10 19:07:32.515095 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 10 19:07:32.515095 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 10 19:07:32.515095 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application packet.raise_for_error() May 10 19:07:32.517106 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 10 19:07:32.517106 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 10 19:07:32.517106 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 10 19:07:32.517106 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 10 19:07:32.517106 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 10 19:07:32.517106 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 10 19:07:32.517106 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [parameters: {'id': '2ac0bdf60bc24b92af01819c7f30ef8f', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 10 19:07:32.517106 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 10 19:07:32.517106 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:07:32.517106 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 19:07:32.517106 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:07:32.517106 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:07:32.517106 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:07:32.517106 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:07:32.517106 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:07:32.517106 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:07:32.523212 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:07:32.523212 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:07:32.523212 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:07:32.523212 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:07:32.523212 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:07:32.523212 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:07:32.523212 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post May 10 19:07:32.523212 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( May 10 19:07:32.523212 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:07:32.523212 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:07:32.523212 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role May 10 19:07:32.523212 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) May 10 19:07:32.523212 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 10 19:07:32.523212 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 10 19:07:32.523212 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 10 19:07:32.523212 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:07:32.529537 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 240/478] 10.222.0.70 () {60 vars in 1131 bytes} [Tue May 10 19:07:32 2022] POST /identity/v3/roles => generated 144 bytes in 200 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 10 19:07:32.529678 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d6d96c-b672-4041-a897-3ed83e57a5d5 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:32.628403 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d6d96c-b672-4041-a897-3ed83e57a5d5 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:32.664005 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afded902-18ae-4ede-a1bc-4e6bdf793ddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:32.664859 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afded902-18ae-4ede-a1bc-4e6bdf793ddc None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:32.665146 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afded902-18ae-4ede-a1bc-4e6bdf793ddc None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:32.665423 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afded902-18ae-4ede-a1bc-4e6bdf793ddc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:32.676753 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afded902-18ae-4ede-a1bc-4e6bdf793ddc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:07:32.685018 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application [None req-afded902-18ae-4ede-a1bc-4e6bdf793ddc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 19:07:32.685018 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:07:32.685018 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:07:32.685018 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:07:32.685018 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:07:32.685018 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:07:32.685018 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:07:32.685018 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:07:32.685018 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:07:32.685018 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:07:32.685018 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:07:32.685018 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:07:32.685018 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:07:32.685018 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:07:32.685018 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:07:32.685018 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:07:32.687186 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:07:32.687186 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:07:32.687186 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:07:32.687186 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:07:32.687186 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:07:32.687186 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:07:32.687186 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:07:32.687186 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:07:32.687186 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:07:32.687186 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:07:32.687186 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:07:32.687186 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application with Lock( May 10 19:07:32.687186 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:07:32.687186 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._enter() May 10 19:07:32.687186 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:07:32.687186 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:07:32.689137 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:07:32.689137 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.creator() May 10 19:07:32.689137 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:07:32.689137 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application created_value = creator( May 10 19:07:32.689137 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:07:32.689137 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:07:32.689137 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:07:32.689137 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:07:32.689137 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:07:32.689137 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:07:32.689137 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 19:07:32.689137 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application May 10 19:07:32.689137 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 239/479] 10.222.0.70 () {56 vars in 1114 bytes} [Tue May 10 19:07:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:07:32.694075 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65290ae2-b13f-458b-9948-4d2b27c17543 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:32.825693 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65290ae2-b13f-458b-9948-4d2b27c17543 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:32.861568 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ec7307-9ccf-4edd-bf09-d1de71b63eb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:32.862237 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ec7307-9ccf-4edd-bf09-d1de71b63eb2 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:32.862521 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ec7307-9ccf-4edd-bf09-d1de71b63eb2 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:32.862795 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ec7307-9ccf-4edd-bf09-d1de71b63eb2 None admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:32.864161 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ec7307-9ccf-4edd-bf09-d1de71b63eb2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:07:32.864494 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ec7307-9ccf-4edd-bf09-d1de71b63eb2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:32.865875 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ec7307-9ccf-4edd-bf09-d1de71b63eb2 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:32.874367 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 241/480] 10.222.0.70 () {56 vars in 1111 bytes} [Tue May 10 19:07:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:07:34.303081 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eefa09-c093-413e-ba8a-c8518f29171b None None] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:34.303560 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eefa09-c093-413e-ba8a-c8518f29171b None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:34.303560 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eefa09-c093-413e-ba8a-c8518f29171b None None] PATH_INFO: `/` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:34.305209 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 240/481] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:07:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:07:34.310639 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28862405-467a-4eda-97da-82baf6c4c364 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:34.311127 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28862405-467a-4eda-97da-82baf6c4c364 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:34.311276 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28862405-467a-4eda-97da-82baf6c4c364 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:34.334508 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-28862405-467a-4eda-97da-82baf6c4c364 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:07:34.335990 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-28862405-467a-4eda-97da-82baf6c4c364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:07:34.402494 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 242/482] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:07:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 19:07:34.425363 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eefa09-c093-413e-ba8a-c8518f29171b None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:34.527699 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eefa09-c093-413e-ba8a-c8518f29171b None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:34.563733 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c199356-6c9f-4a01-8ff4-18516a24cfc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:34.564893 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c199356-6c9f-4a01-8ff4-18516a24cfc2 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:34.565372 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c199356-6c9f-4a01-8ff4-18516a24cfc2 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:34.565856 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c199356-6c9f-4a01-8ff4-18516a24cfc2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:34.576583 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c199356-6c9f-4a01-8ff4-18516a24cfc2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:07:34.585240 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application [None req-6c199356-6c9f-4a01-8ff4-18516a24cfc2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 19:07:34.585240 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:07:34.585240 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:07:34.585240 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:07:34.585240 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:07:34.585240 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:07:34.585240 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:07:34.585240 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:07:34.585240 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:07:34.585240 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:07:34.585240 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:07:34.585240 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:07:34.585240 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:07:34.585240 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:07:34.585240 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:07:34.585240 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:07:34.586151 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:07:34.586151 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:07:34.586151 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:07:34.586151 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:07:34.586151 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:07:34.586151 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:07:34.586151 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:07:34.586151 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:07:34.586151 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:07:34.586151 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:07:34.586151 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:07:34.586151 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application with Lock( May 10 19:07:34.586151 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:07:34.586151 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._enter() May 10 19:07:34.586151 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:07:34.586151 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:07:34.586953 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:07:34.586953 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.creator() May 10 19:07:34.586953 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:07:34.586953 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application created_value = creator( May 10 19:07:34.586953 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:07:34.586953 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:07:34.586953 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:07:34.586953 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:07:34.586953 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:07:34.586953 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:07:34.586953 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 19:07:34.586953 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application May 10 19:07:34.589669 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 241/483] 10.222.0.70 () {56 vars in 1102 bytes} [Tue May 10 19:07:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:07:34.595685 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28862405-467a-4eda-97da-82baf6c4c364 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:34.702164 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28862405-467a-4eda-97da-82baf6c4c364 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:34.738344 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e9e109-06b7-4c60-a7d5-d5fc9f787cf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:34.739412 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e9e109-06b7-4c60-a7d5-d5fc9f787cf0 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:34.739885 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e9e109-06b7-4c60-a7d5-d5fc9f787cf0 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:34.740362 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e9e109-06b7-4c60-a7d5-d5fc9f787cf0 None admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:34.741328 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e9e109-06b7-4c60-a7d5-d5fc9f787cf0 None admin] RBAC: Adding query filter params (name=service) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:07:34.741824 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e9e109-06b7-4c60-a7d5-d5fc9f787cf0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:34.743373 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e9e109-06b7-4c60-a7d5-d5fc9f787cf0 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:34.752369 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 243/484] 10.222.0.70 () {56 vars in 1103 bytes} [Tue May 10 19:07:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:07:34.757433 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c199356-6c9f-4a01-8ff4-18516a24cfc2 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:34.859485 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee427d8-932e-44ff-829d-140bc4a4fe56 None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:34.859775 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee427d8-932e-44ff-829d-140bc4a4fe56 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:34.859972 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee427d8-932e-44ff-829d-140bc4a4fe56 None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:34.860176 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c199356-6c9f-4a01-8ff4-18516a24cfc2 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:34.861655 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 244/485] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:07:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:07:34.867255 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db7f8e0-a9a0-4718-9486-6bd1e7ca315f None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:34.867545 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db7f8e0-a9a0-4718-9486-6bd1e7ca315f None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:34.867829 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db7f8e0-a9a0-4718-9486-6bd1e7ca315f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:34.885000 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-0db7f8e0-a9a0-4718-9486-6bd1e7ca315f None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:07:34.886181 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-0db7f8e0-a9a0-4718-9486-6bd1e7ca315f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:07:34.909338 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528c2032-e8be-445a-8186-f26d77cf72d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:34.910261 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528c2032-e8be-445a-8186-f26d77cf72d4 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:34.910540 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528c2032-e8be-445a-8186-f26d77cf72d4 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:34.910810 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528c2032-e8be-445a-8186-f26d77cf72d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:34.921167 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528c2032-e8be-445a-8186-f26d77cf72d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:34.922643 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528c2032-e8be-445a-8186-f26d77cf72d4 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:34.939532 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application [None req-528c2032-e8be-445a-8186-f26d77cf72d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:07:34.939532 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:07:34.939532 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:07:34.939532 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:07:34.939532 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:07:34.939532 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:07:34.939532 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:07:34.939532 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:07:34.939532 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:07:34.939532 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:07:34.939532 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:07:34.939532 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:07:34.939532 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 19:07:34.939532 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 19:07:34.939532 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 19:07:34.940500 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 19:07:34.940500 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:07:34.940500 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:07:34.940500 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:07:34.940500 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:07:34.940500 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:07:34.940500 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:07:34.940500 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:07:34.940500 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application with Lock( May 10 19:07:34.940500 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:07:34.940500 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._enter() May 10 19:07:34.940500 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:07:34.940500 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:07:34.940500 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:07:34.940500 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.creator() May 10 19:07:34.940500 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:07:34.940500 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application created_value = creator( May 10 19:07:34.941938 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 19:07:34.941938 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 19:07:34.941938 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:07:34.941938 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application May 10 19:07:34.941938 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 242/486] 10.222.0.70 () {56 vars in 1108 bytes} [Tue May 10 19:07:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 19:07:34.942787 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9e91dd-1ad6-42a9-964e-f67df002e4b1 None None] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:34.943070 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9e91dd-1ad6-42a9-964e-f67df002e4b1 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:34.943344 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9e91dd-1ad6-42a9-964e-f67df002e4b1 None None] PATH_INFO: `/` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:34.946509 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 243/487] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:07:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:07:34.956541 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d1e082-2685-4059-9d1d-96fba6c864a3 None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:34.956541 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d1e082-2685-4059-9d1d-96fba6c864a3 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:34.956541 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d1e082-2685-4059-9d1d-96fba6c864a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:34.964887 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 245/488] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:07:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 19:07:34.965671 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db7f8e0-a9a0-4718-9486-6bd1e7ca315f None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:34.977286 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-52d1e082-2685-4059-9d1d-96fba6c864a3 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:07:34.978644 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-52d1e082-2685-4059-9d1d-96fba6c864a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:07:35.043924 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 244/489] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:07:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 19:07:35.053184 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d1e082-2685-4059-9d1d-96fba6c864a3 None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:35.088199 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db7f8e0-a9a0-4718-9486-6bd1e7ca315f None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:35.126344 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3c4ca0-a1ce-4c7b-825b-a857be6ac26d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:35.127049 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3c4ca0-a1ce-4c7b-825b-a857be6ac26d None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:35.127397 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3c4ca0-a1ce-4c7b-825b-a857be6ac26d None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:35.127958 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3c4ca0-a1ce-4c7b-825b-a857be6ac26d None admin] PATH_INFO: `/v3/domains` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:35.129085 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3c4ca0-a1ce-4c7b-825b-a857be6ac26d None admin] RBAC: Adding query filter params (name=Default) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:07:35.129471 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3c4ca0-a1ce-4c7b-825b-a857be6ac26d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:35.130878 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3c4ca0-a1ce-4c7b-825b-a857be6ac26d None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:35.146330 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 246/490] 10.222.0.70 () {56 vars in 1109 bytes} [Tue May 10 19:07:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:07:35.146330 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3c4ca0-a1ce-4c7b-825b-a857be6ac26d None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:35.187604 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d1e082-2685-4059-9d1d-96fba6c864a3 None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:35.230937 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef91a09e-4e3e-404c-836e-ef6a74ea5dc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:35.232455 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef91a09e-4e3e-404c-836e-ef6a74ea5dc0 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:35.233218 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef91a09e-4e3e-404c-836e-ef6a74ea5dc0 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:35.233984 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef91a09e-4e3e-404c-836e-ef6a74ea5dc0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:35.247381 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef91a09e-4e3e-404c-836e-ef6a74ea5dc0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:07:35.252989 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3c4ca0-a1ce-4c7b-825b-a857be6ac26d None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:35.258410 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application [None req-ef91a09e-4e3e-404c-836e-ef6a74ea5dc0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 19:07:35.258410 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:07:35.258410 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:07:35.258410 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:07:35.258410 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:07:35.258410 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:07:35.258410 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:07:35.258410 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:07:35.258410 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:07:35.258410 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:07:35.258410 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:07:35.258410 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:07:35.258410 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:07:35.258410 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:07:35.258410 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:07:35.258410 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:07:35.259321 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:07:35.259321 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:07:35.259321 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:07:35.259321 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:07:35.259321 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:07:35.259321 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:07:35.259321 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:07:35.259321 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:07:35.259321 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:07:35.259321 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:07:35.259321 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:07:35.259321 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application with Lock( May 10 19:07:35.259321 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:07:35.259321 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._enter() May 10 19:07:35.259321 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:07:35.259321 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:07:35.260140 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:07:35.260140 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.creator() May 10 19:07:35.260140 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:07:35.260140 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application created_value = creator( May 10 19:07:35.260140 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:07:35.260140 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:07:35.260140 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:07:35.260140 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:07:35.260140 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:07:35.260140 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:07:35.260140 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 19:07:35.260140 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application May 10 19:07:35.263939 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 245/491] 10.222.0.70 () {56 vars in 1102 bytes} [Tue May 10 19:07:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:07:35.264570 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef91a09e-4e3e-404c-836e-ef6a74ea5dc0 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:35.295604 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e38837-fef5-4469-87c0-8491ea8a5f33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:35.296870 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e38837-fef5-4469-87c0-8491ea8a5f33 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:35.297493 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e38837-fef5-4469-87c0-8491ea8a5f33 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:35.298753 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e38837-fef5-4469-87c0-8491ea8a5f33 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:35.311351 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e38837-fef5-4469-87c0-8491ea8a5f33 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:07:35.322113 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-c2e38837-fef5-4469-87c0-8491ea8a5f33 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 19:07:35.322113 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:07:35.322113 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:07:35.322113 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:07:35.322113 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:07:35.322113 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:07:35.322113 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:07:35.322113 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:07:35.322113 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:07:35.322113 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:07:35.322113 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:07:35.322113 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:07:35.322113 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:07:35.322113 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:07:35.322113 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:07:35.322113 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:07:35.323185 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:07:35.323185 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:07:35.323185 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:07:35.323185 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:07:35.323185 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:07:35.323185 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:07:35.323185 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:07:35.323185 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:07:35.323185 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:07:35.323185 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:07:35.323185 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:07:35.323185 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( May 10 19:07:35.323185 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:07:35.323185 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() May 10 19:07:35.323185 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:07:35.323185 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:07:35.324155 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:07:35.324155 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() May 10 19:07:35.324155 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:07:35.324155 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( May 10 19:07:35.324155 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:07:35.324155 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:07:35.324155 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:07:35.324155 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:07:35.324155 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:07:35.324155 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:07:35.324155 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 19:07:35.324155 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:07:35.330419 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 247/492] 10.222.0.70 () {56 vars in 1102 bytes} [Tue May 10 19:07:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:07:35.330419 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e38837-fef5-4469-87c0-8491ea8a5f33 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:35.371648 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef91a09e-4e3e-404c-836e-ef6a74ea5dc0 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:35.413746 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdff904-999f-4bef-838a-7b32a9502579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:35.415544 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdff904-999f-4bef-838a-7b32a9502579 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:35.416292 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdff904-999f-4bef-838a-7b32a9502579 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:35.416810 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdff904-999f-4bef-838a-7b32a9502579 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:35.428445 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdff904-999f-4bef-838a-7b32a9502579 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:35.430646 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdff904-999f-4bef-838a-7b32a9502579 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:35.448810 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e38837-fef5-4469-87c0-8491ea8a5f33 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:35.450881 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application [None req-abdff904-999f-4bef-838a-7b32a9502579 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 10 19:07:35.450881 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:07:35.450881 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:07:35.450881 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:07:35.450881 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:07:35.450881 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:07:35.450881 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:07:35.450881 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:07:35.450881 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:07:35.450881 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:07:35.450881 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:07:35.450881 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:07:35.450881 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 19:07:35.450881 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 19:07:35.450881 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 19:07:35.450881 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 19:07:35.451956 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:07:35.451956 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:07:35.451956 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 19:07:35.451956 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 19:07:35.451956 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 19:07:35.451956 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 19:07:35.451956 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:07:35.451956 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:07:35.451956 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:07:35.451956 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:07:35.451956 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:07:35.451956 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application with Lock( May 10 19:07:35.451956 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:07:35.451956 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._enter() May 10 19:07:35.451956 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:07:35.451956 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:07:35.451956 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:07:35.451956 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.creator() May 10 19:07:35.453110 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:07:35.453110 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application created_value = creator( May 10 19:07:35.453110 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 19:07:35.453110 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 19:07:35.453110 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 19:07:35.453110 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 19:07:35.453110 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 19:07:35.453110 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 19:07:35.453110 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 10 19:07:35.453110 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application May 10 19:07:35.461154 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 246/493] 10.222.0.70 () {56 vars in 1093 bytes} [Tue May 10 19:07:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:07:35.461725 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdff904-999f-4bef-838a-7b32a9502579 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:35.487628 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33860d8f-7aea-46ba-8013-1caa47003664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:35.488784 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33860d8f-7aea-46ba-8013-1caa47003664 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:35.489110 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33860d8f-7aea-46ba-8013-1caa47003664 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:35.489437 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33860d8f-7aea-46ba-8013-1caa47003664 None admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:35.490176 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33860d8f-7aea-46ba-8013-1caa47003664 None admin] RBAC: Adding query filter params (name=service) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:07:35.490477 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33860d8f-7aea-46ba-8013-1caa47003664 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:35.491895 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33860d8f-7aea-46ba-8013-1caa47003664 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:35.500269 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 248/494] 10.222.0.70 () {56 vars in 1103 bytes} [Tue May 10 19:07:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:07:35.501174 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33860d8f-7aea-46ba-8013-1caa47003664 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:35.589702 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdff904-999f-4bef-838a-7b32a9502579 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:35.601970 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33860d8f-7aea-46ba-8013-1caa47003664 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:35.626769 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a16d13-a035-48c2-8d3d-b008c4270d86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:35.627429 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a16d13-a035-48c2-8d3d-b008c4270d86 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:35.627709 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a16d13-a035-48c2-8d3d-b008c4270d86 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:35.627984 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a16d13-a035-48c2-8d3d-b008c4270d86 None admin] PATH_INFO: `/v3/roles` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:35.629306 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a16d13-a035-48c2-8d3d-b008c4270d86 None admin] RBAC: Adding query filter params (name=service) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:07:35.629614 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a16d13-a035-48c2-8d3d-b008c4270d86 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:35.631018 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a16d13-a035-48c2-8d3d-b008c4270d86 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:35.635560 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37efa233-8737-442e-b019-5e1f29aa84a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:35.636232 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37efa233-8737-442e-b019-5e1f29aa84a4 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:35.636541 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37efa233-8737-442e-b019-5e1f29aa84a4 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:35.636818 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37efa233-8737-442e-b019-5e1f29aa84a4 None admin] PATH_INFO: `/v3/users` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:35.637767 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37efa233-8737-442e-b019-5e1f29aa84a4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:07:35.638084 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37efa233-8737-442e-b019-5e1f29aa84a4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:35.639172 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 247/495] 10.222.0.70 () {56 vars in 1103 bytes} [Tue May 10 19:07:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:07:35.639497 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37efa233-8737-442e-b019-5e1f29aa84a4 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:35.645929 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a16d13-a035-48c2-8d3d-b008c4270d86 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:35.675837 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 249/496] 10.222.0.70 () {56 vars in 1133 bytes} [Tue May 10 19:07:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:07:35.677091 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d53fda-ca29-449c-a20b-2e20761dedda None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:35.677375 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d53fda-ca29-449c-a20b-2e20761dedda None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:35.677646 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d53fda-ca29-449c-a20b-2e20761dedda None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:35.678991 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 250/497] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:07:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:07:35.679520 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d53fda-ca29-449c-a20b-2e20761dedda None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:35.751605 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a16d13-a035-48c2-8d3d-b008c4270d86 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:35.780893 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d53fda-ca29-449c-a20b-2e20761dedda None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:35.785487 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0590a057-b927-4a19-aabc-2e9be9ba8e27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:35.786291 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0590a057-b927-4a19-aabc-2e9be9ba8e27 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:35.786581 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0590a057-b927-4a19-aabc-2e9be9ba8e27 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:35.786881 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0590a057-b927-4a19-aabc-2e9be9ba8e27 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:35.797064 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0590a057-b927-4a19-aabc-2e9be9ba8e27 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:35.798519 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0590a057-b927-4a19-aabc-2e9be9ba8e27 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:35.814974 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application [None req-0590a057-b927-4a19-aabc-2e9be9ba8e27 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:07:35.814974 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:07:35.814974 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:07:35.814974 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:07:35.814974 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:07:35.814974 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:07:35.814974 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:07:35.814974 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:07:35.814974 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:07:35.814974 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:07:35.814974 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:07:35.814974 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:07:35.814974 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 19:07:35.814974 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 19:07:35.814974 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 19:07:35.816414 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 19:07:35.816414 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:07:35.816414 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:07:35.816414 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:07:35.816414 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:07:35.816414 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:07:35.816414 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:07:35.816414 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:07:35.816414 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application with Lock( May 10 19:07:35.816414 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:07:35.816414 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._enter() May 10 19:07:35.816414 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:07:35.816414 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:07:35.816414 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:07:35.816414 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.creator() May 10 19:07:35.816414 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:07:35.816414 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application created_value = creator( May 10 19:07:35.817362 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 19:07:35.817362 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 19:07:35.817362 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:07:35.817362 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application May 10 19:07:35.819719 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54c7c34-46a5-416b-b1fb-4f9b5b5e3128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:35.820545 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54c7c34-46a5-416b-b1fb-4f9b5b5e3128 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:35.820738 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 248/498] 10.222.0.70 () {56 vars in 1108 bytes} [Tue May 10 19:07:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:07:35.821022 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54c7c34-46a5-416b-b1fb-4f9b5b5e3128 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:35.821297 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54c7c34-46a5-416b-b1fb-4f9b5b5e3128 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:35.822024 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0590a057-b927-4a19-aabc-2e9be9ba8e27 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:35.831315 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54c7c34-46a5-416b-b1fb-4f9b5b5e3128 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:35.833126 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54c7c34-46a5-416b-b1fb-4f9b5b5e3128 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:35.850401 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-a54c7c34-46a5-416b-b1fb-4f9b5b5e3128 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:07:35.850401 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:07:35.850401 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:07:35.850401 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:07:35.850401 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:07:35.850401 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:07:35.850401 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:07:35.850401 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:07:35.850401 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:07:35.850401 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:07:35.850401 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:07:35.850401 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:07:35.850401 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 19:07:35.850401 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 19:07:35.850401 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 19:07:35.851284 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 19:07:35.851284 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:07:35.851284 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:07:35.851284 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:07:35.851284 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:07:35.851284 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:07:35.851284 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:07:35.851284 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:07:35.851284 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( May 10 19:07:35.851284 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:07:35.851284 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() May 10 19:07:35.851284 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:07:35.851284 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:07:35.851284 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:07:35.851284 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() May 10 19:07:35.851284 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:07:35.851284 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( May 10 19:07:35.852140 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 19:07:35.852140 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 19:07:35.852140 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:07:35.852140 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:07:35.852140 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 251/499] 10.222.0.70 () {56 vars in 1108 bytes} [Tue May 10 19:07:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:07:35.852893 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6aa974-1a7b-4d1c-b5f0-9ede3f90a097 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:35.853046 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6aa974-1a7b-4d1c-b5f0-9ede3f90a097 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:35.853305 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6aa974-1a7b-4d1c-b5f0-9ede3f90a097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:35.868804 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-3b6aa974-1a7b-4d1c-b5f0-9ede3f90a097 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:07:35.869960 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-3b6aa974-1a7b-4d1c-b5f0-9ede3f90a097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:07:35.926336 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0590a057-b927-4a19-aabc-2e9be9ba8e27 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:35.935838 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 252/500] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:07:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 19:07:35.936527 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6aa974-1a7b-4d1c-b5f0-9ede3f90a097 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:35.964071 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9c38a3-bc0b-4e9e-ad65-e11a3a274f7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:35.964766 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9c38a3-bc0b-4e9e-ad65-e11a3a274f7c None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:35.965047 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9c38a3-bc0b-4e9e-ad65-e11a3a274f7c None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:35.965315 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9c38a3-bc0b-4e9e-ad65-e11a3a274f7c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:36.029869 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9c38a3-bc0b-4e9e-ad65-e11a3a274f7c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:36.030874 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6aa974-1a7b-4d1c-b5f0-9ede3f90a097 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:36.031333 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9c38a3-bc0b-4e9e-ad65-e11a3a274f7c None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:36.063497 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dc5f8d-47f8-4abd-9d14-be632458f51e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:36.064141 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dc5f8d-47f8-4abd-9d14-be632458f51e None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:36.064438 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dc5f8d-47f8-4abd-9d14-be632458f51e None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:36.064712 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dc5f8d-47f8-4abd-9d14-be632458f51e None admin] PATH_INFO: `/v3/domains` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:36.065412 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dc5f8d-47f8-4abd-9d14-be632458f51e None admin] RBAC: Adding query filter params (name=Default) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:07:36.065710 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dc5f8d-47f8-4abd-9d14-be632458f51e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:36.067645 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dc5f8d-47f8-4abd-9d14-be632458f51e None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:36.078177 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 253/501] 10.222.0.70 () {56 vars in 1109 bytes} [Tue May 10 19:07:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:07:36.078968 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dc5f8d-47f8-4abd-9d14-be632458f51e None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:36.124567 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 249/502] 10.222.0.70 () {58 vars in 1282 bytes} [Tue May 10 19:07:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 19:07:36.126016 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab18dbb1-25c7-4ecd-ad69-b4840bb459f0 None None] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:36.126307 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab18dbb1-25c7-4ecd-ad69-b4840bb459f0 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:36.126590 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab18dbb1-25c7-4ecd-ad69-b4840bb459f0 None None] PATH_INFO: `/` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:36.127848 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 250/503] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:07:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:07:36.128695 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab18dbb1-25c7-4ecd-ad69-b4840bb459f0 None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:36.170717 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dc5f8d-47f8-4abd-9d14-be632458f51e None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:36.201514 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f0c733-a13c-4f13-9c0c-079fc9da88bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:36.202162 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f0c733-a13c-4f13-9c0c-079fc9da88bd None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:36.202439 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f0c733-a13c-4f13-9c0c-079fc9da88bd None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:36.202707 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f0c733-a13c-4f13-9c0c-079fc9da88bd None admin] PATH_INFO: `/v3/domains` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:36.203402 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f0c733-a13c-4f13-9c0c-079fc9da88bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:07:36.203698 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f0c733-a13c-4f13-9c0c-079fc9da88bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:36.205068 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f0c733-a13c-4f13-9c0c-079fc9da88bd None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:36.216851 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 254/504] 10.222.0.70 () {56 vars in 1109 bytes} [Tue May 10 19:07:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:07:36.217626 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f0c733-a13c-4f13-9c0c-079fc9da88bd None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:36.223716 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab18dbb1-25c7-4ecd-ad69-b4840bb459f0 None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:36.255991 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1891541-dab0-4a18-b850-783d8f8c8240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:36.256853 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1891541-dab0-4a18-b850-783d8f8c8240 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:36.257134 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1891541-dab0-4a18-b850-783d8f8c8240 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:36.257402 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1891541-dab0-4a18-b850-783d8f8c8240 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:36.266903 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1891541-dab0-4a18-b850-783d8f8c8240 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:07:36.275029 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application [None req-c1891541-dab0-4a18-b850-783d8f8c8240 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 19:07:36.275029 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:07:36.275029 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:07:36.275029 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:07:36.275029 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:07:36.275029 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:07:36.275029 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:07:36.275029 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:07:36.275029 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:07:36.275029 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:07:36.275029 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:07:36.275029 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:07:36.275029 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:07:36.275029 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:07:36.275029 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:07:36.275029 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:07:36.276068 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:07:36.276068 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:07:36.276068 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:07:36.276068 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:07:36.276068 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:07:36.276068 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:07:36.276068 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:07:36.276068 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:07:36.276068 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:07:36.276068 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:07:36.276068 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:07:36.276068 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application with Lock( May 10 19:07:36.276068 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:07:36.276068 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._enter() May 10 19:07:36.276068 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:07:36.276068 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:07:36.276962 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:07:36.276962 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.creator() May 10 19:07:36.276962 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:07:36.276962 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application created_value = creator( May 10 19:07:36.276962 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:07:36.276962 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:07:36.276962 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:07:36.276962 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:07:36.276962 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:07:36.276962 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:07:36.276962 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 19:07:36.276962 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application May 10 19:07:36.276962 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 251/505] 10.222.0.70 () {56 vars in 1102 bytes} [Tue May 10 19:07:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:07:36.277627 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1891541-dab0-4a18-b850-783d8f8c8240 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:36.312556 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f0c733-a13c-4f13-9c0c-079fc9da88bd None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:36.343993 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ca89fe-fec5-4903-a359-d0ce7169ae08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:36.344804 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ca89fe-fec5-4903-a359-d0ce7169ae08 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:36.345082 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ca89fe-fec5-4903-a359-d0ce7169ae08 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:36.345348 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ca89fe-fec5-4903-a359-d0ce7169ae08 None admin] PATH_INFO: `/v3/users/glance` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:36.352008 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ca89fe-fec5-4903-a359-d0ce7169ae08 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:36.353456 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ca89fe-fec5-4903-a359-d0ce7169ae08 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:36.369430 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-b4ca89fe-fec5-4903-a359-d0ce7169ae08 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 10 19:07:36.369430 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:07:36.369430 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:07:36.369430 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:07:36.369430 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:07:36.369430 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:07:36.369430 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:07:36.369430 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:07:36.369430 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:07:36.369430 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:07:36.369430 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:07:36.369430 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:07:36.369430 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 19:07:36.369430 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 19:07:36.369430 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 19:07:36.369430 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 19:07:36.370560 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:07:36.370560 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:07:36.370560 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 19:07:36.370560 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 19:07:36.370560 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 19:07:36.370560 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 19:07:36.370560 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:07:36.370560 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:07:36.370560 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:07:36.370560 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:07:36.370560 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:07:36.370560 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( May 10 19:07:36.370560 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:07:36.370560 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() May 10 19:07:36.370560 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:07:36.370560 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:07:36.370560 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:07:36.370560 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() May 10 19:07:36.371474 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:07:36.371474 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( May 10 19:07:36.371474 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 19:07:36.371474 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 19:07:36.371474 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 19:07:36.371474 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 19:07:36.371474 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 19:07:36.371474 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 19:07:36.371474 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 10 19:07:36.371474 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:07:36.371987 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1891541-dab0-4a18-b850-783d8f8c8240 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:36.372385 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 255/506] 10.222.0.70 () {56 vars in 1099 bytes} [Tue May 10 19:07:36 2022] GET /identity/v3/users/glance => generated 84 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:07:36.372385 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9149f648-5858-446e-ba4a-cdb4691faa4c None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:36.372385 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9149f648-5858-446e-ba4a-cdb4691faa4c None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:36.372385 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9149f648-5858-446e-ba4a-cdb4691faa4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:36.389545 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-9149f648-5858-446e-ba4a-cdb4691faa4c None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:07:36.390704 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-9149f648-5858-446e-ba4a-cdb4691faa4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:07:36.402762 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007edb80-3edd-49d7-8a28-30c8b78852fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:36.403550 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007edb80-3edd-49d7-8a28-30c8b78852fe None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:36.403831 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007edb80-3edd-49d7-8a28-30c8b78852fe None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:36.404108 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007edb80-3edd-49d7-8a28-30c8b78852fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:36.414605 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007edb80-3edd-49d7-8a28-30c8b78852fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:36.416058 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007edb80-3edd-49d7-8a28-30c8b78852fe None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:36.432097 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application [None req-007edb80-3edd-49d7-8a28-30c8b78852fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:07:36.432097 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:07:36.432097 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:07:36.432097 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:07:36.432097 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:07:36.432097 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:07:36.432097 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:07:36.432097 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:07:36.432097 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:07:36.432097 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:07:36.432097 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:07:36.432097 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:07:36.432097 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 19:07:36.432097 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 19:07:36.432097 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 19:07:36.433079 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 19:07:36.433079 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:07:36.433079 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:07:36.433079 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:07:36.433079 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:07:36.433079 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:07:36.433079 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:07:36.433079 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:07:36.433079 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application with Lock( May 10 19:07:36.433079 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:07:36.433079 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._enter() May 10 19:07:36.433079 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:07:36.433079 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:07:36.433079 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:07:36.433079 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.creator() May 10 19:07:36.433079 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:07:36.433079 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application created_value = creator( May 10 19:07:36.433968 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 19:07:36.433968 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 19:07:36.433968 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:07:36.433968 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application May 10 19:07:36.433968 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 252/507] 10.222.0.70 () {56 vars in 1108 bytes} [Tue May 10 19:07:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:07:36.434242 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007edb80-3edd-49d7-8a28-30c8b78852fe None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:36.454097 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 256/508] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:07:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 19:07:36.454870 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9149f648-5858-446e-ba4a-cdb4691faa4c None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:36.530141 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007edb80-3edd-49d7-8a28-30c8b78852fe None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:36.546561 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9149f648-5858-446e-ba4a-cdb4691faa4c None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:36.563587 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dafe4f-6f70-47dd-9140-aadd03d3d0e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:36.564380 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dafe4f-6f70-47dd-9140-aadd03d3d0e4 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:36.564691 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dafe4f-6f70-47dd-9140-aadd03d3d0e4 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:36.564972 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dafe4f-6f70-47dd-9140-aadd03d3d0e4 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:36.573424 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dafe4f-6f70-47dd-9140-aadd03d3d0e4 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:36.574878 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dafe4f-6f70-47dd-9140-aadd03d3d0e4 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:36.582477 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1d4824-77e4-47ee-a022-bf22ffd2a150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:36.583135 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1d4824-77e4-47ee-a022-bf22ffd2a150 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:36.583420 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1d4824-77e4-47ee-a022-bf22ffd2a150 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:36.583694 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1d4824-77e4-47ee-a022-bf22ffd2a150 None admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:36.584458 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1d4824-77e4-47ee-a022-bf22ffd2a150 None admin] RBAC: Adding query filter params (name=service) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:07:36.585285 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1d4824-77e4-47ee-a022-bf22ffd2a150 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:36.586649 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1d4824-77e4-47ee-a022-bf22ffd2a150 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:36.589321 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application [None req-13dafe4f-6f70-47dd-9140-aadd03d3d0e4 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 10 19:07:36.589321 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:07:36.589321 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:07:36.589321 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:07:36.589321 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:07:36.589321 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:07:36.589321 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:07:36.589321 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:07:36.589321 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:07:36.589321 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:07:36.589321 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:07:36.589321 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:07:36.589321 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 19:07:36.589321 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 19:07:36.589321 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 19:07:36.589321 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 19:07:36.590187 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:07:36.590187 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:07:36.590187 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 19:07:36.590187 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 19:07:36.590187 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 19:07:36.590187 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 19:07:36.590187 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:07:36.590187 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:07:36.590187 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:07:36.590187 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:07:36.590187 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:07:36.590187 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application with Lock( May 10 19:07:36.590187 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:07:36.590187 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._enter() May 10 19:07:36.590187 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:07:36.590187 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:07:36.590187 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:07:36.590187 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.creator() May 10 19:07:36.591077 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:07:36.591077 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application created_value = creator( May 10 19:07:36.591077 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 19:07:36.591077 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 19:07:36.591077 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 19:07:36.591077 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 19:07:36.591077 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 19:07:36.591077 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 19:07:36.591077 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 10 19:07:36.591077 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application May 10 19:07:36.591077 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 253/509] 10.222.0.70 () {56 vars in 1099 bytes} [Tue May 10 19:07:36 2022] GET /identity/v3/users/cinder => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:07:36.591640 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dafe4f-6f70-47dd-9140-aadd03d3d0e4 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:36.602828 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 257/510] 10.222.0.70 () {56 vars in 1103 bytes} [Tue May 10 19:07:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:07:36.602828 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1d4824-77e4-47ee-a022-bf22ffd2a150 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:36.683837 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dafe4f-6f70-47dd-9140-aadd03d3d0e4 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:36.692840 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1d4824-77e4-47ee-a022-bf22ffd2a150 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:36.715421 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71218850-1708-469e-b27d-d5ff8041be7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:36.716017 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71218850-1708-469e-b27d-d5ff8041be7f None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:36.716303 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71218850-1708-469e-b27d-d5ff8041be7f None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:36.716612 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71218850-1708-469e-b27d-d5ff8041be7f None admin] PATH_INFO: `/v3/users` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:36.717437 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71218850-1708-469e-b27d-d5ff8041be7f None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:07:36.717749 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71218850-1708-469e-b27d-d5ff8041be7f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:36.719188 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71218850-1708-469e-b27d-d5ff8041be7f None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:36.723977 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a367e9-836f-49ed-aec4-113d88731541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:36.724669 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a367e9-836f-49ed-aec4-113d88731541 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:36.724945 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a367e9-836f-49ed-aec4-113d88731541 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:36.725216 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a367e9-836f-49ed-aec4-113d88731541 None admin] PATH_INFO: `/v3/domains` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:36.725921 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a367e9-836f-49ed-aec4-113d88731541 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:07:36.726220 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a367e9-836f-49ed-aec4-113d88731541 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:36.727566 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a367e9-836f-49ed-aec4-113d88731541 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:36.738608 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 258/511] 10.222.0.70 () {56 vars in 1109 bytes} [Tue May 10 19:07:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:07:36.739379 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a367e9-836f-49ed-aec4-113d88731541 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:36.755638 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 254/512] 10.222.0.70 () {56 vars in 1137 bytes} [Tue May 10 19:07:36 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:07:36.756507 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71218850-1708-469e-b27d-d5ff8041be7f None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:36.834032 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a367e9-836f-49ed-aec4-113d88731541 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:36.849268 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71218850-1708-469e-b27d-d5ff8041be7f None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:36.866335 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b100c1ed-151c-4d6c-9473-d239e7f29020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:36.867123 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b100c1ed-151c-4d6c-9473-d239e7f29020 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:36.867408 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b100c1ed-151c-4d6c-9473-d239e7f29020 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:36.867684 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b100c1ed-151c-4d6c-9473-d239e7f29020 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:36.877166 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b100c1ed-151c-4d6c-9473-d239e7f29020 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:36.879237 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b100c1ed-151c-4d6c-9473-d239e7f29020 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:36.881007 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b306495-d1f3-45db-8e38-85df3a664046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:36.881660 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b306495-d1f3-45db-8e38-85df3a664046 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:36.881936 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b306495-d1f3-45db-8e38-85df3a664046 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:36.882203 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b306495-d1f3-45db-8e38-85df3a664046 None admin] PATH_INFO: `/v3/users` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:36.883018 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b306495-d1f3-45db-8e38-85df3a664046 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:07:36.883318 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b306495-d1f3-45db-8e38-85df3a664046 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:36.884764 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b306495-d1f3-45db-8e38-85df3a664046 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:36.896323 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-b100c1ed-151c-4d6c-9473-d239e7f29020 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:07:36.896323 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:07:36.896323 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:07:36.896323 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:07:36.896323 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:07:36.896323 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:07:36.896323 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:07:36.896323 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:07:36.896323 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:07:36.896323 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:07:36.896323 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:07:36.896323 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:07:36.896323 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 19:07:36.896323 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 19:07:36.896323 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 19:07:36.897172 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 19:07:36.897172 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:07:36.897172 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:07:36.897172 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:07:36.897172 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:07:36.897172 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:07:36.897172 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:07:36.897172 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:07:36.897172 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( May 10 19:07:36.897172 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:07:36.897172 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() May 10 19:07:36.897172 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:07:36.897172 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:07:36.897172 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:07:36.897172 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() May 10 19:07:36.897172 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:07:36.897172 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( May 10 19:07:36.898019 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 19:07:36.898019 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 19:07:36.898019 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:07:36.898019 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:07:36.898019 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 259/513] 10.222.0.70 () {56 vars in 1108 bytes} [Tue May 10 19:07:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:07:36.898280 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b100c1ed-151c-4d6c-9473-d239e7f29020 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:36.905903 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 255/514] 10.222.0.70 () {56 vars in 1137 bytes} [Tue May 10 19:07:36 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:07:36.906698 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b306495-d1f3-45db-8e38-85df3a664046 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:36.996126 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b100c1ed-151c-4d6c-9473-d239e7f29020 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:36.998260 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b306495-d1f3-45db-8e38-85df3a664046 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:37.028842 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cfabff-627d-43d9-9ac6-f9d3973e15da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:37.029630 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cfabff-627d-43d9-9ac6-f9d3973e15da None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:37.029730 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061df1e2-03d9-423b-bbbf-6982139167f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:37.029913 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cfabff-627d-43d9-9ac6-f9d3973e15da None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:37.030278 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cfabff-627d-43d9-9ac6-f9d3973e15da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:37.030441 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061df1e2-03d9-423b-bbbf-6982139167f0 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:37.030696 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061df1e2-03d9-423b-bbbf-6982139167f0 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:37.030971 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061df1e2-03d9-423b-bbbf-6982139167f0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:37.037875 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061df1e2-03d9-423b-bbbf-6982139167f0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:37.039322 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061df1e2-03d9-423b-bbbf-6982139167f0 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:37.040962 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cfabff-627d-43d9-9ac6-f9d3973e15da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:37.042498 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cfabff-627d-43d9-9ac6-f9d3973e15da None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:37.053102 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application [None req-061df1e2-03d9-423b-bbbf-6982139167f0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 19:07:37.053102 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:07:37.053102 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:07:37.053102 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:07:37.053102 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:07:37.053102 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:07:37.053102 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:07:37.053102 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:07:37.053102 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:07:37.053102 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:07:37.053102 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:07:37.053102 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:07:37.053102 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 19:07:37.053102 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 19:07:37.053102 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 19:07:37.053954 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 19:07:37.053954 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:07:37.053954 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:07:37.053954 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:07:37.053954 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:07:37.053954 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:07:37.053954 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:07:37.053954 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:07:37.053954 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application with Lock( May 10 19:07:37.053954 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:07:37.053954 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._enter() May 10 19:07:37.053954 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:07:37.053954 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:07:37.053954 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:07:37.053954 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.creator() May 10 19:07:37.053954 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:07:37.053954 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application created_value = creator( May 10 19:07:37.054800 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 19:07:37.054800 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 19:07:37.054800 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 19:07:37.054800 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 19:07:37.054800 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 19:07:37.054800 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 19:07:37.054800 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 19:07:37.054800 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application May 10 19:07:37.054800 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 256/515] 10.222.0.70 () {56 vars in 1111 bytes} [Tue May 10 19:07:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:07:37.055882 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061df1e2-03d9-423b-bbbf-6982139167f0 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:37.060760 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-09cfabff-627d-43d9-9ac6-f9d3973e15da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:07:37.060760 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:07:37.060760 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:07:37.060760 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:07:37.060760 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:07:37.060760 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:07:37.060760 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:07:37.060760 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:07:37.060760 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:07:37.060760 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:07:37.060760 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:07:37.060760 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:07:37.060760 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 19:07:37.060760 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 19:07:37.060760 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 19:07:37.061792 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 19:07:37.061792 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:07:37.061792 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:07:37.061792 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:07:37.061792 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:07:37.061792 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:07:37.061792 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:07:37.061792 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:07:37.061792 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( May 10 19:07:37.061792 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:07:37.061792 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() May 10 19:07:37.061792 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:07:37.061792 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:07:37.061792 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:07:37.061792 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() May 10 19:07:37.061792 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:07:37.061792 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( May 10 19:07:37.062857 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 19:07:37.062857 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 19:07:37.062857 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:07:37.062857 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:07:37.062857 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 260/516] 10.222.0.70 () {56 vars in 1108 bytes} [Tue May 10 19:07:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:07:37.062857 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cfabff-627d-43d9-9ac6-f9d3973e15da None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:37.153248 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061df1e2-03d9-423b-bbbf-6982139167f0 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:37.159898 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cfabff-627d-43d9-9ac6-f9d3973e15da None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:37.183838 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6f3f56-421f-417a-a439-4e7476d70b34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:37.184518 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6f3f56-421f-417a-a439-4e7476d70b34 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:37.184806 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6f3f56-421f-417a-a439-4e7476d70b34 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:37.185087 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6f3f56-421f-417a-a439-4e7476d70b34 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:37.191689 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5ecc60-045b-4a8e-8d39-dfdeb152fa98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:37.192334 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5ecc60-045b-4a8e-8d39-dfdeb152fa98 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:37.192646 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5ecc60-045b-4a8e-8d39-dfdeb152fa98 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:37.192926 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5ecc60-045b-4a8e-8d39-dfdeb152fa98 None admin] PATH_INFO: `/v3/domains` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:37.193647 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5ecc60-045b-4a8e-8d39-dfdeb152fa98 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:07:37.193948 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5ecc60-045b-4a8e-8d39-dfdeb152fa98 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:37.195326 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5ecc60-045b-4a8e-8d39-dfdeb152fa98 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:37.205876 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 261/517] 10.222.0.70 () {56 vars in 1109 bytes} [Tue May 10 19:07:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:07:37.206710 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5ecc60-045b-4a8e-8d39-dfdeb152fa98 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:37.248292 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6f3f56-421f-417a-a439-4e7476d70b34 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:37.249717 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6f3f56-421f-417a-a439-4e7476d70b34 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:37.301960 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5ecc60-045b-4a8e-8d39-dfdeb152fa98 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:37.333750 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb49b4d-71af-453a-b498-3b39a8d7ca38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:37.334379 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb49b4d-71af-453a-b498-3b39a8d7ca38 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:37.334666 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb49b4d-71af-453a-b498-3b39a8d7ca38 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:37.334940 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb49b4d-71af-453a-b498-3b39a8d7ca38 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:37.341308 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 257/518] 10.222.0.70 () {58 vars in 1282 bytes} [Tue May 10 19:07:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 19:07:37.342088 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6f3f56-421f-417a-a439-4e7476d70b34 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:37.398300 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb49b4d-71af-453a-b498-3b39a8d7ca38 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:37.399755 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb49b4d-71af-453a-b498-3b39a8d7ca38 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:37.432727 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6f3f56-421f-417a-a439-4e7476d70b34 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:37.464552 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdb78c7-e94e-4b8e-a658-6eec33202253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:37.465199 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdb78c7-e94e-4b8e-a658-6eec33202253 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:37.465481 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdb78c7-e94e-4b8e-a658-6eec33202253 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:37.465756 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdb78c7-e94e-4b8e-a658-6eec33202253 None admin] PATH_INFO: `/v3/projects` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:37.466539 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdb78c7-e94e-4b8e-a658-6eec33202253 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:07:37.466849 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdb78c7-e94e-4b8e-a658-6eec33202253 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:37.468289 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdb78c7-e94e-4b8e-a658-6eec33202253 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:37.490903 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 258/519] 10.222.0.70 () {56 vars in 1148 bytes} [Tue May 10 19:07:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:07:37.490903 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdb78c7-e94e-4b8e-a658-6eec33202253 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:37.491442 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 262/520] 10.222.0.70 () {58 vars in 1282 bytes} [Tue May 10 19:07:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 19:07:37.491442 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb49b4d-71af-453a-b498-3b39a8d7ca38 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:37.578754 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdb78c7-e94e-4b8e-a658-6eec33202253 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:37.585775 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb49b4d-71af-453a-b498-3b39a8d7ca38 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:37.610731 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90409e96-6239-4c7a-b632-cd16dee953f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:37.611382 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90409e96-6239-4c7a-b632-cd16dee953f0 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:37.611659 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90409e96-6239-4c7a-b632-cd16dee953f0 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:37.611931 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90409e96-6239-4c7a-b632-cd16dee953f0 None admin] PATH_INFO: `/v3/domains` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:37.612661 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90409e96-6239-4c7a-b632-cd16dee953f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:07:37.613496 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90409e96-6239-4c7a-b632-cd16dee953f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:37.614877 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90409e96-6239-4c7a-b632-cd16dee953f0 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:37.617403 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1352b451-070c-42ff-a747-145292c5b5eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:37.618062 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1352b451-070c-42ff-a747-145292c5b5eb None admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:37.618346 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1352b451-070c-42ff-a747-145292c5b5eb None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:37.618621 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1352b451-070c-42ff-a747-145292c5b5eb None admin] PATH_INFO: `/v3/users` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:37.619318 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1352b451-070c-42ff-a747-145292c5b5eb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:37.620770 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1352b451-070c-42ff-a747-145292c5b5eb None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:37.625477 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 259/521] 10.222.0.70 () {56 vars in 1109 bytes} [Tue May 10 19:07:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:07:37.626230 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90409e96-6239-4c7a-b632-cd16dee953f0 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:37.640063 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 263/522] 10.222.0.70 () {60 vars in 1132 bytes} [Tue May 10 19:07:37 2022] POST /identity/v3/users => generated 247 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:07:37.640796 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1352b451-070c-42ff-a747-145292c5b5eb None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:37.731835 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90409e96-6239-4c7a-b632-cd16dee953f0 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:37.752353 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1352b451-070c-42ff-a747-145292c5b5eb None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:37.765833 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154aaf8c-3cf1-4f58-8549-ed0bf2ab872e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:37.766650 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154aaf8c-3cf1-4f58-8549-ed0bf2ab872e None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:37.766938 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154aaf8c-3cf1-4f58-8549-ed0bf2ab872e None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:37.767215 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154aaf8c-3cf1-4f58-8549-ed0bf2ab872e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:37.778922 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154aaf8c-3cf1-4f58-8549-ed0bf2ab872e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:37.780436 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154aaf8c-3cf1-4f58-8549-ed0bf2ab872e None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:37.786696 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8aeaefb-582e-459a-ab71-d4e9c21a5e74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:37.787356 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aeaefb-582e-459a-ab71-d4e9c21a5e74 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:37.787635 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aeaefb-582e-459a-ab71-d4e9c21a5e74 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:37.787908 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aeaefb-582e-459a-ab71-d4e9c21a5e74 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:37.788767 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8aeaefb-582e-459a-ab71-d4e9c21a5e74 None admin] RBAC: Adding query filter params (role.id=445805bec1e741c9b823495ae6e364f0, scope.project.id=2ee9ec5b515440fe9b39aedf3e339c79, user.id=b9f310a468ec4058b3c95356ea60ab4c) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:07:37.789080 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8aeaefb-582e-459a-ab71-d4e9c21a5e74 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:37.790529 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8aeaefb-582e-459a-ab71-d4e9c21a5e74 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:37.798814 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application [None req-154aaf8c-3cf1-4f58-8549-ed0bf2ab872e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:07:37.798814 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:07:37.798814 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:07:37.798814 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:07:37.798814 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:07:37.798814 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:07:37.798814 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:07:37.798814 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:07:37.798814 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:07:37.798814 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:07:37.798814 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:07:37.798814 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:07:37.798814 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 19:07:37.798814 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 19:07:37.798814 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 19:07:37.799752 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 19:07:37.799752 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:07:37.799752 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:07:37.799752 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:07:37.799752 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:07:37.799752 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:07:37.799752 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:07:37.799752 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:07:37.799752 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application with Lock( May 10 19:07:37.799752 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:07:37.799752 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._enter() May 10 19:07:37.799752 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:07:37.799752 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:07:37.799752 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:07:37.799752 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.creator() May 10 19:07:37.799752 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:07:37.799752 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application created_value = creator( May 10 19:07:37.801641 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 19:07:37.801641 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 19:07:37.801641 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:07:37.801641 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application May 10 19:07:37.801641 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 260/523] 10.222.0.70 () {56 vars in 1108 bytes} [Tue May 10 19:07:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:07:37.801641 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154aaf8c-3cf1-4f58-8549-ed0bf2ab872e None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:37.812586 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 264/524] 10.222.0.70 () {56 vars in 1374 bytes} [Tue May 10 19:07:37 2022] GET /identity/v3/role_assignments?user.id=b9f310a468ec4058b3c95356ea60ab4c&scope.project.id=2ee9ec5b515440fe9b39aedf3e339c79&role.id=445805bec1e741c9b823495ae6e364f0 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:07:37.812586 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8aeaefb-582e-459a-ab71-d4e9c21a5e74 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:37.919638 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154aaf8c-3cf1-4f58-8549-ed0bf2ab872e None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:37.922335 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8aeaefb-582e-459a-ab71-d4e9c21a5e74 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:37.958514 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10aaa9ac-a12e-408b-98bf-586ebdeaa4e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:37.959333 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aaa9ac-a12e-408b-98bf-586ebdeaa4e1 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:37.959617 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aaa9ac-a12e-408b-98bf-586ebdeaa4e1 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:37.960066 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aaa9ac-a12e-408b-98bf-586ebdeaa4e1 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:37.965645 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b2b412-ded8-4212-a4e7-e8143929438c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:37.966777 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b2b412-ded8-4212-a4e7-e8143929438c None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:37.967247 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b2b412-ded8-4212-a4e7-e8143929438c None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:37.967708 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b2b412-ded8-4212-a4e7-e8143929438c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:37.969232 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10aaa9ac-a12e-408b-98bf-586ebdeaa4e1 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:37.970697 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10aaa9ac-a12e-408b-98bf-586ebdeaa4e1 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:37.980398 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b2b412-ded8-4212-a4e7-e8143929438c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:37.982214 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b2b412-ded8-4212-a4e7-e8143929438c None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:37.986324 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-10aaa9ac-a12e-408b-98bf-586ebdeaa4e1 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 10 19:07:37.986324 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:07:37.986324 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:07:37.986324 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:07:37.986324 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:07:37.986324 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:07:37.986324 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:07:37.986324 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:07:37.986324 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:07:37.986324 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:07:37.986324 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:07:37.986324 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:07:37.986324 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 19:07:37.986324 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 19:07:37.986324 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 19:07:37.986324 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 19:07:37.987272 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:07:37.987272 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:07:37.987272 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 19:07:37.987272 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 19:07:37.987272 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 19:07:37.987272 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 19:07:37.987272 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:07:37.987272 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:07:37.987272 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:07:37.987272 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:07:37.987272 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:07:37.987272 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( May 10 19:07:37.987272 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:07:37.987272 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() May 10 19:07:37.987272 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:07:37.987272 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:07:37.987272 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:07:37.987272 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() May 10 19:07:37.988272 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:07:37.988272 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( May 10 19:07:37.988272 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 19:07:37.988272 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 19:07:37.988272 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 19:07:37.988272 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 19:07:37.988272 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 19:07:37.988272 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 19:07:37.988272 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 10 19:07:37.988272 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:07:37.988272 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 265/525] 10.222.0.70 () {56 vars in 1102 bytes} [Tue May 10 19:07:37 2022] GET /identity/v3/users/neutron => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:07:37.988898 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10aaa9ac-a12e-408b-98bf-586ebdeaa4e1 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:38.004201 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application [None req-85b2b412-ded8-4212-a4e7-e8143929438c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:07:38.004201 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:07:38.004201 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:07:38.004201 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:07:38.004201 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:07:38.004201 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:07:38.004201 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:07:38.004201 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:07:38.004201 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:07:38.004201 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:07:38.004201 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:07:38.004201 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:07:38.004201 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 19:07:38.004201 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 19:07:38.004201 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 19:07:38.005183 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 19:07:38.005183 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:07:38.005183 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:07:38.005183 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:07:38.005183 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:07:38.005183 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:07:38.005183 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:07:38.005183 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:07:38.005183 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application with Lock( May 10 19:07:38.005183 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:07:38.005183 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._enter() May 10 19:07:38.005183 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:07:38.005183 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:07:38.005183 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:07:38.005183 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.creator() May 10 19:07:38.005183 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:07:38.005183 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application created_value = creator( May 10 19:07:38.006060 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 19:07:38.006060 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 19:07:38.006060 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:07:38.006060 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application May 10 19:07:38.006601 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 261/526] 10.222.0.70 () {56 vars in 1108 bytes} [Tue May 10 19:07:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:07:38.007288 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b2b412-ded8-4212-a4e7-e8143929438c None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:38.093867 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10aaa9ac-a12e-408b-98bf-586ebdeaa4e1 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:38.108408 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b2b412-ded8-4212-a4e7-e8143929438c None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:38.126988 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc2880c-f878-4d5e-a0c9-ebd45d344f96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:38.127647 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc2880c-f878-4d5e-a0c9-ebd45d344f96 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:38.127926 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc2880c-f878-4d5e-a0c9-ebd45d344f96 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:38.128199 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc2880c-f878-4d5e-a0c9-ebd45d344f96 None admin] PATH_INFO: `/v3/domains` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:38.129478 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc2880c-f878-4d5e-a0c9-ebd45d344f96 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:07:38.129777 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc2880c-f878-4d5e-a0c9-ebd45d344f96 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:38.131138 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc2880c-f878-4d5e-a0c9-ebd45d344f96 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:38.143303 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68424691-4053-4df6-9b2d-298c912ab505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:38.143620 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 266/527] 10.222.0.70 () {56 vars in 1109 bytes} [Tue May 10 19:07:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:07:38.144529 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc2880c-f878-4d5e-a0c9-ebd45d344f96 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:38.148363 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68424691-4053-4df6-9b2d-298c912ab505 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:38.149487 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68424691-4053-4df6-9b2d-298c912ab505 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:38.149771 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68424691-4053-4df6-9b2d-298c912ab505 None admin] PATH_INFO: `/v3/users` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:38.150614 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68424691-4053-4df6-9b2d-298c912ab505 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:07:38.150918 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68424691-4053-4df6-9b2d-298c912ab505 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:38.152365 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68424691-4053-4df6-9b2d-298c912ab505 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:38.176592 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 262/528] 10.222.0.70 () {56 vars in 1139 bytes} [Tue May 10 19:07:38 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:07:38.177384 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68424691-4053-4df6-9b2d-298c912ab505 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:38.258485 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc2880c-f878-4d5e-a0c9-ebd45d344f96 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:38.292936 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bd4fb4-0f00-4261-b547-50ef31b6b808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:38.293602 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bd4fb4-0f00-4261-b547-50ef31b6b808 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:38.293879 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bd4fb4-0f00-4261-b547-50ef31b6b808 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:38.294145 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bd4fb4-0f00-4261-b547-50ef31b6b808 None admin] PATH_INFO: `/v3/domains` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:38.294859 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bd4fb4-0f00-4261-b547-50ef31b6b808 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:07:38.295154 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bd4fb4-0f00-4261-b547-50ef31b6b808 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:38.296546 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bd4fb4-0f00-4261-b547-50ef31b6b808 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:38.307260 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68424691-4053-4df6-9b2d-298c912ab505 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:38.307647 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 267/529] 10.222.0.70 () {56 vars in 1109 bytes} [Tue May 10 19:07:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:07:38.312664 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bd4fb4-0f00-4261-b547-50ef31b6b808 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:38.344997 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a3356a-1349-49c0-a948-a8c3c070fe8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:38.346353 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a3356a-1349-49c0-a948-a8c3c070fe8a None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:38.346849 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a3356a-1349-49c0-a948-a8c3c070fe8a None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:38.347383 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a3356a-1349-49c0-a948-a8c3c070fe8a None admin] PATH_INFO: `/v3/projects/service` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:38.354348 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a3356a-1349-49c0-a948-a8c3c070fe8a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:38.356055 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a3356a-1349-49c0-a948-a8c3c070fe8a None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:38.370666 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application [None req-d1a3356a-1349-49c0-a948-a8c3c070fe8a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 19:07:38.370666 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:07:38.370666 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:07:38.370666 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:07:38.370666 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:07:38.370666 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:07:38.370666 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:07:38.370666 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:07:38.370666 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:07:38.370666 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:07:38.370666 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:07:38.370666 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:07:38.370666 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 19:07:38.370666 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 19:07:38.370666 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 19:07:38.371562 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 19:07:38.371562 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:07:38.371562 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:07:38.371562 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:07:38.371562 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:07:38.371562 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:07:38.371562 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:07:38.371562 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:07:38.371562 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application with Lock( May 10 19:07:38.371562 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:07:38.371562 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._enter() May 10 19:07:38.371562 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:07:38.371562 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:07:38.371562 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:07:38.371562 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.creator() May 10 19:07:38.371562 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:07:38.371562 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application created_value = creator( May 10 19:07:38.372480 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 19:07:38.372480 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 19:07:38.372480 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 19:07:38.372480 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 19:07:38.372480 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 19:07:38.372480 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 19:07:38.372480 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 19:07:38.372480 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application May 10 19:07:38.374893 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 263/530] 10.222.0.70 () {56 vars in 1111 bytes} [Tue May 10 19:07:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:07:38.375875 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a3356a-1349-49c0-a948-a8c3c070fe8a None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:38.412145 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bd4fb4-0f00-4261-b547-50ef31b6b808 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:38.446547 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede88f07-7943-45f9-86ce-35c347a6325c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:38.447684 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede88f07-7943-45f9-86ce-35c347a6325c None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:38.447684 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede88f07-7943-45f9-86ce-35c347a6325c None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:38.447684 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede88f07-7943-45f9-86ce-35c347a6325c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:38.477995 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a3356a-1349-49c0-a948-a8c3c070fe8a None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:38.512286 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407ca012-7d14-4bc6-96e2-3ec316a2c6a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:38.513502 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407ca012-7d14-4bc6-96e2-3ec316a2c6a4 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:38.513987 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407ca012-7d14-4bc6-96e2-3ec316a2c6a4 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:38.514462 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407ca012-7d14-4bc6-96e2-3ec316a2c6a4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:38.514638 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede88f07-7943-45f9-86ce-35c347a6325c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:38.516079 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede88f07-7943-45f9-86ce-35c347a6325c None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:38.522847 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407ca012-7d14-4bc6-96e2-3ec316a2c6a4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:38.524626 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407ca012-7d14-4bc6-96e2-3ec316a2c6a4 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:38.539248 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application [None req-407ca012-7d14-4bc6-96e2-3ec316a2c6a4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 19:07:38.539248 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:07:38.539248 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:07:38.539248 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:07:38.539248 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:07:38.539248 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:07:38.539248 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:07:38.539248 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:07:38.539248 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:07:38.539248 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:07:38.539248 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:07:38.539248 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:07:38.539248 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 19:07:38.539248 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 19:07:38.539248 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 19:07:38.540720 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 19:07:38.540720 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:07:38.540720 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:07:38.540720 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:07:38.540720 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:07:38.540720 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:07:38.540720 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:07:38.540720 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:07:38.540720 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application with Lock( May 10 19:07:38.540720 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:07:38.540720 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._enter() May 10 19:07:38.540720 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:07:38.540720 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:07:38.540720 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:07:38.540720 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.creator() May 10 19:07:38.540720 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:07:38.540720 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application created_value = creator( May 10 19:07:38.541994 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 19:07:38.541994 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 19:07:38.541994 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 19:07:38.541994 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 19:07:38.541994 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 19:07:38.541994 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 19:07:38.541994 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 19:07:38.541994 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application May 10 19:07:38.544921 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 264/531] 10.222.0.70 () {56 vars in 1111 bytes} [Tue May 10 19:07:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:07:38.545942 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407ca012-7d14-4bc6-96e2-3ec316a2c6a4 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:38.622686 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 268/532] 10.222.0.70 () {58 vars in 1282 bytes} [Tue May 10 19:07:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 19:07:38.623582 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede88f07-7943-45f9-86ce-35c347a6325c None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:38.652406 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407ca012-7d14-4bc6-96e2-3ec316a2c6a4 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:38.686943 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c37eca2-d9ea-4315-8503-06d99f17982f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:38.687963 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c37eca2-d9ea-4315-8503-06d99f17982f None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:38.688496 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c37eca2-d9ea-4315-8503-06d99f17982f None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:38.688996 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c37eca2-d9ea-4315-8503-06d99f17982f None admin] PATH_INFO: `/v3/projects` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:38.689983 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c37eca2-d9ea-4315-8503-06d99f17982f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:07:38.690494 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c37eca2-d9ea-4315-8503-06d99f17982f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:38.692757 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c37eca2-d9ea-4315-8503-06d99f17982f None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:38.705225 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 265/533] 10.222.0.70 () {56 vars in 1148 bytes} [Tue May 10 19:07:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:07:38.706303 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c37eca2-d9ea-4315-8503-06d99f17982f None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:38.726400 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede88f07-7943-45f9-86ce-35c347a6325c None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:38.759698 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ef2359-42a5-45f9-a304-c8beeb863355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:38.760526 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ef2359-42a5-45f9-a304-c8beeb863355 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:38.760812 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ef2359-42a5-45f9-a304-c8beeb863355 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:38.761227 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ef2359-42a5-45f9-a304-c8beeb863355 None admin] PATH_INFO: `/v3/projects` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:38.762008 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ef2359-42a5-45f9-a304-c8beeb863355 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:07:38.762312 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ef2359-42a5-45f9-a304-c8beeb863355 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:38.763795 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ef2359-42a5-45f9-a304-c8beeb863355 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:38.786570 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 269/534] 10.222.0.70 () {56 vars in 1148 bytes} [Tue May 10 19:07:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:07:38.787655 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ef2359-42a5-45f9-a304-c8beeb863355 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:38.809952 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c37eca2-d9ea-4315-8503-06d99f17982f None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:38.843690 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d354920-347a-4dc9-bc47-b9dccc19eee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:38.844823 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d354920-347a-4dc9-bc47-b9dccc19eee4 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:38.845312 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d354920-347a-4dc9-bc47-b9dccc19eee4 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:38.845813 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d354920-347a-4dc9-bc47-b9dccc19eee4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:38.859331 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d354920-347a-4dc9-bc47-b9dccc19eee4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:38.861533 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d354920-347a-4dc9-bc47-b9dccc19eee4 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:38.880448 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application [None req-1d354920-347a-4dc9-bc47-b9dccc19eee4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:07:38.880448 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:07:38.880448 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:07:38.880448 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:07:38.880448 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:07:38.880448 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:07:38.880448 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:07:38.880448 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:07:38.880448 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:07:38.880448 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:07:38.880448 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:07:38.880448 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:07:38.880448 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 19:07:38.880448 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 19:07:38.880448 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 19:07:38.881385 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 19:07:38.881385 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:07:38.881385 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:07:38.881385 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:07:38.881385 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:07:38.881385 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:07:38.881385 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:07:38.881385 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:07:38.881385 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application with Lock( May 10 19:07:38.881385 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:07:38.881385 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._enter() May 10 19:07:38.881385 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:07:38.881385 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:07:38.881385 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:07:38.881385 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.creator() May 10 19:07:38.881385 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:07:38.881385 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application created_value = creator( May 10 19:07:38.882253 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 19:07:38.882253 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 19:07:38.882253 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:07:38.882253 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application May 10 19:07:38.884158 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 266/535] 10.222.0.70 () {56 vars in 1108 bytes} [Tue May 10 19:07:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:07:38.885169 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d354920-347a-4dc9-bc47-b9dccc19eee4 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:38.886954 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ef2359-42a5-45f9-a304-c8beeb863355 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:38.922601 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8c418d-5f8b-4796-b21a-730292b0c5d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:38.923280 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8c418d-5f8b-4796-b21a-730292b0c5d7 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:38.924565 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8c418d-5f8b-4796-b21a-730292b0c5d7 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:38.924565 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8c418d-5f8b-4796-b21a-730292b0c5d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:38.924866 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8c418d-5f8b-4796-b21a-730292b0c5d7 None admin] RBAC: Adding query filter params (role.id=445805bec1e741c9b823495ae6e364f0, scope.project.id=2ee9ec5b515440fe9b39aedf3e339c79, user.id=24ca97ff2a1745e58dedba4cef61b3f0) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:07:38.925003 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8c418d-5f8b-4796-b21a-730292b0c5d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:38.927087 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8c418d-5f8b-4796-b21a-730292b0c5d7 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:38.933210 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 270/536] 10.222.0.70 () {56 vars in 1374 bytes} [Tue May 10 19:07:38 2022] GET /identity/v3/role_assignments?user.id=24ca97ff2a1745e58dedba4cef61b3f0&scope.project.id=2ee9ec5b515440fe9b39aedf3e339c79&role.id=445805bec1e741c9b823495ae6e364f0 => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:07:38.934089 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8c418d-5f8b-4796-b21a-730292b0c5d7 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:39.004332 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d354920-347a-4dc9-bc47-b9dccc19eee4 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:39.039494 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f304e3c0-a7a7-4799-a7f7-380716615cec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:39.039708 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8c418d-5f8b-4796-b21a-730292b0c5d7 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:39.040170 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f304e3c0-a7a7-4799-a7f7-380716615cec None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:39.040475 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f304e3c0-a7a7-4799-a7f7-380716615cec None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:39.040760 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f304e3c0-a7a7-4799-a7f7-380716615cec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:39.041611 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f304e3c0-a7a7-4799-a7f7-380716615cec None admin] RBAC: Adding query filter params (role.id=445805bec1e741c9b823495ae6e364f0, scope.project.id=2ee9ec5b515440fe9b39aedf3e339c79, user.id=15df2a8967aa43299c10e365f4200d37) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:07:39.041923 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f304e3c0-a7a7-4799-a7f7-380716615cec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:39.043448 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f304e3c0-a7a7-4799-a7f7-380716615cec None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:39.049656 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 267/537] 10.222.0.70 () {56 vars in 1374 bytes} [Tue May 10 19:07:38 2022] GET /identity/v3/role_assignments?user.id=15df2a8967aa43299c10e365f4200d37&scope.project.id=2ee9ec5b515440fe9b39aedf3e339c79&role.id=445805bec1e741c9b823495ae6e364f0 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:07:39.078704 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ed0a72-c0f7-4804-ad8e-53e97c2a59a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:39.079395 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ed0a72-c0f7-4804-ad8e-53e97c2a59a7 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:39.079674 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ed0a72-c0f7-4804-ad8e-53e97c2a59a7 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:39.079948 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ed0a72-c0f7-4804-ad8e-53e97c2a59a7 None admin] PATH_INFO: `/v3/domains` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:39.080733 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ed0a72-c0f7-4804-ad8e-53e97c2a59a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:07:39.081040 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ed0a72-c0f7-4804-ad8e-53e97c2a59a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:39.083272 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ed0a72-c0f7-4804-ad8e-53e97c2a59a7 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:39.097393 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 271/538] 10.222.0.70 () {56 vars in 1109 bytes} [Tue May 10 19:07:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:07:39.102111 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f304e3c0-a7a7-4799-a7f7-380716615cec None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:39.222807 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f304e3c0-a7a7-4799-a7f7-380716615cec None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:39.257786 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18b71c6-666f-4c5a-80ac-0b4e5c048af7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:39.258605 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18b71c6-666f-4c5a-80ac-0b4e5c048af7 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:39.258890 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18b71c6-666f-4c5a-80ac-0b4e5c048af7 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:39.259167 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18b71c6-666f-4c5a-80ac-0b4e5c048af7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:39.266307 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18b71c6-666f-4c5a-80ac-0b4e5c048af7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:39.267786 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18b71c6-666f-4c5a-80ac-0b4e5c048af7 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:39.283200 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application [None req-d18b71c6-666f-4c5a-80ac-0b4e5c048af7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 19:07:39.283200 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:07:39.283200 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:07:39.283200 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:07:39.283200 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:07:39.283200 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:07:39.283200 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:07:39.283200 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:07:39.283200 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:07:39.283200 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:07:39.283200 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:07:39.283200 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:07:39.283200 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 19:07:39.283200 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 19:07:39.283200 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 19:07:39.285375 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 19:07:39.285375 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:07:39.285375 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:07:39.285375 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:07:39.285375 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:07:39.285375 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:07:39.285375 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:07:39.285375 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:07:39.285375 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application with Lock( May 10 19:07:39.285375 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:07:39.285375 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._enter() May 10 19:07:39.285375 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:07:39.285375 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:07:39.285375 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:07:39.285375 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.creator() May 10 19:07:39.285375 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:07:39.285375 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application created_value = creator( May 10 19:07:39.287445 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 19:07:39.287445 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 19:07:39.287445 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 19:07:39.287445 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 19:07:39.287445 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 19:07:39.287445 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 19:07:39.287445 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 19:07:39.287445 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application May 10 19:07:39.287445 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 268/539] 10.222.0.70 () {56 vars in 1111 bytes} [Tue May 10 19:07:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:07:39.296440 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ed0a72-c0f7-4804-ad8e-53e97c2a59a7 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:39.403595 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ed0a72-c0f7-4804-ad8e-53e97c2a59a7 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:39.437303 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020ed400-a747-4bbe-a8b5-3db5977f4978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:39.438074 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020ed400-a747-4bbe-a8b5-3db5977f4978 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:39.438235 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020ed400-a747-4bbe-a8b5-3db5977f4978 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:39.438508 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020ed400-a747-4bbe-a8b5-3db5977f4978 None admin] PATH_INFO: `/v3/projects` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:39.439298 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020ed400-a747-4bbe-a8b5-3db5977f4978 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:07:39.439628 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020ed400-a747-4bbe-a8b5-3db5977f4978 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:39.441602 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020ed400-a747-4bbe-a8b5-3db5977f4978 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:39.454262 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 272/540] 10.222.0.70 () {56 vars in 1148 bytes} [Tue May 10 19:07:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:07:39.460385 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18b71c6-666f-4c5a-80ac-0b4e5c048af7 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:39.560472 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18b71c6-666f-4c5a-80ac-0b4e5c048af7 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:39.596923 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6711261-4e71-4e1d-94f5-aac15db6016c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:39.598134 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6711261-4e71-4e1d-94f5-aac15db6016c None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:39.598424 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6711261-4e71-4e1d-94f5-aac15db6016c None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:39.598700 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6711261-4e71-4e1d-94f5-aac15db6016c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:39.599530 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6711261-4e71-4e1d-94f5-aac15db6016c None admin] RBAC: Adding query filter params (role.id=445805bec1e741c9b823495ae6e364f0, scope.project.id=2ee9ec5b515440fe9b39aedf3e339c79, user.id=91f1dc79540b48c0866478cc48cd8205) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:07:39.599843 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6711261-4e71-4e1d-94f5-aac15db6016c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:39.601305 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6711261-4e71-4e1d-94f5-aac15db6016c None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:39.607428 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 269/541] 10.222.0.70 () {56 vars in 1374 bytes} [Tue May 10 19:07:39 2022] GET /identity/v3/role_assignments?user.id=91f1dc79540b48c0866478cc48cd8205&scope.project.id=2ee9ec5b515440fe9b39aedf3e339c79&role.id=445805bec1e741c9b823495ae6e364f0 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:07:40.197450 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d6e914-364b-4a85-b9ec-9efd49eb77a5 None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:40.197450 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d6e914-364b-4a85-b9ec-9efd49eb77a5 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:40.197450 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d6e914-364b-4a85-b9ec-9efd49eb77a5 None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:40.198373 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 273/542] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:07:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:07:40.204783 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff31270-cfb0-4e16-9c04-3f90f06c2f72 None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:40.204783 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff31270-cfb0-4e16-9c04-3f90f06c2f72 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:40.204783 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff31270-cfb0-4e16-9c04-3f90f06c2f72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:40.236801 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-5ff31270-cfb0-4e16-9c04-3f90f06c2f72 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:07:40.238399 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-5ff31270-cfb0-4e16-9c04-3f90f06c2f72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:07:40.286410 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341c2a5f-5a44-423c-b7d9-342b8b8c80ab None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:40.287022 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341c2a5f-5a44-423c-b7d9-342b8b8c80ab None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:40.287494 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341c2a5f-5a44-423c-b7d9-342b8b8c80ab None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:40.289323 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 274/543] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:07:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:07:40.310989 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68af7684-2ea2-4a43-a9a3-bb0e0a138e1c None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:40.311653 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68af7684-2ea2-4a43-a9a3-bb0e0a138e1c None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:40.312128 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68af7684-2ea2-4a43-a9a3-bb0e0a138e1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:40.341255 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-68af7684-2ea2-4a43-a9a3-bb0e0a138e1c None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:07:40.342439 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-68af7684-2ea2-4a43-a9a3-bb0e0a138e1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:07:40.345795 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 270/544] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:07:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 19:07:40.404846 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff31270-cfb0-4e16-9c04-3f90f06c2f72 None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:40.443651 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 275/545] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:07:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 19:07:40.481902 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68af7684-2ea2-4a43-a9a3-bb0e0a138e1c None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:40.548831 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff31270-cfb0-4e16-9c04-3f90f06c2f72 None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:40.608553 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068d88c7-987e-4c41-86fd-071d7352a03d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:40.609353 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068d88c7-987e-4c41-86fd-071d7352a03d None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:40.609648 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068d88c7-987e-4c41-86fd-071d7352a03d None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:40.609931 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068d88c7-987e-4c41-86fd-071d7352a03d None admin] PATH_INFO: `/v3/roles/service` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:40.641918 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68af7684-2ea2-4a43-a9a3-bb0e0a138e1c None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:40.645332 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068d88c7-987e-4c41-86fd-071d7352a03d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:07:40.661400 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application [None req-068d88c7-987e-4c41-86fd-071d7352a03d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 19:07:40.661400 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:07:40.661400 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:07:40.661400 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:07:40.661400 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:07:40.661400 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:07:40.661400 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:07:40.661400 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:07:40.661400 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:07:40.661400 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:07:40.661400 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:07:40.661400 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:07:40.661400 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:07:40.661400 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:07:40.661400 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:07:40.661400 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:07:40.662322 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:07:40.662322 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:07:40.662322 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:07:40.662322 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:07:40.662322 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:07:40.662322 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:07:40.662322 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:07:40.662322 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:07:40.662322 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:07:40.662322 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:07:40.662322 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:07:40.662322 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application with Lock( May 10 19:07:40.662322 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:07:40.662322 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._enter() May 10 19:07:40.662322 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:07:40.662322 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:07:40.663114 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:07:40.663114 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.creator() May 10 19:07:40.663114 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:07:40.663114 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application created_value = creator( May 10 19:07:40.663114 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:07:40.663114 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:07:40.663114 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:07:40.663114 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:07:40.663114 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:07:40.663114 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:07:40.663114 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 19:07:40.663114 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application May 10 19:07:40.665846 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 271/546] 10.222.0.70 () {56 vars in 1102 bytes} [Tue May 10 19:07:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 19:07:40.671147 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068d88c7-987e-4c41-86fd-071d7352a03d None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:40.677613 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e533c783-52aa-4326-95a9-0c3f4e824828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:40.678597 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e533c783-52aa-4326-95a9-0c3f4e824828 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:40.679031 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e533c783-52aa-4326-95a9-0c3f4e824828 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:40.679455 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e533c783-52aa-4326-95a9-0c3f4e824828 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:40.689937 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e533c783-52aa-4326-95a9-0c3f4e824828 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:07:40.697873 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-e533c783-52aa-4326-95a9-0c3f4e824828 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 19:07:40.697873 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:07:40.697873 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:07:40.697873 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:07:40.697873 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:07:40.697873 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:07:40.697873 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:07:40.697873 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:07:40.697873 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:07:40.697873 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:07:40.697873 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:07:40.697873 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:07:40.697873 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:07:40.697873 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:07:40.697873 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:07:40.697873 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:07:40.698885 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:07:40.698885 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:07:40.698885 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:07:40.698885 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:07:40.698885 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:07:40.698885 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:07:40.698885 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:07:40.698885 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:07:40.698885 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:07:40.698885 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:07:40.698885 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:07:40.698885 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( May 10 19:07:40.698885 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:07:40.698885 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() May 10 19:07:40.698885 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:07:40.698885 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:07:40.699715 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:07:40.699715 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() May 10 19:07:40.699715 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:07:40.699715 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( May 10 19:07:40.699715 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:07:40.699715 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:07:40.699715 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:07:40.699715 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:07:40.699715 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:07:40.699715 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:07:40.699715 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 19:07:40.699715 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:07:40.702391 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 276/547] 10.222.0.70 () {56 vars in 1102 bytes} [Tue May 10 19:07:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 19:07:40.709103 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e533c783-52aa-4326-95a9-0c3f4e824828 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:40.832433 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068d88c7-987e-4c41-86fd-071d7352a03d None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:40.877119 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb632c1-afca-4015-8868-192f99ecc739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:40.878191 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb632c1-afca-4015-8868-192f99ecc739 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:40.878675 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb632c1-afca-4015-8868-192f99ecc739 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:40.879143 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb632c1-afca-4015-8868-192f99ecc739 None admin] PATH_INFO: `/v3/roles` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:40.880176 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb632c1-afca-4015-8868-192f99ecc739 None admin] RBAC: Adding query filter params (name=service) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:07:40.880769 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb632c1-afca-4015-8868-192f99ecc739 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:40.882364 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb632c1-afca-4015-8868-192f99ecc739 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:40.886266 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e533c783-52aa-4326-95a9-0c3f4e824828 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:40.892899 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 272/548] 10.222.0.70 () {56 vars in 1103 bytes} [Tue May 10 19:07:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:07:40.900146 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb632c1-afca-4015-8868-192f99ecc739 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:40.948619 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfece7a-e524-4140-ab04-9c4e4509d6ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:40.949674 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfece7a-e524-4140-ab04-9c4e4509d6ee None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:40.950154 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfece7a-e524-4140-ab04-9c4e4509d6ee None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:40.950621 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfece7a-e524-4140-ab04-9c4e4509d6ee None admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:40.951586 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfece7a-e524-4140-ab04-9c4e4509d6ee None admin] RBAC: Adding query filter params (name=service) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:07:40.952087 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfece7a-e524-4140-ab04-9c4e4509d6ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:40.954828 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfece7a-e524-4140-ab04-9c4e4509d6ee None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:40.983246 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 277/549] 10.222.0.70 () {56 vars in 1103 bytes} [Tue May 10 19:07:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:07:40.989299 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfece7a-e524-4140-ab04-9c4e4509d6ee None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:41.090486 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb632c1-afca-4015-8868-192f99ecc739 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:41.150192 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f446939b-7f30-47bc-8b91-2bfffdcfb7ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:41.151351 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f446939b-7f30-47bc-8b91-2bfffdcfb7ce None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:41.151834 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f446939b-7f30-47bc-8b91-2bfffdcfb7ce None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:41.152359 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f446939b-7f30-47bc-8b91-2bfffdcfb7ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:41.167814 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfece7a-e524-4140-ab04-9c4e4509d6ee None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:41.171812 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f446939b-7f30-47bc-8b91-2bfffdcfb7ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:41.177043 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f446939b-7f30-47bc-8b91-2bfffdcfb7ce None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:41.206931 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application [None req-f446939b-7f30-47bc-8b91-2bfffdcfb7ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:07:41.206931 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:07:41.206931 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:07:41.206931 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:07:41.206931 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:07:41.206931 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:07:41.206931 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:07:41.206931 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:07:41.206931 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:07:41.206931 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:07:41.206931 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:07:41.206931 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:07:41.206931 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 19:07:41.206931 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 19:07:41.206931 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 19:07:41.208127 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 19:07:41.208127 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:07:41.208127 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:07:41.208127 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:07:41.208127 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:07:41.208127 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:07:41.208127 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:07:41.208127 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:07:41.208127 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application with Lock( May 10 19:07:41.208127 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:07:41.208127 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._enter() May 10 19:07:41.208127 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:07:41.208127 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:07:41.208127 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:07:41.208127 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.creator() May 10 19:07:41.208127 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:07:41.208127 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application created_value = creator( May 10 19:07:41.209026 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 19:07:41.209026 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 19:07:41.209026 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:07:41.209026 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application May 10 19:07:41.217284 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 273/550] 10.222.0.70 () {56 vars in 1108 bytes} [Tue May 10 19:07:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:07:41.219366 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f446939b-7f30-47bc-8b91-2bfffdcfb7ce None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:41.234045 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219df0a5-7b83-44d8-b91e-b44d97a3b28e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:41.237833 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219df0a5-7b83-44d8-b91e-b44d97a3b28e None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:41.238334 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219df0a5-7b83-44d8-b91e-b44d97a3b28e None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:41.238804 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219df0a5-7b83-44d8-b91e-b44d97a3b28e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:41.256071 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219df0a5-7b83-44d8-b91e-b44d97a3b28e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:41.259173 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219df0a5-7b83-44d8-b91e-b44d97a3b28e None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:41.295297 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-219df0a5-7b83-44d8-b91e-b44d97a3b28e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:07:41.295297 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:07:41.295297 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:07:41.295297 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:07:41.295297 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:07:41.295297 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:07:41.295297 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:07:41.295297 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:07:41.295297 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:07:41.295297 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:07:41.295297 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:07:41.295297 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:07:41.295297 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 19:07:41.295297 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 19:07:41.295297 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 19:07:41.296214 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 19:07:41.296214 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:07:41.296214 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:07:41.296214 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:07:41.296214 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:07:41.296214 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:07:41.296214 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:07:41.296214 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:07:41.296214 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( May 10 19:07:41.296214 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:07:41.296214 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() May 10 19:07:41.296214 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:07:41.296214 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:07:41.296214 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:07:41.296214 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() May 10 19:07:41.296214 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:07:41.296214 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( May 10 19:07:41.297131 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 19:07:41.297131 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 19:07:41.297131 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:07:41.297131 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:07:41.306771 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 278/551] 10.222.0.70 () {56 vars in 1108 bytes} [Tue May 10 19:07:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 19:07:41.310040 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219df0a5-7b83-44d8-b91e-b44d97a3b28e None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:41.420463 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f446939b-7f30-47bc-8b91-2bfffdcfb7ce None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:41.463469 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee99e54-237c-4ad8-bfef-de7a44f56187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:41.464140 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee99e54-237c-4ad8-bfef-de7a44f56187 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:41.464441 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee99e54-237c-4ad8-bfef-de7a44f56187 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:41.464742 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee99e54-237c-4ad8-bfef-de7a44f56187 None admin] PATH_INFO: `/v3/domains` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:41.465467 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee99e54-237c-4ad8-bfef-de7a44f56187 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:07:41.465774 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee99e54-237c-4ad8-bfef-de7a44f56187 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:41.467154 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee99e54-237c-4ad8-bfef-de7a44f56187 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:41.489730 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 274/552] 10.222.0.70 () {56 vars in 1109 bytes} [Tue May 10 19:07:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:07:41.491518 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f92385-f529-475a-ac34-e5ff96e6e277 None None] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:41.491807 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f92385-f529-475a-ac34-e5ff96e6e277 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:41.492085 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f92385-f529-475a-ac34-e5ff96e6e277 None None] PATH_INFO: `/` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:41.497861 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 275/553] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:07:41 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:07:41.498608 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f92385-f529-475a-ac34-e5ff96e6e277 None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:41.510068 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219df0a5-7b83-44d8-b91e-b44d97a3b28e None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:41.552725 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e5ad81-9159-46bd-970b-7cbae7e1dc87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:41.553693 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e5ad81-9159-46bd-970b-7cbae7e1dc87 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:41.553980 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e5ad81-9159-46bd-970b-7cbae7e1dc87 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:41.554261 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e5ad81-9159-46bd-970b-7cbae7e1dc87 None admin] PATH_INFO: `/v3/domains` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:41.554988 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e5ad81-9159-46bd-970b-7cbae7e1dc87 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:07:41.555297 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e5ad81-9159-46bd-970b-7cbae7e1dc87 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:41.557286 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e5ad81-9159-46bd-970b-7cbae7e1dc87 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:41.574548 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 279/554] 10.222.0.70 () {56 vars in 1109 bytes} [Tue May 10 19:07:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:07:41.576003 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3820a4d8-0973-4b98-ac25-ddbc15d62275 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:41.576348 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3820a4d8-0973-4b98-ac25-ddbc15d62275 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:41.576659 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3820a4d8-0973-4b98-ac25-ddbc15d62275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:41.596450 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-3820a4d8-0973-4b98-ac25-ddbc15d62275 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:07:41.598549 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-3820a4d8-0973-4b98-ac25-ddbc15d62275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:07:41.609502 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f92385-f529-475a-ac34-e5ff96e6e277 None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:41.645670 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87732827-d421-402f-8428-ab9fe85f66ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:41.646613 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87732827-d421-402f-8428-ab9fe85f66ad None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:41.646992 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87732827-d421-402f-8428-ab9fe85f66ad None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:41.647410 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87732827-d421-402f-8428-ab9fe85f66ad None admin] PATH_INFO: `/v3/users/swift` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:41.656916 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87732827-d421-402f-8428-ab9fe85f66ad None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:41.658793 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87732827-d421-402f-8428-ab9fe85f66ad None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:41.675677 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 280/555] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:07:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 19:07:41.676625 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3820a4d8-0973-4b98-ac25-ddbc15d62275 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:41.694262 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application [None req-87732827-d421-402f-8428-ab9fe85f66ad None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 10 19:07:41.694262 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:07:41.694262 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:07:41.694262 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:07:41.694262 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:07:41.694262 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:07:41.694262 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:07:41.694262 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:07:41.694262 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:07:41.694262 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:07:41.694262 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:07:41.694262 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:07:41.694262 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 19:07:41.694262 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 19:07:41.694262 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 19:07:41.694262 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 19:07:41.696464 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:07:41.696464 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:07:41.696464 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 19:07:41.696464 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 19:07:41.696464 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 19:07:41.696464 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 19:07:41.696464 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:07:41.696464 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:07:41.696464 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:07:41.696464 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:07:41.696464 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:07:41.696464 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application with Lock( May 10 19:07:41.696464 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:07:41.696464 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._enter() May 10 19:07:41.696464 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:07:41.696464 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:07:41.696464 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:07:41.696464 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.creator() May 10 19:07:41.698647 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:07:41.698647 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application created_value = creator( May 10 19:07:41.698647 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 19:07:41.698647 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 19:07:41.698647 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 19:07:41.698647 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 19:07:41.698647 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 19:07:41.698647 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 19:07:41.698647 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 10 19:07:41.698647 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application May 10 19:07:41.703686 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 276/556] 10.222.0.70 () {56 vars in 1096 bytes} [Tue May 10 19:07:41 2022] GET /identity/v3/users/swift => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:07:41.703686 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87732827-d421-402f-8428-ab9fe85f66ad None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:41.820691 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3820a4d8-0973-4b98-ac25-ddbc15d62275 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:41.836083 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87732827-d421-402f-8428-ab9fe85f66ad None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:41.856823 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc580be-80c5-4bb7-9c31-eb28f9cec700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:41.857967 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc580be-80c5-4bb7-9c31-eb28f9cec700 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:41.858475 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc580be-80c5-4bb7-9c31-eb28f9cec700 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:41.858941 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc580be-80c5-4bb7-9c31-eb28f9cec700 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:41.867414 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc580be-80c5-4bb7-9c31-eb28f9cec700 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:41.869257 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc580be-80c5-4bb7-9c31-eb28f9cec700 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:41.880571 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b753f43-b15a-4123-b097-79895d7da9db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:41.881484 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b753f43-b15a-4123-b097-79895d7da9db None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:41.881887 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b753f43-b15a-4123-b097-79895d7da9db None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:41.882231 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b753f43-b15a-4123-b097-79895d7da9db None admin] PATH_INFO: `/v3/roles/service` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:41.886779 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-efc580be-80c5-4bb7-9c31-eb28f9cec700 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 10 19:07:41.886779 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:07:41.886779 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:07:41.886779 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:07:41.886779 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:07:41.886779 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:07:41.886779 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:07:41.886779 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:07:41.886779 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:07:41.886779 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:07:41.886779 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:07:41.886779 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:07:41.886779 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 19:07:41.886779 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 19:07:41.886779 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 19:07:41.886779 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 19:07:41.887746 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:07:41.887746 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:07:41.887746 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 19:07:41.887746 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 19:07:41.887746 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 19:07:41.887746 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 19:07:41.887746 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:07:41.887746 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:07:41.887746 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:07:41.887746 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:07:41.887746 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:07:41.887746 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( May 10 19:07:41.887746 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:07:41.887746 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() May 10 19:07:41.887746 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:07:41.887746 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:07:41.887746 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:07:41.887746 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() May 10 19:07:41.888950 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:07:41.888950 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( May 10 19:07:41.888950 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 19:07:41.888950 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 19:07:41.888950 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 19:07:41.888950 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 19:07:41.888950 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 19:07:41.888950 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 19:07:41.888950 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 10 19:07:41.888950 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:07:41.891433 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 281/557] 10.222.0.70 () {56 vars in 1093 bytes} [Tue May 10 19:07:41 2022] GET /identity/v3/users/nova => generated 82 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:07:41.892404 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc580be-80c5-4bb7-9c31-eb28f9cec700 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:41.899800 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b753f43-b15a-4123-b097-79895d7da9db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:07:41.910528 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application [None req-4b753f43-b15a-4123-b097-79895d7da9db None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 19:07:41.910528 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:07:41.910528 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:07:41.910528 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:07:41.910528 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:07:41.910528 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:07:41.910528 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:07:41.910528 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:07:41.910528 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:07:41.910528 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:07:41.910528 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:07:41.910528 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:07:41.910528 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:07:41.910528 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:07:41.910528 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:07:41.910528 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:07:41.911445 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:07:41.911445 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:07:41.911445 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:07:41.911445 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:07:41.911445 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:07:41.911445 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:07:41.911445 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:07:41.911445 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:07:41.911445 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:07:41.911445 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:07:41.911445 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:07:41.911445 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application with Lock( May 10 19:07:41.911445 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:07:41.911445 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._enter() May 10 19:07:41.911445 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:07:41.911445 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:07:41.912266 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:07:41.912266 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.creator() May 10 19:07:41.912266 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:07:41.912266 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application created_value = creator( May 10 19:07:41.912266 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:07:41.912266 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:07:41.912266 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:07:41.912266 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:07:41.912266 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:07:41.912266 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:07:41.912266 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 19:07:41.912266 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application May 10 19:07:41.916943 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 277/558] 10.222.0.70 () {56 vars in 1102 bytes} [Tue May 10 19:07:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:07:41.918202 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b753f43-b15a-4123-b097-79895d7da9db None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:42.005531 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc580be-80c5-4bb7-9c31-eb28f9cec700 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:42.023226 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b753f43-b15a-4123-b097-79895d7da9db None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:42.040902 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f28c332-b5f9-4d5c-b030-4988b878c1b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:42.041912 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f28c332-b5f9-4d5c-b030-4988b878c1b1 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:42.041912 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f28c332-b5f9-4d5c-b030-4988b878c1b1 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:42.042171 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f28c332-b5f9-4d5c-b030-4988b878c1b1 None admin] PATH_INFO: `/v3/users` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:42.042986 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f28c332-b5f9-4d5c-b030-4988b878c1b1 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:07:42.043293 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f28c332-b5f9-4d5c-b030-4988b878c1b1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:42.044869 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f28c332-b5f9-4d5c-b030-4988b878c1b1 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:42.060965 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea68bb0-7cc4-466d-9e88-74aae63d142a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:42.061693 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea68bb0-7cc4-466d-9e88-74aae63d142a None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:42.061990 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea68bb0-7cc4-466d-9e88-74aae63d142a None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:42.062205 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea68bb0-7cc4-466d-9e88-74aae63d142a None admin] PATH_INFO: `/v3/users` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:42.063092 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea68bb0-7cc4-466d-9e88-74aae63d142a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:07:42.063372 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea68bb0-7cc4-466d-9e88-74aae63d142a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:42.064006 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 282/559] 10.222.0.70 () {56 vars in 1135 bytes} [Tue May 10 19:07:41 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:07:42.068545 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f28c332-b5f9-4d5c-b030-4988b878c1b1 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:42.068734 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea68bb0-7cc4-466d-9e88-74aae63d142a None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:42.087378 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 278/560] 10.222.0.70 () {56 vars in 1133 bytes} [Tue May 10 19:07:41 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:07:42.089010 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d326843-a20d-47a4-92e2-da1e01f64734 None None] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:42.089010 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d326843-a20d-47a4-92e2-da1e01f64734 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:42.089335 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d326843-a20d-47a4-92e2-da1e01f64734 None None] PATH_INFO: `/` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:42.090736 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 279/561] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:07:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:07:42.091448 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d326843-a20d-47a4-92e2-da1e01f64734 None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:42.171135 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f28c332-b5f9-4d5c-b030-4988b878c1b1 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:42.204497 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3ee193-4477-404d-9318-53ef930dfb5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:42.205118 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3ee193-4477-404d-9318-53ef930dfb5f None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:42.205397 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3ee193-4477-404d-9318-53ef930dfb5f None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:42.205666 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3ee193-4477-404d-9318-53ef930dfb5f None admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:42.206945 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3ee193-4477-404d-9318-53ef930dfb5f None admin] RBAC: Adding query filter params (name=service) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:07:42.207499 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3ee193-4477-404d-9318-53ef930dfb5f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:42.208308 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d326843-a20d-47a4-92e2-da1e01f64734 None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:42.208888 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3ee193-4477-404d-9318-53ef930dfb5f None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:42.221371 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 283/562] 10.222.0.70 () {56 vars in 1103 bytes} [Tue May 10 19:07:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:07:42.221371 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3ee193-4477-404d-9318-53ef930dfb5f None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:42.246959 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4620b8c4-da7b-4269-9686-40626825a5f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:42.247663 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4620b8c4-da7b-4269-9686-40626825a5f5 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:42.247950 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4620b8c4-da7b-4269-9686-40626825a5f5 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:42.248297 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4620b8c4-da7b-4269-9686-40626825a5f5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:42.310605 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3ee193-4477-404d-9318-53ef930dfb5f None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:42.311220 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4620b8c4-da7b-4269-9686-40626825a5f5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:42.312739 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4620b8c4-da7b-4269-9686-40626825a5f5 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:42.341813 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb751f2-376d-4d0a-a95e-317a8977a002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:42.342594 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb751f2-376d-4d0a-a95e-317a8977a002 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:42.342870 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb751f2-376d-4d0a-a95e-317a8977a002 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:42.343140 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb751f2-376d-4d0a-a95e-317a8977a002 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:42.353022 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb751f2-376d-4d0a-a95e-317a8977a002 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:42.354445 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb751f2-376d-4d0a-a95e-317a8977a002 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:42.371073 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-0cb751f2-376d-4d0a-a95e-317a8977a002 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:07:42.371073 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:07:42.371073 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:07:42.371073 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:07:42.371073 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:07:42.371073 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:07:42.371073 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:07:42.371073 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:07:42.371073 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:07:42.371073 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:07:42.371073 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:07:42.371073 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:07:42.371073 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 19:07:42.371073 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 19:07:42.371073 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 19:07:42.372090 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 19:07:42.372090 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:07:42.372090 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:07:42.372090 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:07:42.372090 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:07:42.372090 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:07:42.372090 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:07:42.372090 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:07:42.372090 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( May 10 19:07:42.372090 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:07:42.372090 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() May 10 19:07:42.372090 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:07:42.372090 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:07:42.372090 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:07:42.372090 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() May 10 19:07:42.372090 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:07:42.372090 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( May 10 19:07:42.373071 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 19:07:42.373071 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 19:07:42.373071 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:07:42.373071 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:07:42.373071 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 284/563] 10.222.0.70 () {56 vars in 1108 bytes} [Tue May 10 19:07:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:07:42.373813 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a92eb87-e7db-4e64-b16f-062b274be93c None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:42.374096 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a92eb87-e7db-4e64-b16f-062b274be93c None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:42.374366 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a92eb87-e7db-4e64-b16f-062b274be93c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:42.389795 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-1a92eb87-e7db-4e64-b16f-062b274be93c None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:07:42.390957 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-1a92eb87-e7db-4e64-b16f-062b274be93c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:07:42.408798 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 280/564] 10.222.0.70 () {58 vars in 1282 bytes} [Tue May 10 19:07:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 19:07:42.409796 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4620b8c4-da7b-4269-9686-40626825a5f5 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:42.452552 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 285/565] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:07:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 19:07:42.453852 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499e3778-7228-4555-8260-912cd72fb6cf None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:42.454169 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499e3778-7228-4555-8260-912cd72fb6cf None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:42.454426 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499e3778-7228-4555-8260-912cd72fb6cf None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:42.460096 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 286/566] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:07:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:07:42.460096 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499e3778-7228-4555-8260-912cd72fb6cf None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:42.501519 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4620b8c4-da7b-4269-9686-40626825a5f5 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:42.532816 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc34757-9a6d-43aa-b485-49848eea00d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:42.533603 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc34757-9a6d-43aa-b485-49848eea00d6 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:42.533888 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc34757-9a6d-43aa-b485-49848eea00d6 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:42.534164 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc34757-9a6d-43aa-b485-49848eea00d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:42.544115 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc34757-9a6d-43aa-b485-49848eea00d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:42.545600 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc34757-9a6d-43aa-b485-49848eea00d6 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:42.557016 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499e3778-7228-4555-8260-912cd72fb6cf None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:42.562182 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application [None req-3fc34757-9a6d-43aa-b485-49848eea00d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:07:42.562182 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:07:42.562182 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:07:42.562182 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:07:42.562182 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:07:42.562182 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:07:42.562182 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:07:42.562182 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:07:42.562182 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:07:42.562182 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:07:42.562182 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:07:42.562182 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:07:42.562182 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 19:07:42.562182 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 19:07:42.562182 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 19:07:42.563135 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 19:07:42.563135 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:07:42.563135 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:07:42.563135 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:07:42.563135 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:07:42.563135 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:07:42.563135 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:07:42.563135 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:07:42.563135 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application with Lock( May 10 19:07:42.563135 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:07:42.563135 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._enter() May 10 19:07:42.563135 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:07:42.563135 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:07:42.563135 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:07:42.563135 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.creator() May 10 19:07:42.563135 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:07:42.563135 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application created_value = creator( May 10 19:07:42.564150 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 19:07:42.564150 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 19:07:42.564150 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:07:42.564150 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application May 10 19:07:42.564150 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 281/567] 10.222.0.70 () {56 vars in 1108 bytes} [Tue May 10 19:07:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:07:42.564150 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc34757-9a6d-43aa-b485-49848eea00d6 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:42.594194 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348e2255-f077-4332-9347-1d064db26def None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:42.594847 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348e2255-f077-4332-9347-1d064db26def None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:42.595126 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348e2255-f077-4332-9347-1d064db26def None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:42.595396 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348e2255-f077-4332-9347-1d064db26def None admin] PATH_INFO: `/v3/domains` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:42.596097 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348e2255-f077-4332-9347-1d064db26def None admin] RBAC: Adding query filter params (name=Default) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:07:42.596395 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348e2255-f077-4332-9347-1d064db26def None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:42.598327 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348e2255-f077-4332-9347-1d064db26def None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:42.608837 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 287/568] 10.222.0.70 () {56 vars in 1109 bytes} [Tue May 10 19:07:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:07:42.609996 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b61c40-a195-401f-a680-6b765a06a4e9 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:42.610284 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b61c40-a195-401f-a680-6b765a06a4e9 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:42.610555 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b61c40-a195-401f-a680-6b765a06a4e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:42.627269 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-49b61c40-a195-401f-a680-6b765a06a4e9 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:07:42.629076 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-49b61c40-a195-401f-a680-6b765a06a4e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:07:42.658849 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc34757-9a6d-43aa-b485-49848eea00d6 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:42.690493 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b698e0c-48fb-4ffb-af91-3aa6a1074c2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:42.691952 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b698e0c-48fb-4ffb-af91-3aa6a1074c2c None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:42.692235 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b698e0c-48fb-4ffb-af91-3aa6a1074c2c None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:42.692549 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b698e0c-48fb-4ffb-af91-3aa6a1074c2c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:42.694815 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 288/569] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:07:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 19:07:42.695638 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b61c40-a195-401f-a680-6b765a06a4e9 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:42.704003 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b698e0c-48fb-4ffb-af91-3aa6a1074c2c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:42.705493 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b698e0c-48fb-4ffb-af91-3aa6a1074c2c None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:42.722960 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application [None req-4b698e0c-48fb-4ffb-af91-3aa6a1074c2c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:07:42.722960 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:07:42.722960 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:07:42.722960 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:07:42.722960 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:07:42.722960 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:07:42.722960 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:07:42.722960 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:07:42.722960 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:07:42.722960 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:07:42.722960 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:07:42.722960 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:07:42.722960 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 19:07:42.722960 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 19:07:42.722960 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 19:07:42.724114 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 19:07:42.724114 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:07:42.724114 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:07:42.724114 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:07:42.724114 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:07:42.724114 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:07:42.724114 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:07:42.724114 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:07:42.724114 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application with Lock( May 10 19:07:42.724114 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:07:42.724114 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._enter() May 10 19:07:42.724114 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:07:42.724114 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:07:42.724114 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:07:42.724114 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.creator() May 10 19:07:42.724114 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:07:42.724114 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application created_value = creator( May 10 19:07:42.725431 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 19:07:42.725431 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 19:07:42.725431 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:07:42.725431 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application May 10 19:07:42.725431 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 282/570] 10.222.0.70 () {56 vars in 1108 bytes} [Tue May 10 19:07:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:07:42.725431 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b698e0c-48fb-4ffb-af91-3aa6a1074c2c None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:42.790667 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b61c40-a195-401f-a680-6b765a06a4e9 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:42.816697 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b698e0c-48fb-4ffb-af91-3aa6a1074c2c None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:42.821792 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d81ebb3-dbea-4136-8d05-8dd1c87a9035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:42.822585 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d81ebb3-dbea-4136-8d05-8dd1c87a9035 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:42.822867 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d81ebb3-dbea-4136-8d05-8dd1c87a9035 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:42.823139 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d81ebb3-dbea-4136-8d05-8dd1c87a9035 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:42.833584 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d81ebb3-dbea-4136-8d05-8dd1c87a9035 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:07:42.841157 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-3d81ebb3-dbea-4136-8d05-8dd1c87a9035 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 19:07:42.841157 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:07:42.841157 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:07:42.841157 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:07:42.841157 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:07:42.841157 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:07:42.841157 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:07:42.841157 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:07:42.841157 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:07:42.841157 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:07:42.841157 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:07:42.841157 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:07:42.841157 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:07:42.841157 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:07:42.841157 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:07:42.841157 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:07:42.842063 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:07:42.842063 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:07:42.842063 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:07:42.842063 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:07:42.842063 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:07:42.842063 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:07:42.842063 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:07:42.842063 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:07:42.842063 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:07:42.842063 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:07:42.842063 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:07:42.842063 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( May 10 19:07:42.842063 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:07:42.842063 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() May 10 19:07:42.842063 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:07:42.842063 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:07:42.842925 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:07:42.842925 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() May 10 19:07:42.842925 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:07:42.842925 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( May 10 19:07:42.842925 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:07:42.842925 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:07:42.842925 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:07:42.842925 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:07:42.842925 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:07:42.842925 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:07:42.842925 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 19:07:42.842925 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:07:42.842925 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 289/571] 10.222.0.70 () {56 vars in 1102 bytes} [Tue May 10 19:07:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:07:42.844161 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d81ebb3-dbea-4136-8d05-8dd1c87a9035 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:42.849616 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9bdd8d-347f-4861-9f8e-3e5b6ee543f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:42.850277 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9bdd8d-347f-4861-9f8e-3e5b6ee543f4 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:42.850555 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9bdd8d-347f-4861-9f8e-3e5b6ee543f4 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:42.850829 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9bdd8d-347f-4861-9f8e-3e5b6ee543f4 None admin] PATH_INFO: `/v3/domains` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:42.851533 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9bdd8d-347f-4861-9f8e-3e5b6ee543f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:07:42.851830 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9bdd8d-347f-4861-9f8e-3e5b6ee543f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:42.853223 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9bdd8d-347f-4861-9f8e-3e5b6ee543f4 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:42.864500 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 283/572] 10.222.0.70 () {56 vars in 1109 bytes} [Tue May 10 19:07:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:07:42.865459 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9bdd8d-347f-4861-9f8e-3e5b6ee543f4 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:42.965310 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d81ebb3-dbea-4136-8d05-8dd1c87a9035 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:42.980872 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9bdd8d-347f-4861-9f8e-3e5b6ee543f4 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:42.996780 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25b4e1f-8ac3-4128-b410-0c5994183930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:42.997566 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25b4e1f-8ac3-4128-b410-0c5994183930 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:42.997851 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25b4e1f-8ac3-4128-b410-0c5994183930 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:42.998127 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25b4e1f-8ac3-4128-b410-0c5994183930 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:43.004521 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25b4e1f-8ac3-4128-b410-0c5994183930 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:43.005991 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25b4e1f-8ac3-4128-b410-0c5994183930 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:43.011367 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc75e1e-10b1-4914-9dd6-172899e4a0a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:43.012161 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc75e1e-10b1-4914-9dd6-172899e4a0a2 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:43.012460 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc75e1e-10b1-4914-9dd6-172899e4a0a2 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:43.012736 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc75e1e-10b1-4914-9dd6-172899e4a0a2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:43.020949 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-f25b4e1f-8ac3-4128-b410-0c5994183930 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 19:07:43.020949 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:07:43.020949 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:07:43.020949 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:07:43.020949 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:07:43.020949 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:07:43.020949 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:07:43.020949 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:07:43.020949 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:07:43.020949 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:07:43.020949 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:07:43.020949 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:07:43.020949 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 19:07:43.020949 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 19:07:43.020949 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 19:07:43.022005 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 19:07:43.022005 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:07:43.022005 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:07:43.022005 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:07:43.022005 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:07:43.022005 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:07:43.022005 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:07:43.022005 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:07:43.022005 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( May 10 19:07:43.022005 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:07:43.022005 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() May 10 19:07:43.022005 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:07:43.022005 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:07:43.022005 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:07:43.022005 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() May 10 19:07:43.022005 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:07:43.022005 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( May 10 19:07:43.023000 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 19:07:43.023000 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 19:07:43.023000 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 19:07:43.023000 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 19:07:43.023000 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 19:07:43.023000 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 19:07:43.023000 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 19:07:43.023000 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:07:43.023000 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 290/573] 10.222.0.70 () {56 vars in 1111 bytes} [Tue May 10 19:07:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:07:43.023000 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25b4e1f-8ac3-4128-b410-0c5994183930 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:43.024375 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc75e1e-10b1-4914-9dd6-172899e4a0a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:07:43.031981 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application [None req-2fc75e1e-10b1-4914-9dd6-172899e4a0a2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 19:07:43.031981 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:07:43.031981 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:07:43.031981 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:07:43.031981 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:07:43.031981 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:07:43.031981 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:07:43.031981 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:07:43.031981 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:07:43.031981 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:07:43.031981 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:07:43.031981 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:07:43.031981 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:07:43.031981 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:07:43.031981 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:07:43.031981 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:07:43.033156 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:07:43.033156 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:07:43.033156 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:07:43.033156 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:07:43.033156 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:07:43.033156 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:07:43.033156 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:07:43.033156 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:07:43.033156 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:07:43.033156 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:07:43.033156 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:07:43.033156 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application with Lock( May 10 19:07:43.033156 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:07:43.033156 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._enter() May 10 19:07:43.033156 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:07:43.033156 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:07:43.034038 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:07:43.034038 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.creator() May 10 19:07:43.034038 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:07:43.034038 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application created_value = creator( May 10 19:07:43.034038 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:07:43.034038 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:07:43.034038 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:07:43.034038 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:07:43.034038 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:07:43.034038 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:07:43.034038 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 19:07:43.034038 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application May 10 19:07:43.034038 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 284/574] 10.222.0.70 () {56 vars in 1102 bytes} [Tue May 10 19:07:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:07:43.034038 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc75e1e-10b1-4914-9dd6-172899e4a0a2 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:43.117938 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25b4e1f-8ac3-4128-b410-0c5994183930 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:43.125001 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc75e1e-10b1-4914-9dd6-172899e4a0a2 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:43.149450 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965d66e9-4b76-4248-a8c1-b0527f392cf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:43.150107 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965d66e9-4b76-4248-a8c1-b0527f392cf0 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:43.150387 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965d66e9-4b76-4248-a8c1-b0527f392cf0 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:43.150660 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965d66e9-4b76-4248-a8c1-b0527f392cf0 None admin] PATH_INFO: `/v3/domains` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:43.151367 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965d66e9-4b76-4248-a8c1-b0527f392cf0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:07:43.151672 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965d66e9-4b76-4248-a8c1-b0527f392cf0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:43.153059 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965d66e9-4b76-4248-a8c1-b0527f392cf0 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:43.156140 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c5dc73-3c0f-4062-b97e-5124e189df42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:43.156829 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c5dc73-3c0f-4062-b97e-5124e189df42 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:43.157115 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c5dc73-3c0f-4062-b97e-5124e189df42 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:43.157393 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c5dc73-3c0f-4062-b97e-5124e189df42 None admin] PATH_INFO: `/v3/roles` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:43.158126 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c5dc73-3c0f-4062-b97e-5124e189df42 None admin] RBAC: Adding query filter params (name=service) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:07:43.158433 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c5dc73-3c0f-4062-b97e-5124e189df42 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:43.160394 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c5dc73-3c0f-4062-b97e-5124e189df42 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:43.164076 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 291/575] 10.222.0.70 () {56 vars in 1109 bytes} [Tue May 10 19:07:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:07:43.164883 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965d66e9-4b76-4248-a8c1-b0527f392cf0 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:43.171779 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 285/576] 10.222.0.70 () {56 vars in 1103 bytes} [Tue May 10 19:07:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:07:43.172532 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c5dc73-3c0f-4062-b97e-5124e189df42 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:43.256581 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965d66e9-4b76-4248-a8c1-b0527f392cf0 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:43.265824 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c5dc73-3c0f-4062-b97e-5124e189df42 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:43.288469 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214dac77-5d36-48a2-8a7c-57f035f6497d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:43.289291 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214dac77-5d36-48a2-8a7c-57f035f6497d None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:43.289542 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214dac77-5d36-48a2-8a7c-57f035f6497d None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:43.289816 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214dac77-5d36-48a2-8a7c-57f035f6497d None admin] PATH_INFO: `/v3/users/glance` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:43.296914 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214dac77-5d36-48a2-8a7c-57f035f6497d None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:43.298340 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214dac77-5d36-48a2-8a7c-57f035f6497d None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:43.300287 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9f86d5-9806-4181-b711-776b6b6ae725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:43.300971 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9f86d5-9806-4181-b711-776b6b6ae725 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:43.301252 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9f86d5-9806-4181-b711-776b6b6ae725 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:43.301529 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9f86d5-9806-4181-b711-776b6b6ae725 None admin] PATH_INFO: `/v3/projects` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:43.302308 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9f86d5-9806-4181-b711-776b6b6ae725 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:07:43.302616 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9f86d5-9806-4181-b711-776b6b6ae725 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:43.304034 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9f86d5-9806-4181-b711-776b6b6ae725 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:43.311934 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-214dac77-5d36-48a2-8a7c-57f035f6497d None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 10 19:07:43.311934 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:07:43.311934 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:07:43.311934 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:07:43.311934 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:07:43.311934 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:07:43.311934 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:07:43.311934 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:07:43.311934 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:07:43.311934 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:07:43.311934 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:07:43.311934 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:07:43.311934 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 19:07:43.311934 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 19:07:43.311934 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 19:07:43.311934 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 19:07:43.312906 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:07:43.312906 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:07:43.312906 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 19:07:43.312906 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 19:07:43.312906 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 19:07:43.312906 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 19:07:43.312906 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:07:43.312906 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:07:43.312906 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:07:43.312906 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:07:43.312906 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:07:43.312906 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( May 10 19:07:43.312906 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:07:43.312906 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() May 10 19:07:43.312906 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:07:43.312906 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:07:43.312906 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:07:43.312906 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() May 10 19:07:43.313853 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:07:43.313853 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( May 10 19:07:43.313853 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 19:07:43.313853 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 19:07:43.313853 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 19:07:43.313853 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 19:07:43.313853 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 19:07:43.313853 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 19:07:43.313853 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 10 19:07:43.313853 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:07:43.313853 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 292/577] 10.222.0.70 () {56 vars in 1099 bytes} [Tue May 10 19:07:43 2022] GET /identity/v3/users/glance => generated 84 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:07:43.313853 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214dac77-5d36-48a2-8a7c-57f035f6497d None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:43.320235 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 286/578] 10.222.0.70 () {56 vars in 1148 bytes} [Tue May 10 19:07:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:07:43.321057 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9f86d5-9806-4181-b711-776b6b6ae725 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:43.407243 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214dac77-5d36-48a2-8a7c-57f035f6497d None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:43.411451 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9f86d5-9806-4181-b711-776b6b6ae725 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:43.438443 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e551b8c6-4c22-4413-8234-361a3bc8a168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:43.439098 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e551b8c6-4c22-4413-8234-361a3bc8a168 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:43.439373 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e551b8c6-4c22-4413-8234-361a3bc8a168 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:43.439645 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e551b8c6-4c22-4413-8234-361a3bc8a168 None admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:43.440371 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e551b8c6-4c22-4413-8234-361a3bc8a168 None admin] RBAC: Adding query filter params (name=service) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:07:43.441301 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e551b8c6-4c22-4413-8234-361a3bc8a168 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:43.442701 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e551b8c6-4c22-4413-8234-361a3bc8a168 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:43.443280 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1569c8f6-ad94-442d-831b-da23a855ffc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:43.444064 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1569c8f6-ad94-442d-831b-da23a855ffc7 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:43.444348 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1569c8f6-ad94-442d-831b-da23a855ffc7 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:43.444653 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1569c8f6-ad94-442d-831b-da23a855ffc7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:43.450420 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 293/579] 10.222.0.70 () {56 vars in 1103 bytes} [Tue May 10 19:07:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:07:43.451058 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e551b8c6-4c22-4413-8234-361a3bc8a168 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:43.451900 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1569c8f6-ad94-442d-831b-da23a855ffc7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:43.453370 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1569c8f6-ad94-442d-831b-da23a855ffc7 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:43.467119 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application [None req-1569c8f6-ad94-442d-831b-da23a855ffc7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 19:07:43.467119 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:07:43.467119 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:07:43.467119 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:07:43.467119 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:07:43.467119 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:07:43.467119 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:07:43.467119 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:07:43.467119 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:07:43.467119 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:07:43.467119 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:07:43.467119 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:07:43.467119 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 19:07:43.467119 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 19:07:43.467119 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 19:07:43.468102 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 19:07:43.468102 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:07:43.468102 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:07:43.468102 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:07:43.468102 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:07:43.468102 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:07:43.468102 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:07:43.468102 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:07:43.468102 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application with Lock( May 10 19:07:43.468102 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:07:43.468102 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._enter() May 10 19:07:43.468102 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:07:43.468102 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:07:43.468102 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:07:43.468102 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.creator() May 10 19:07:43.468102 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:07:43.468102 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application created_value = creator( May 10 19:07:43.469051 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 19:07:43.469051 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 19:07:43.469051 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 19:07:43.469051 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 19:07:43.469051 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 19:07:43.469051 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 19:07:43.469051 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 19:07:43.469051 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application May 10 19:07:43.469051 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 287/580] 10.222.0.70 () {56 vars in 1111 bytes} [Tue May 10 19:07:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:07:43.469051 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1569c8f6-ad94-442d-831b-da23a855ffc7 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:43.542458 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e551b8c6-4c22-4413-8234-361a3bc8a168 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:43.561718 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1569c8f6-ad94-442d-831b-da23a855ffc7 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:43.572775 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1592d1-fc8c-4519-a6ba-70de2a7c7959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:43.573559 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1592d1-fc8c-4519-a6ba-70de2a7c7959 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:43.573837 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1592d1-fc8c-4519-a6ba-70de2a7c7959 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:43.574108 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1592d1-fc8c-4519-a6ba-70de2a7c7959 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:43.584876 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1592d1-fc8c-4519-a6ba-70de2a7c7959 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:43.586333 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1592d1-fc8c-4519-a6ba-70de2a7c7959 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:43.594340 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df85c52-b08e-4a56-8b39-fd1df0f3e27e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:43.594999 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df85c52-b08e-4a56-8b39-fd1df0f3e27e None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:43.595282 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df85c52-b08e-4a56-8b39-fd1df0f3e27e None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:43.595559 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df85c52-b08e-4a56-8b39-fd1df0f3e27e None admin] PATH_INFO: `/v3/users` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:43.596387 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df85c52-b08e-4a56-8b39-fd1df0f3e27e None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:07:43.596729 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df85c52-b08e-4a56-8b39-fd1df0f3e27e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:43.598249 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df85c52-b08e-4a56-8b39-fd1df0f3e27e None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:43.602534 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-0f1592d1-fc8c-4519-a6ba-70de2a7c7959 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:07:43.602534 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:07:43.602534 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:07:43.602534 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:07:43.602534 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:07:43.602534 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:07:43.602534 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:07:43.602534 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:07:43.602534 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:07:43.602534 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:07:43.602534 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:07:43.602534 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:07:43.602534 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 19:07:43.602534 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 19:07:43.602534 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 19:07:43.603430 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 19:07:43.603430 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:07:43.603430 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:07:43.603430 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:07:43.603430 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:07:43.603430 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:07:43.603430 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:07:43.603430 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:07:43.603430 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( May 10 19:07:43.603430 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:07:43.603430 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() May 10 19:07:43.603430 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:07:43.603430 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:07:43.603430 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:07:43.603430 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() May 10 19:07:43.603430 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:07:43.603430 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( May 10 19:07:43.604318 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 19:07:43.604318 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 19:07:43.604318 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:07:43.604318 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:07:43.604318 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 294/581] 10.222.0.70 () {56 vars in 1108 bytes} [Tue May 10 19:07:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:07:43.604647 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1592d1-fc8c-4519-a6ba-70de2a7c7959 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:43.615531 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 288/582] 10.222.0.70 () {56 vars in 1137 bytes} [Tue May 10 19:07:43 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:07:43.616265 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df85c52-b08e-4a56-8b39-fd1df0f3e27e None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:43.698372 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1592d1-fc8c-4519-a6ba-70de2a7c7959 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:43.707516 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df85c52-b08e-4a56-8b39-fd1df0f3e27e None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:43.729714 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095361c0-9ae8-40e4-878a-6a5cef4edaba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:43.730712 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095361c0-9ae8-40e4-878a-6a5cef4edaba None admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:43.730995 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095361c0-9ae8-40e4-878a-6a5cef4edaba None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:43.731268 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095361c0-9ae8-40e4-878a-6a5cef4edaba None admin] PATH_INFO: `/v3/projects/2ee9ec5b515440fe9b39aedf3e339c79/users/b9f310a468ec4058b3c95356ea60ab4c/roles/445805bec1e741c9b823495ae6e364f0` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:43.739289 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526918eb-82dd-40c9-bdf1-db39d4bebce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:43.740067 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526918eb-82dd-40c9-bdf1-db39d4bebce2 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:43.740357 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526918eb-82dd-40c9-bdf1-db39d4bebce2 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:43.740662 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526918eb-82dd-40c9-bdf1-db39d4bebce2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:43.745256 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095361c0-9ae8-40e4-878a-6a5cef4edaba None admin] RBAC: Authorizing `identity:create_grant(project_id=2ee9ec5b515440fe9b39aedf3e339c79, user_id=b9f310a468ec4058b3c95356ea60ab4c, role_id=445805bec1e741c9b823495ae6e364f0)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:43.746685 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095361c0-9ae8-40e4-878a-6a5cef4edaba None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:43.750182 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526918eb-82dd-40c9-bdf1-db39d4bebce2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:43.752079 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526918eb-82dd-40c9-bdf1-db39d4bebce2 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:43.758844 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 295/583] 10.222.0.70 () {58 vars in 1439 bytes} [Tue May 10 19:07:43 2022] PUT /identity/v3/projects/2ee9ec5b515440fe9b39aedf3e339c79/users/b9f310a468ec4058b3c95356ea60ab4c/roles/445805bec1e741c9b823495ae6e364f0 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:07:43.759630 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095361c0-9ae8-40e4-878a-6a5cef4edaba None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:43.770531 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application [None req-526918eb-82dd-40c9-bdf1-db39d4bebce2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:07:43.770531 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:07:43.770531 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:07:43.770531 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:07:43.770531 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:07:43.770531 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:07:43.770531 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:07:43.770531 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:07:43.770531 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:07:43.770531 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:07:43.770531 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:07:43.770531 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:07:43.770531 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 19:07:43.770531 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 19:07:43.770531 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 19:07:43.771661 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 19:07:43.771661 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:07:43.771661 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:07:43.771661 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:07:43.771661 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:07:43.771661 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:07:43.771661 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:07:43.771661 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:07:43.771661 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application with Lock( May 10 19:07:43.771661 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:07:43.771661 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._enter() May 10 19:07:43.771661 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:07:43.771661 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:07:43.771661 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:07:43.771661 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.creator() May 10 19:07:43.771661 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:07:43.771661 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application created_value = creator( May 10 19:07:43.773041 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 19:07:43.773041 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 19:07:43.773041 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:07:43.773041 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application May 10 19:07:43.773041 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 289/584] 10.222.0.70 () {56 vars in 1108 bytes} [Tue May 10 19:07:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:07:43.773041 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526918eb-82dd-40c9-bdf1-db39d4bebce2 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:43.869851 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095361c0-9ae8-40e4-878a-6a5cef4edaba None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:43.885053 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526918eb-82dd-40c9-bdf1-db39d4bebce2 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:43.904209 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1b3a58-e206-40c7-a535-ab1cf5b9f373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:43.904936 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1b3a58-e206-40c7-a535-ab1cf5b9f373 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:43.905214 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1b3a58-e206-40c7-a535-ab1cf5b9f373 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:43.905486 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1b3a58-e206-40c7-a535-ab1cf5b9f373 None admin] PATH_INFO: `/v3/projects` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:43.906281 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1b3a58-e206-40c7-a535-ab1cf5b9f373 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:07:43.906583 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1b3a58-e206-40c7-a535-ab1cf5b9f373 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:43.908134 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1b3a58-e206-40c7-a535-ab1cf5b9f373 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:43.925063 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 296/585] 10.222.0.70 () {56 vars in 1148 bytes} [Tue May 10 19:07:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:07:43.925063 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1b3a58-e206-40c7-a535-ab1cf5b9f373 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:43.926186 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7d3410-dae5-481b-b88b-617030ff0c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:43.926880 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7d3410-dae5-481b-b88b-617030ff0c06 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:43.927164 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7d3410-dae5-481b-b88b-617030ff0c06 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:43.927440 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7d3410-dae5-481b-b88b-617030ff0c06 None admin] PATH_INFO: `/v3/domains` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:43.928169 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7d3410-dae5-481b-b88b-617030ff0c06 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:07:43.928506 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7d3410-dae5-481b-b88b-617030ff0c06 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:43.929917 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7d3410-dae5-481b-b88b-617030ff0c06 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:43.944946 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 290/586] 10.222.0.70 () {56 vars in 1109 bytes} [Tue May 10 19:07:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:07:43.944946 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7d3410-dae5-481b-b88b-617030ff0c06 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:44.033324 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1b3a58-e206-40c7-a535-ab1cf5b9f373 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:44.042615 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7d3410-dae5-481b-b88b-617030ff0c06 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:44.066881 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7594f095-f278-4b4f-a965-2cbfc4a14dc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:44.067668 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7594f095-f278-4b4f-a965-2cbfc4a14dc6 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:44.067946 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7594f095-f278-4b4f-a965-2cbfc4a14dc6 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:44.068211 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7594f095-f278-4b4f-a965-2cbfc4a14dc6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:44.074706 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d78d39-88c2-42b2-8ff5-0531a6b6dd51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:44.075363 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d78d39-88c2-42b2-8ff5-0531a6b6dd51 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:44.075647 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d78d39-88c2-42b2-8ff5-0531a6b6dd51 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:44.076228 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d78d39-88c2-42b2-8ff5-0531a6b6dd51 None admin] PATH_INFO: `/v3/domains` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:44.076702 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d78d39-88c2-42b2-8ff5-0531a6b6dd51 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:07:44.077006 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d78d39-88c2-42b2-8ff5-0531a6b6dd51 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:44.078421 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d78d39-88c2-42b2-8ff5-0531a6b6dd51 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:44.080387 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7594f095-f278-4b4f-a965-2cbfc4a14dc6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:44.082367 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7594f095-f278-4b4f-a965-2cbfc4a14dc6 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:44.090294 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 291/587] 10.222.0.70 () {56 vars in 1109 bytes} [Tue May 10 19:07:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:07:44.091102 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d78d39-88c2-42b2-8ff5-0531a6b6dd51 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:44.102940 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-7594f095-f278-4b4f-a965-2cbfc4a14dc6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:07:44.102940 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:07:44.102940 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:07:44.102940 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:07:44.102940 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:07:44.102940 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:07:44.102940 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:07:44.102940 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:07:44.102940 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:07:44.102940 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:07:44.102940 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:07:44.102940 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:07:44.102940 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 19:07:44.102940 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 19:07:44.102940 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 19:07:44.103861 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 19:07:44.103861 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:07:44.103861 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:07:44.103861 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:07:44.103861 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:07:44.103861 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:07:44.103861 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:07:44.103861 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:07:44.103861 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( May 10 19:07:44.103861 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:07:44.103861 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() May 10 19:07:44.103861 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:07:44.103861 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:07:44.103861 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:07:44.103861 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() May 10 19:07:44.103861 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:07:44.103861 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( May 10 19:07:44.105451 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 19:07:44.105451 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 19:07:44.105451 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:07:44.105451 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:07:44.105451 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 297/588] 10.222.0.70 () {56 vars in 1108 bytes} [Tue May 10 19:07:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:07:44.105451 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7594f095-f278-4b4f-a965-2cbfc4a14dc6 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:44.187591 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d78d39-88c2-42b2-8ff5-0531a6b6dd51 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:44.209413 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7594f095-f278-4b4f-a965-2cbfc4a14dc6 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:44.220139 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adee0697-157e-408c-8ec6-0b6819d54370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:44.220827 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adee0697-157e-408c-8ec6-0b6819d54370 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:44.221107 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adee0697-157e-408c-8ec6-0b6819d54370 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:44.221380 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adee0697-157e-408c-8ec6-0b6819d54370 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:44.222737 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adee0697-157e-408c-8ec6-0b6819d54370 None admin] RBAC: Adding query filter params (role.id=445805bec1e741c9b823495ae6e364f0, scope.project.id=2ee9ec5b515440fe9b39aedf3e339c79, user.id=0454aa03fa31487ea1464b9d0008212c) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:07:44.223044 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adee0697-157e-408c-8ec6-0b6819d54370 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:44.224492 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adee0697-157e-408c-8ec6-0b6819d54370 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:44.232752 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 292/589] 10.222.0.70 () {56 vars in 1374 bytes} [Tue May 10 19:07:44 2022] GET /identity/v3/role_assignments?user.id=0454aa03fa31487ea1464b9d0008212c&scope.project.id=2ee9ec5b515440fe9b39aedf3e339c79&role.id=445805bec1e741c9b823495ae6e364f0 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:07:44.234019 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adee0697-157e-408c-8ec6-0b6819d54370 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:44.244711 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ab0726-a684-4d28-b5f9-95a268fc6f5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:44.245989 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ab0726-a684-4d28-b5f9-95a268fc6f5f None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:44.246476 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ab0726-a684-4d28-b5f9-95a268fc6f5f None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:44.246975 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ab0726-a684-4d28-b5f9-95a268fc6f5f None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:44.256785 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ab0726-a684-4d28-b5f9-95a268fc6f5f None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:44.258711 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ab0726-a684-4d28-b5f9-95a268fc6f5f None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:44.274396 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-22ab0726-a684-4d28-b5f9-95a268fc6f5f None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 10 19:07:44.274396 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:07:44.274396 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:07:44.274396 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:07:44.274396 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:07:44.274396 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:07:44.274396 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:07:44.274396 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:07:44.274396 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:07:44.274396 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:07:44.274396 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:07:44.274396 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:07:44.274396 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 19:07:44.274396 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 19:07:44.274396 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 19:07:44.274396 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 19:07:44.275423 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:07:44.275423 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:07:44.275423 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 19:07:44.275423 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 19:07:44.275423 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 19:07:44.275423 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 19:07:44.275423 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:07:44.275423 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:07:44.275423 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:07:44.275423 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:07:44.275423 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:07:44.275423 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( May 10 19:07:44.275423 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:07:44.275423 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() May 10 19:07:44.275423 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:07:44.275423 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:07:44.275423 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:07:44.275423 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() May 10 19:07:44.276375 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:07:44.276375 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( May 10 19:07:44.276375 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 19:07:44.276375 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 19:07:44.276375 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 19:07:44.276375 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 19:07:44.276375 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 19:07:44.276375 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 19:07:44.276375 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 10 19:07:44.276375 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:07:44.279178 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 298/590] 10.222.0.70 () {56 vars in 1099 bytes} [Tue May 10 19:07:44 2022] GET /identity/v3/users/cinder => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:07:44.280358 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ab0726-a684-4d28-b5f9-95a268fc6f5f None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:44.371623 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adee0697-157e-408c-8ec6-0b6819d54370 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:44.392304 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ab0726-a684-4d28-b5f9-95a268fc6f5f None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:44.407031 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd16e2c-f9ed-4997-9af6-f6fcfa9debc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:44.407810 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd16e2c-f9ed-4997-9af6-f6fcfa9debc8 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:44.408095 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd16e2c-f9ed-4997-9af6-f6fcfa9debc8 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:44.408369 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd16e2c-f9ed-4997-9af6-f6fcfa9debc8 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:44.416506 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd16e2c-f9ed-4997-9af6-f6fcfa9debc8 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:44.417993 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd16e2c-f9ed-4997-9af6-f6fcfa9debc8 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:44.433268 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df929f9-b026-45d8-9ded-56aa01ad53bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:44.433460 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application [None req-bbd16e2c-f9ed-4997-9af6-f6fcfa9debc8 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 10 19:07:44.433460 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:07:44.433460 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:07:44.433460 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:07:44.433460 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:07:44.433460 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:07:44.433460 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:07:44.433460 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:07:44.433460 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:07:44.433460 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:07:44.433460 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:07:44.433460 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:07:44.433460 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 19:07:44.433460 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 19:07:44.433460 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 19:07:44.433460 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 19:07:44.434347 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:07:44.434347 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:07:44.434347 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 19:07:44.434347 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 19:07:44.434347 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 19:07:44.434347 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 19:07:44.434347 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:07:44.434347 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:07:44.434347 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:07:44.434347 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:07:44.434347 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:07:44.434347 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application with Lock( May 10 19:07:44.434347 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:07:44.434347 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._enter() May 10 19:07:44.434347 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:07:44.434347 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:07:44.434347 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:07:44.434347 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.creator() May 10 19:07:44.435307 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:07:44.435307 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application created_value = creator( May 10 19:07:44.435307 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 19:07:44.435307 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 19:07:44.435307 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 19:07:44.435307 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 19:07:44.435307 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 19:07:44.435307 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 19:07:44.435307 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 10 19:07:44.435307 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application May 10 19:07:44.435307 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 293/591] 10.222.0.70 () {56 vars in 1102 bytes} [Tue May 10 19:07:44 2022] GET /identity/v3/users/neutron => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:07:44.435898 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd16e2c-f9ed-4997-9af6-f6fcfa9debc8 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:44.437252 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df929f9-b026-45d8-9ded-56aa01ad53bb None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:44.437791 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df929f9-b026-45d8-9ded-56aa01ad53bb None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:44.438263 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df929f9-b026-45d8-9ded-56aa01ad53bb None admin] PATH_INFO: `/v3/domains` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:44.439259 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df929f9-b026-45d8-9ded-56aa01ad53bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:07:44.439637 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df929f9-b026-45d8-9ded-56aa01ad53bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:44.441721 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df929f9-b026-45d8-9ded-56aa01ad53bb None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:44.458655 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 299/592] 10.222.0.70 () {56 vars in 1109 bytes} [Tue May 10 19:07:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:07:44.459650 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df929f9-b026-45d8-9ded-56aa01ad53bb None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:44.535345 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd16e2c-f9ed-4997-9af6-f6fcfa9debc8 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:44.559723 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df929f9-b026-45d8-9ded-56aa01ad53bb None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:44.569721 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c4b7dd-9278-4877-9817-e05bd07895c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:44.570805 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c4b7dd-9278-4877-9817-e05bd07895c0 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:44.571475 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c4b7dd-9278-4877-9817-e05bd07895c0 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:44.571969 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c4b7dd-9278-4877-9817-e05bd07895c0 None admin] PATH_INFO: `/v3/users` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:44.573076 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c4b7dd-9278-4877-9817-e05bd07895c0 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:07:44.573679 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c4b7dd-9278-4877-9817-e05bd07895c0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:44.575319 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c4b7dd-9278-4877-9817-e05bd07895c0 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:44.594365 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 294/593] 10.222.0.70 () {56 vars in 1137 bytes} [Tue May 10 19:07:44 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:07:44.598966 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261a0813-8274-4e96-88a3-0e60957b028a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:44.598966 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261a0813-8274-4e96-88a3-0e60957b028a None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:44.598966 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261a0813-8274-4e96-88a3-0e60957b028a None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:44.598966 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261a0813-8274-4e96-88a3-0e60957b028a None admin] PATH_INFO: `/v3/users` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:44.599639 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261a0813-8274-4e96-88a3-0e60957b028a None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:07:44.599639 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261a0813-8274-4e96-88a3-0e60957b028a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:44.599772 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261a0813-8274-4e96-88a3-0e60957b028a None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:44.600967 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c4b7dd-9278-4877-9817-e05bd07895c0 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:44.618379 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 300/594] 10.222.0.70 () {56 vars in 1139 bytes} [Tue May 10 19:07:44 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:07:44.619235 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261a0813-8274-4e96-88a3-0e60957b028a None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:44.701602 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c4b7dd-9278-4877-9817-e05bd07895c0 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:44.723484 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261a0813-8274-4e96-88a3-0e60957b028a None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:44.736317 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31502ac-4f6b-49cb-9c87-3f0edbd83882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:44.738327 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31502ac-4f6b-49cb-9c87-3f0edbd83882 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:44.738820 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31502ac-4f6b-49cb-9c87-3f0edbd83882 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:44.739292 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31502ac-4f6b-49cb-9c87-3f0edbd83882 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:44.746851 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31502ac-4f6b-49cb-9c87-3f0edbd83882 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:44.748648 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31502ac-4f6b-49cb-9c87-3f0edbd83882 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:44.761113 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ef997a-60e6-417c-a006-041bc48b7c37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:44.761907 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ef997a-60e6-417c-a006-041bc48b7c37 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:44.762184 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ef997a-60e6-417c-a006-041bc48b7c37 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:44.762452 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ef997a-60e6-417c-a006-041bc48b7c37 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:44.763348 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application [None req-b31502ac-4f6b-49cb-9c87-3f0edbd83882 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 19:07:44.763348 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:07:44.763348 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:07:44.763348 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:07:44.763348 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:07:44.763348 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:07:44.763348 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:07:44.763348 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:07:44.763348 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:07:44.763348 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:07:44.763348 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:07:44.763348 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:07:44.763348 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 19:07:44.763348 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 19:07:44.763348 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 19:07:44.764207 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 19:07:44.764207 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:07:44.764207 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:07:44.764207 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:07:44.764207 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:07:44.764207 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:07:44.764207 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:07:44.764207 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:07:44.764207 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application with Lock( May 10 19:07:44.764207 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:07:44.764207 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._enter() May 10 19:07:44.764207 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:07:44.764207 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:07:44.764207 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:07:44.764207 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.creator() May 10 19:07:44.764207 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:07:44.764207 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application created_value = creator( May 10 19:07:44.765151 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 19:07:44.765151 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 19:07:44.765151 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 19:07:44.765151 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 19:07:44.765151 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 19:07:44.765151 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 19:07:44.765151 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 19:07:44.765151 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application May 10 19:07:44.767512 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 295/595] 10.222.0.70 () {56 vars in 1111 bytes} [Tue May 10 19:07:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:07:44.768640 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31502ac-4f6b-49cb-9c87-3f0edbd83882 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:44.773901 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ef997a-60e6-417c-a006-041bc48b7c37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:44.775347 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ef997a-60e6-417c-a006-041bc48b7c37 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:44.797723 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-04ef997a-60e6-417c-a006-041bc48b7c37 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:07:44.797723 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:07:44.797723 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:07:44.797723 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:07:44.797723 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:07:44.797723 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:07:44.797723 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:07:44.797723 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:07:44.797723 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:07:44.797723 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:07:44.797723 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:07:44.797723 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:07:44.797723 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 19:07:44.797723 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 19:07:44.797723 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 19:07:44.798718 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 19:07:44.798718 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:07:44.798718 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:07:44.798718 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:07:44.798718 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:07:44.798718 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:07:44.798718 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:07:44.798718 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:07:44.798718 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( May 10 19:07:44.798718 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:07:44.798718 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() May 10 19:07:44.798718 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:07:44.798718 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:07:44.798718 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:07:44.798718 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() May 10 19:07:44.798718 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:07:44.798718 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( May 10 19:07:44.799640 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 19:07:44.799640 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 19:07:44.799640 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:07:44.799640 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:07:44.803621 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 301/596] 10.222.0.70 () {56 vars in 1108 bytes} [Tue May 10 19:07:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:07:44.804619 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ef997a-60e6-417c-a006-041bc48b7c37 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:44.875654 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31502ac-4f6b-49cb-9c87-3f0edbd83882 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:44.911354 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fedf8c-91fd-461e-bb1a-d4019a1a0be5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:44.912697 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fedf8c-91fd-461e-bb1a-d4019a1a0be5 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:44.913186 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fedf8c-91fd-461e-bb1a-d4019a1a0be5 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:44.913665 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fedf8c-91fd-461e-bb1a-d4019a1a0be5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:44.925698 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fedf8c-91fd-461e-bb1a-d4019a1a0be5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:44.927500 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ef997a-60e6-417c-a006-041bc48b7c37 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:44.927715 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fedf8c-91fd-461e-bb1a-d4019a1a0be5 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:44.945913 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application [None req-81fedf8c-91fd-461e-bb1a-d4019a1a0be5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:07:44.945913 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:07:44.945913 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:07:44.945913 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:07:44.945913 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:07:44.945913 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:07:44.945913 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:07:44.945913 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:07:44.945913 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:07:44.945913 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:07:44.945913 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:07:44.945913 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:07:44.945913 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 19:07:44.945913 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 19:07:44.945913 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 19:07:44.946856 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 19:07:44.946856 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:07:44.946856 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:07:44.946856 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:07:44.946856 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:07:44.946856 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:07:44.946856 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:07:44.946856 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:07:44.946856 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application with Lock( May 10 19:07:44.946856 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:07:44.946856 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._enter() May 10 19:07:44.946856 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:07:44.946856 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:07:44.946856 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:07:44.946856 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.creator() May 10 19:07:44.946856 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:07:44.946856 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application created_value = creator( May 10 19:07:44.947753 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 19:07:44.947753 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 19:07:44.947753 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:07:44.947753 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application May 10 19:07:44.950055 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 296/597] 10.222.0.70 () {56 vars in 1108 bytes} [Tue May 10 19:07:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:07:44.951119 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fedf8c-91fd-461e-bb1a-d4019a1a0be5 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:44.983921 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106f63f8-38a3-4b14-92be-3b0be684ab31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:44.983921 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106f63f8-38a3-4b14-92be-3b0be684ab31 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:44.983921 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106f63f8-38a3-4b14-92be-3b0be684ab31 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:44.983921 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106f63f8-38a3-4b14-92be-3b0be684ab31 None admin] PATH_INFO: `/v3/projects` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:44.984338 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106f63f8-38a3-4b14-92be-3b0be684ab31 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:07:44.984338 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106f63f8-38a3-4b14-92be-3b0be684ab31 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:44.984719 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106f63f8-38a3-4b14-92be-3b0be684ab31 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:44.999657 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 302/598] 10.222.0.70 () {56 vars in 1148 bytes} [Tue May 10 19:07:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:07:45.000696 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106f63f8-38a3-4b14-92be-3b0be684ab31 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:45.053561 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fedf8c-91fd-461e-bb1a-d4019a1a0be5 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:45.097272 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5b9410-0b57-4164-ac72-833e4072a5c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:45.098090 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5b9410-0b57-4164-ac72-833e4072a5c5 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:45.098373 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5b9410-0b57-4164-ac72-833e4072a5c5 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:45.098965 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5b9410-0b57-4164-ac72-833e4072a5c5 None admin] PATH_INFO: `/v3/domains` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:45.099947 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5b9410-0b57-4164-ac72-833e4072a5c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:07:45.100252 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5b9410-0b57-4164-ac72-833e4072a5c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:45.102145 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5b9410-0b57-4164-ac72-833e4072a5c5 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:45.107179 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106f63f8-38a3-4b14-92be-3b0be684ab31 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:45.120507 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 297/599] 10.222.0.70 () {56 vars in 1109 bytes} [Tue May 10 19:07:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:07:45.121490 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5b9410-0b57-4164-ac72-833e4072a5c5 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:45.150111 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dade0050-087d-436e-9635-e2c75456502a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:45.151201 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dade0050-087d-436e-9635-e2c75456502a None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:45.151499 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dade0050-087d-436e-9635-e2c75456502a None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:45.152034 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dade0050-087d-436e-9635-e2c75456502a None admin] PATH_INFO: `/v3/domains` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:45.152771 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dade0050-087d-436e-9635-e2c75456502a None admin] RBAC: Adding query filter params (name=Default) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:07:45.153072 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dade0050-087d-436e-9635-e2c75456502a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:45.155316 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dade0050-087d-436e-9635-e2c75456502a None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:45.169040 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 303/600] 10.222.0.70 () {56 vars in 1109 bytes} [Tue May 10 19:07:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:07:45.169658 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dade0050-087d-436e-9635-e2c75456502a None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:45.223433 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5b9410-0b57-4164-ac72-833e4072a5c5 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:45.258875 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976d29cb-1d8b-487e-9638-e7f2b4c95d4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:45.259767 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976d29cb-1d8b-487e-9638-e7f2b4c95d4a None admin] REQUEST_METHOD: `PUT` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:45.260052 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976d29cb-1d8b-487e-9638-e7f2b4c95d4a None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:45.260520 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976d29cb-1d8b-487e-9638-e7f2b4c95d4a None admin] PATH_INFO: `/v3/projects/2ee9ec5b515440fe9b39aedf3e339c79/users/24ca97ff2a1745e58dedba4cef61b3f0/roles/445805bec1e741c9b823495ae6e364f0` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:45.275313 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976d29cb-1d8b-487e-9638-e7f2b4c95d4a None admin] RBAC: Authorizing `identity:create_grant(project_id=2ee9ec5b515440fe9b39aedf3e339c79, user_id=24ca97ff2a1745e58dedba4cef61b3f0, role_id=445805bec1e741c9b823495ae6e364f0)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:45.276844 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976d29cb-1d8b-487e-9638-e7f2b4c95d4a None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:45.286105 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dade0050-087d-436e-9635-e2c75456502a None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:45.292971 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 298/601] 10.222.0.70 () {58 vars in 1439 bytes} [Tue May 10 19:07:45 2022] PUT /identity/v3/projects/2ee9ec5b515440fe9b39aedf3e339c79/users/24ca97ff2a1745e58dedba4cef61b3f0/roles/445805bec1e741c9b823495ae6e364f0 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:07:45.294448 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976d29cb-1d8b-487e-9638-e7f2b4c95d4a None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:45.321367 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44289fc5-273a-4e13-be4f-93c44d947f16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:45.322202 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44289fc5-273a-4e13-be4f-93c44d947f16 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:45.322541 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44289fc5-273a-4e13-be4f-93c44d947f16 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:45.322812 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44289fc5-273a-4e13-be4f-93c44d947f16 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:45.330637 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44289fc5-273a-4e13-be4f-93c44d947f16 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:45.333099 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44289fc5-273a-4e13-be4f-93c44d947f16 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:45.347342 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-44289fc5-273a-4e13-be4f-93c44d947f16 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 19:07:45.347342 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:07:45.347342 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:07:45.347342 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:07:45.347342 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:07:45.347342 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:07:45.347342 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:07:45.347342 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:07:45.347342 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:07:45.347342 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:07:45.347342 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:07:45.347342 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:07:45.347342 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 19:07:45.347342 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 19:07:45.347342 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 19:07:45.350263 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 19:07:45.350263 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:07:45.350263 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:07:45.350263 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:07:45.350263 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:07:45.350263 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:07:45.350263 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:07:45.350263 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:07:45.350263 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( May 10 19:07:45.350263 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:07:45.350263 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() May 10 19:07:45.350263 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:07:45.350263 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:07:45.350263 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:07:45.350263 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() May 10 19:07:45.350263 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:07:45.350263 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( May 10 19:07:45.356552 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 19:07:45.356552 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 19:07:45.356552 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 19:07:45.356552 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 19:07:45.356552 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 19:07:45.356552 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 19:07:45.356552 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 19:07:45.356552 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:07:45.356552 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 304/602] 10.222.0.70 () {56 vars in 1111 bytes} [Tue May 10 19:07:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:07:45.356552 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44289fc5-273a-4e13-be4f-93c44d947f16 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:45.413830 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976d29cb-1d8b-487e-9638-e7f2b4c95d4a None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:45.453439 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b06d8c-334c-4abd-9433-f4be88a3e512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:45.454262 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b06d8c-334c-4abd-9433-f4be88a3e512 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:45.454551 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b06d8c-334c-4abd-9433-f4be88a3e512 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:45.454832 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b06d8c-334c-4abd-9433-f4be88a3e512 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:45.462769 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44289fc5-273a-4e13-be4f-93c44d947f16 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:45.464047 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b06d8c-334c-4abd-9433-f4be88a3e512 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:45.465647 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b06d8c-334c-4abd-9433-f4be88a3e512 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:45.480880 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application [None req-c0b06d8c-334c-4abd-9433-f4be88a3e512 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 19:07:45.480880 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:07:45.480880 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:07:45.480880 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:07:45.480880 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:07:45.480880 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:07:45.480880 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:07:45.480880 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:07:45.480880 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:07:45.480880 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:07:45.480880 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:07:45.480880 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:07:45.480880 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 19:07:45.480880 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 19:07:45.480880 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 19:07:45.482952 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 19:07:45.482952 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:07:45.482952 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:07:45.482952 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:07:45.482952 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:07:45.482952 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:07:45.482952 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:07:45.482952 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:07:45.482952 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application with Lock( May 10 19:07:45.482952 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:07:45.482952 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._enter() May 10 19:07:45.482952 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:07:45.482952 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:07:45.482952 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:07:45.482952 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.creator() May 10 19:07:45.482952 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:07:45.482952 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application created_value = creator( May 10 19:07:45.485117 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 19:07:45.485117 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 19:07:45.485117 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 19:07:45.485117 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 19:07:45.485117 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 19:07:45.485117 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 19:07:45.485117 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 19:07:45.485117 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application May 10 19:07:45.492447 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 299/603] 10.222.0.70 () {56 vars in 1111 bytes} [Tue May 10 19:07:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:07:45.492447 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b06d8c-334c-4abd-9433-f4be88a3e512 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:45.498773 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238900c6-ef5b-4256-948c-5740f2b44b90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:45.499838 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238900c6-ef5b-4256-948c-5740f2b44b90 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:45.500329 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238900c6-ef5b-4256-948c-5740f2b44b90 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:45.500672 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238900c6-ef5b-4256-948c-5740f2b44b90 None admin] PATH_INFO: `/v3/projects` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:45.501483 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238900c6-ef5b-4256-948c-5740f2b44b90 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:07:45.501788 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238900c6-ef5b-4256-948c-5740f2b44b90 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:45.504667 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238900c6-ef5b-4256-948c-5740f2b44b90 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:45.518078 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 305/604] 10.222.0.70 () {56 vars in 1148 bytes} [Tue May 10 19:07:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:07:45.525058 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238900c6-ef5b-4256-948c-5740f2b44b90 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:45.678730 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238900c6-ef5b-4256-948c-5740f2b44b90 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:45.692694 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b06d8c-334c-4abd-9433-f4be88a3e512 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:45.722385 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3271b7-e9da-4b85-b5c8-fda620597c83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:45.723563 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3271b7-e9da-4b85-b5c8-fda620597c83 None admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:45.723851 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3271b7-e9da-4b85-b5c8-fda620597c83 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:45.724123 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3271b7-e9da-4b85-b5c8-fda620597c83 None admin] PATH_INFO: `/v3/projects/2ee9ec5b515440fe9b39aedf3e339c79/users/15df2a8967aa43299c10e365f4200d37/roles/445805bec1e741c9b823495ae6e364f0` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:45.743972 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9ab5fe-3e4a-482e-b9ba-9ad7e45e81d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:45.744730 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9ab5fe-3e4a-482e-b9ba-9ad7e45e81d1 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:45.746049 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9ab5fe-3e4a-482e-b9ba-9ad7e45e81d1 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:45.746325 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9ab5fe-3e4a-482e-b9ba-9ad7e45e81d1 None admin] PATH_INFO: `/v3/projects` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:45.747106 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9ab5fe-3e4a-482e-b9ba-9ad7e45e81d1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:07:45.747408 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9ab5fe-3e4a-482e-b9ba-9ad7e45e81d1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:45.748885 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9ab5fe-3e4a-482e-b9ba-9ad7e45e81d1 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:45.754609 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3271b7-e9da-4b85-b5c8-fda620597c83 None admin] RBAC: Authorizing `identity:create_grant(project_id=2ee9ec5b515440fe9b39aedf3e339c79, user_id=15df2a8967aa43299c10e365f4200d37, role_id=445805bec1e741c9b823495ae6e364f0)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:45.756027 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3271b7-e9da-4b85-b5c8-fda620597c83 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:45.774397 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 306/605] 10.222.0.70 () {58 vars in 1439 bytes} [Tue May 10 19:07:45 2022] PUT /identity/v3/projects/2ee9ec5b515440fe9b39aedf3e339c79/users/15df2a8967aa43299c10e365f4200d37/roles/445805bec1e741c9b823495ae6e364f0 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:07:45.776147 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 300/606] 10.222.0.70 () {56 vars in 1148 bytes} [Tue May 10 19:07:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:07:45.782372 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3271b7-e9da-4b85-b5c8-fda620597c83 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:45.904857 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3271b7-e9da-4b85-b5c8-fda620597c83 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:45.948094 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0370764-d364-4b10-8b63-6846241b0e93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:45.949469 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0370764-d364-4b10-8b63-6846241b0e93 None admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:45.949979 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0370764-d364-4b10-8b63-6846241b0e93 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:45.950451 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0370764-d364-4b10-8b63-6846241b0e93 None admin] PATH_INFO: `/v3/projects/2ee9ec5b515440fe9b39aedf3e339c79/users/91f1dc79540b48c0866478cc48cd8205/roles/445805bec1e741c9b823495ae6e364f0` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:45.978179 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0370764-d364-4b10-8b63-6846241b0e93 None admin] RBAC: Authorizing `identity:create_grant(project_id=2ee9ec5b515440fe9b39aedf3e339c79, user_id=91f1dc79540b48c0866478cc48cd8205, role_id=445805bec1e741c9b823495ae6e364f0)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:45.980129 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0370764-d364-4b10-8b63-6846241b0e93 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:46.017058 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 307/607] 10.222.0.70 () {58 vars in 1439 bytes} [Tue May 10 19:07:45 2022] PUT /identity/v3/projects/2ee9ec5b515440fe9b39aedf3e339c79/users/91f1dc79540b48c0866478cc48cd8205/roles/445805bec1e741c9b823495ae6e364f0 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 19:07:46.204862 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be230433-3561-422b-9f7d-7ff4512319c0 None None] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:46.205502 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be230433-3561-422b-9f7d-7ff4512319c0 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:46.206012 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be230433-3561-422b-9f7d-7ff4512319c0 None None] PATH_INFO: `/` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:46.207948 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 301/608] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:07:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:07:46.214061 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3ee896-2abb-43bb-84e7-890fe3b673d2 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:46.214655 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3ee896-2abb-43bb-84e7-890fe3b673d2 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:46.215130 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3ee896-2abb-43bb-84e7-890fe3b673d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:46.238105 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-de3ee896-2abb-43bb-84e7-890fe3b673d2 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:07:46.239359 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-de3ee896-2abb-43bb-84e7-890fe3b673d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:07:46.312911 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 308/609] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:07:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 19:07:46.335445 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be230433-3561-422b-9f7d-7ff4512319c0 None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:46.476185 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be230433-3561-422b-9f7d-7ff4512319c0 None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:46.523643 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f498973-4b35-4c1d-be10-e50fd21e0b09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:46.524863 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f498973-4b35-4c1d-be10-e50fd21e0b09 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:46.525346 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f498973-4b35-4c1d-be10-e50fd21e0b09 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:46.525827 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f498973-4b35-4c1d-be10-e50fd21e0b09 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:46.539685 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f498973-4b35-4c1d-be10-e50fd21e0b09 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:07:46.547600 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application [None req-5f498973-4b35-4c1d-be10-e50fd21e0b09 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 19:07:46.547600 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:07:46.547600 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:07:46.547600 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:07:46.547600 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:07:46.547600 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:07:46.547600 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:07:46.547600 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:07:46.547600 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:07:46.547600 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:07:46.547600 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:07:46.547600 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:07:46.547600 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:07:46.547600 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:07:46.547600 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:07:46.547600 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:07:46.548543 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:07:46.548543 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:07:46.548543 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:07:46.548543 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:07:46.548543 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:07:46.548543 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:07:46.548543 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:07:46.548543 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:07:46.548543 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:07:46.548543 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:07:46.548543 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:07:46.548543 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application with Lock( May 10 19:07:46.548543 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:07:46.548543 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._enter() May 10 19:07:46.548543 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:07:46.548543 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:07:46.549394 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:07:46.549394 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.creator() May 10 19:07:46.549394 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:07:46.549394 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application created_value = creator( May 10 19:07:46.549394 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:07:46.549394 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:07:46.549394 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:07:46.549394 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:07:46.549394 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:07:46.549394 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:07:46.549394 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 19:07:46.549394 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application May 10 19:07:46.552540 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 302/610] 10.222.0.70 () {56 vars in 1102 bytes} [Tue May 10 19:07:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:07:46.554555 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3ee896-2abb-43bb-84e7-890fe3b673d2 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:46.676967 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3ee896-2abb-43bb-84e7-890fe3b673d2 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:46.725121 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68be08b7-1b1c-47da-8973-8c2a1d46930a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:46.725903 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68be08b7-1b1c-47da-8973-8c2a1d46930a None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:46.726067 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68be08b7-1b1c-47da-8973-8c2a1d46930a None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:46.726337 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68be08b7-1b1c-47da-8973-8c2a1d46930a None admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:46.727085 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68be08b7-1b1c-47da-8973-8c2a1d46930a None admin] RBAC: Adding query filter params (name=service) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:07:46.727390 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68be08b7-1b1c-47da-8973-8c2a1d46930a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:46.728781 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68be08b7-1b1c-47da-8973-8c2a1d46930a None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:46.736923 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 309/611] 10.222.0.70 () {56 vars in 1103 bytes} [Tue May 10 19:07:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:07:46.742857 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f498973-4b35-4c1d-be10-e50fd21e0b09 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:46.839457 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516966c6-e013-4b17-b274-6195b63f7183 None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:46.839873 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516966c6-e013-4b17-b274-6195b63f7183 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:46.840049 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516966c6-e013-4b17-b274-6195b63f7183 None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:46.841635 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 310/612] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:07:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 19:07:46.846640 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f21d43-eca6-41b5-9177-bfa9d4b98898 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:46.846987 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f21d43-eca6-41b5-9177-bfa9d4b98898 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:46.847272 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f21d43-eca6-41b5-9177-bfa9d4b98898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:46.864438 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-85f21d43-eca6-41b5-9177-bfa9d4b98898 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:07:46.865631 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-85f21d43-eca6-41b5-9177-bfa9d4b98898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:07:46.874126 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f498973-4b35-4c1d-be10-e50fd21e0b09 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:46.912564 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e60901-3222-4033-bd42-9d0aafc77ce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:46.913420 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e60901-3222-4033-bd42-9d0aafc77ce9 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:46.913708 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e60901-3222-4033-bd42-9d0aafc77ce9 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:46.914031 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e60901-3222-4033-bd42-9d0aafc77ce9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:46.926173 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e60901-3222-4033-bd42-9d0aafc77ce9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:46.927688 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e60901-3222-4033-bd42-9d0aafc77ce9 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:46.934316 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 311/613] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:07:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 19:07:46.945761 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application [None req-34e60901-3222-4033-bd42-9d0aafc77ce9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:07:46.945761 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:07:46.945761 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:07:46.945761 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:07:46.945761 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:07:46.945761 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:07:46.945761 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:07:46.945761 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:07:46.945761 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:07:46.945761 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:07:46.945761 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:07:46.945761 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:07:46.945761 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 19:07:46.945761 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 19:07:46.945761 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 19:07:46.946758 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 19:07:46.946758 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:07:46.946758 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:07:46.946758 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:07:46.946758 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:07:46.946758 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:07:46.946758 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:07:46.946758 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:07:46.946758 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application with Lock( May 10 19:07:46.946758 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:07:46.946758 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._enter() May 10 19:07:46.946758 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:07:46.946758 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:07:46.946758 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:07:46.946758 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.creator() May 10 19:07:46.946758 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:07:46.946758 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application created_value = creator( May 10 19:07:46.947708 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 19:07:46.947708 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 19:07:46.947708 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:07:46.947708 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application May 10 19:07:46.959458 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 303/614] 10.222.0.70 () {56 vars in 1108 bytes} [Tue May 10 19:07:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:07:46.959779 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f21d43-eca6-41b5-9177-bfa9d4b98898 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:46.973494 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e60901-3222-4033-bd42-9d0aafc77ce9 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:47.084444 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f21d43-eca6-41b5-9177-bfa9d4b98898 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:47.126252 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2309ce4a-372b-4a48-9bbc-2d6022a67193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:47.126878 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2309ce4a-372b-4a48-9bbc-2d6022a67193 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:47.127165 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2309ce4a-372b-4a48-9bbc-2d6022a67193 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:47.127441 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2309ce4a-372b-4a48-9bbc-2d6022a67193 None admin] PATH_INFO: `/v3/domains` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:47.128721 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2309ce4a-372b-4a48-9bbc-2d6022a67193 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:07:47.129028 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2309ce4a-372b-4a48-9bbc-2d6022a67193 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:47.130418 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2309ce4a-372b-4a48-9bbc-2d6022a67193 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:47.148410 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e60901-3222-4033-bd42-9d0aafc77ce9 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:47.155774 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 312/615] 10.222.0.70 () {56 vars in 1109 bytes} [Tue May 10 19:07:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:07:47.162209 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2309ce4a-372b-4a48-9bbc-2d6022a67193 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:47.182810 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac2b8a6-2365-41fb-9f5a-33daa4c10bd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:47.183930 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac2b8a6-2365-41fb-9f5a-33daa4c10bd9 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:47.184444 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac2b8a6-2365-41fb-9f5a-33daa4c10bd9 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:47.184928 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac2b8a6-2365-41fb-9f5a-33daa4c10bd9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:47.195903 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac2b8a6-2365-41fb-9f5a-33daa4c10bd9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:07:47.203894 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application [None req-6ac2b8a6-2365-41fb-9f5a-33daa4c10bd9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 19:07:47.203894 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:07:47.203894 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:07:47.203894 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:07:47.203894 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:07:47.203894 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:07:47.203894 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:07:47.203894 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:07:47.203894 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:07:47.203894 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:07:47.203894 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:07:47.203894 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:07:47.203894 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:07:47.203894 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:07:47.203894 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:07:47.203894 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:07:47.204905 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:07:47.204905 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:07:47.204905 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:07:47.204905 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:07:47.204905 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:07:47.204905 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:07:47.204905 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:07:47.204905 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:07:47.204905 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:07:47.204905 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:07:47.204905 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:07:47.204905 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application with Lock( May 10 19:07:47.204905 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:07:47.204905 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._enter() May 10 19:07:47.204905 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:07:47.204905 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:07:47.205753 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:07:47.205753 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.creator() May 10 19:07:47.205753 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:07:47.205753 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application created_value = creator( May 10 19:07:47.205753 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:07:47.205753 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:07:47.205753 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:07:47.205753 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:07:47.205753 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:07:47.205753 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:07:47.205753 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 19:07:47.205753 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application May 10 19:07:47.208809 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 304/616] 10.222.0.70 () {56 vars in 1102 bytes} [Tue May 10 19:07:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:07:47.214088 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac2b8a6-2365-41fb-9f5a-33daa4c10bd9 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:47.361243 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2309ce4a-372b-4a48-9bbc-2d6022a67193 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:47.375887 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac2b8a6-2365-41fb-9f5a-33daa4c10bd9 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:47.423770 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310c0724-f42b-47ba-a1a3-3f67f6b8fea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:47.424611 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310c0724-f42b-47ba-a1a3-3f67f6b8fea8 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:47.425432 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310c0724-f42b-47ba-a1a3-3f67f6b8fea8 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:47.425706 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310c0724-f42b-47ba-a1a3-3f67f6b8fea8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:47.435123 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1b927d-1301-47fc-935e-54b5068a080f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:47.435799 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1b927d-1301-47fc-935e-54b5068a080f None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:47.436080 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1b927d-1301-47fc-935e-54b5068a080f None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:47.436352 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1b927d-1301-47fc-935e-54b5068a080f None admin] PATH_INFO: `/v3/roles` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:47.437121 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1b927d-1301-47fc-935e-54b5068a080f None admin] RBAC: Adding query filter params (name=service) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:07:47.437426 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1b927d-1301-47fc-935e-54b5068a080f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:47.438803 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1b927d-1301-47fc-935e-54b5068a080f None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:47.446334 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310c0724-f42b-47ba-a1a3-3f67f6b8fea8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:47.447779 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310c0724-f42b-47ba-a1a3-3f67f6b8fea8 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:47.450439 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 305/617] 10.222.0.70 () {56 vars in 1103 bytes} [Tue May 10 19:07:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:07:47.457623 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1b927d-1301-47fc-935e-54b5068a080f None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:47.471031 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-310c0724-f42b-47ba-a1a3-3f67f6b8fea8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 10 19:07:47.471031 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:07:47.471031 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:07:47.471031 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:07:47.471031 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:07:47.471031 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:07:47.471031 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:07:47.471031 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:07:47.471031 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:07:47.471031 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:07:47.471031 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:07:47.471031 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:07:47.471031 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 19:07:47.471031 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 19:07:47.471031 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 19:07:47.471031 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 19:07:47.472097 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:07:47.472097 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:07:47.472097 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 19:07:47.472097 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 19:07:47.472097 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 19:07:47.472097 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 19:07:47.472097 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:07:47.472097 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:07:47.472097 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:07:47.472097 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:07:47.472097 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:07:47.472097 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( May 10 19:07:47.472097 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:07:47.472097 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() May 10 19:07:47.472097 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:07:47.472097 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:07:47.472097 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:07:47.472097 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() May 10 19:07:47.473103 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:07:47.473103 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( May 10 19:07:47.473103 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 19:07:47.473103 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 19:07:47.473103 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 19:07:47.473103 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 19:07:47.473103 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 19:07:47.473103 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 19:07:47.473103 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 10 19:07:47.473103 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:07:47.473103 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 313/618] 10.222.0.70 () {56 vars in 1093 bytes} [Tue May 10 19:07:47 2022] GET /identity/v3/users/nova => generated 82 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 19:07:47.477843 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310c0724-f42b-47ba-a1a3-3f67f6b8fea8 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:47.657888 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1b927d-1301-47fc-935e-54b5068a080f None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:47.667058 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310c0724-f42b-47ba-a1a3-3f67f6b8fea8 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:47.722876 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fcc00d-7a41-4e58-977b-5866381e4df8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:47.723603 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fcc00d-7a41-4e58-977b-5866381e4df8 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:47.723888 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fcc00d-7a41-4e58-977b-5866381e4df8 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:47.724160 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fcc00d-7a41-4e58-977b-5866381e4df8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:47.727968 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcba0cc6-4791-4d38-b388-d6ff37551710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:47.728673 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcba0cc6-4791-4d38-b388-d6ff37551710 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:47.728955 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcba0cc6-4791-4d38-b388-d6ff37551710 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:47.729227 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcba0cc6-4791-4d38-b388-d6ff37551710 None admin] PATH_INFO: `/v3/users` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:47.730063 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcba0cc6-4791-4d38-b388-d6ff37551710 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:07:47.730368 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcba0cc6-4791-4d38-b388-d6ff37551710 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:47.735649 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcba0cc6-4791-4d38-b388-d6ff37551710 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:47.747726 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fcc00d-7a41-4e58-977b-5866381e4df8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:47.749213 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fcc00d-7a41-4e58-977b-5866381e4df8 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:47.766621 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 314/619] 10.222.0.70 () {56 vars in 1133 bytes} [Tue May 10 19:07:47 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:07:47.773368 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcba0cc6-4791-4d38-b388-d6ff37551710 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:47.779797 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application [None req-b4fcc00d-7a41-4e58-977b-5866381e4df8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:07:47.779797 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:07:47.779797 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:07:47.779797 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:07:47.779797 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:07:47.779797 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:07:47.779797 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:07:47.779797 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:07:47.779797 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:07:47.779797 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:07:47.779797 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:07:47.779797 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:07:47.779797 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 19:07:47.779797 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 19:07:47.779797 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 19:07:47.781791 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 19:07:47.781791 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:07:47.781791 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:07:47.781791 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:07:47.781791 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:07:47.781791 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:07:47.781791 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:07:47.781791 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:07:47.781791 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application with Lock( May 10 19:07:47.781791 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:07:47.781791 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._enter() May 10 19:07:47.781791 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:07:47.781791 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:07:47.781791 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:07:47.781791 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.creator() May 10 19:07:47.781791 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:07:47.781791 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application created_value = creator( May 10 19:07:47.783863 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 19:07:47.783863 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 19:07:47.783863 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:07:47.783863 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application May 10 19:07:47.783863 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 306/620] 10.222.0.70 () {56 vars in 1108 bytes} [Tue May 10 19:07:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:07:47.790305 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fcc00d-7a41-4e58-977b-5866381e4df8 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:47.880450 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcba0cc6-4791-4d38-b388-d6ff37551710 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:47.918692 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da11052b-3e25-4927-ab94-a325597b6f18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:47.919349 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da11052b-3e25-4927-ab94-a325597b6f18 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:47.919633 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da11052b-3e25-4927-ab94-a325597b6f18 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:47.919912 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da11052b-3e25-4927-ab94-a325597b6f18 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:47.984184 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fcc00d-7a41-4e58-977b-5866381e4df8 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:48.052991 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5d9ecc-28a2-41c1-b710-ba58848645a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:48.053663 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5d9ecc-28a2-41c1-b710-ba58848645a0 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:48.053946 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5d9ecc-28a2-41c1-b710-ba58848645a0 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:48.054222 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5d9ecc-28a2-41c1-b710-ba58848645a0 None admin] PATH_INFO: `/v3/domains` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:48.054944 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5d9ecc-28a2-41c1-b710-ba58848645a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:07:48.055254 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5d9ecc-28a2-41c1-b710-ba58848645a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:48.056686 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5d9ecc-28a2-41c1-b710-ba58848645a0 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:48.059068 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da11052b-3e25-4927-ab94-a325597b6f18 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:48.060717 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da11052b-3e25-4927-ab94-a325597b6f18 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:48.084438 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 307/621] 10.222.0.70 () {56 vars in 1109 bytes} [Tue May 10 19:07:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:07:48.089881 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5d9ecc-28a2-41c1-b710-ba58848645a0 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:48.196226 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 315/622] 10.222.0.70 () {58 vars in 1282 bytes} [Tue May 10 19:07:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 19:07:48.208409 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da11052b-3e25-4927-ab94-a325597b6f18 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:48.275870 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5d9ecc-28a2-41c1-b710-ba58848645a0 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:48.306960 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da11052b-3e25-4927-ab94-a325597b6f18 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:48.308836 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ac7b85-2685-45cd-a81c-0fc1f7704d94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:48.309645 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ac7b85-2685-45cd-a81c-0fc1f7704d94 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:48.309927 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ac7b85-2685-45cd-a81c-0fc1f7704d94 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:48.310202 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ac7b85-2685-45cd-a81c-0fc1f7704d94 None admin] PATH_INFO: `/v3/users/swift` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:48.317302 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ac7b85-2685-45cd-a81c-0fc1f7704d94 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:48.318758 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ac7b85-2685-45cd-a81c-0fc1f7704d94 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:48.333823 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application [None req-75ac7b85-2685-45cd-a81c-0fc1f7704d94 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 10 19:07:48.333823 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:07:48.333823 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:07:48.333823 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:07:48.333823 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:07:48.333823 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:07:48.333823 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:07:48.333823 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:07:48.333823 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:07:48.333823 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:07:48.333823 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:07:48.333823 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:07:48.333823 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 19:07:48.333823 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 19:07:48.333823 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 19:07:48.333823 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 19:07:48.334820 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:07:48.334820 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:07:48.334820 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 19:07:48.334820 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 19:07:48.334820 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 19:07:48.334820 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 19:07:48.334820 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:07:48.334820 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:07:48.334820 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:07:48.334820 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:07:48.334820 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:07:48.334820 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application with Lock( May 10 19:07:48.334820 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:07:48.334820 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._enter() May 10 19:07:48.334820 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:07:48.334820 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:07:48.334820 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:07:48.334820 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.creator() May 10 19:07:48.335859 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:07:48.335859 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application created_value = creator( May 10 19:07:48.335859 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 19:07:48.335859 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 19:07:48.335859 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 19:07:48.335859 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 19:07:48.335859 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 19:07:48.335859 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 19:07:48.335859 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 10 19:07:48.335859 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application May 10 19:07:48.335859 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 308/623] 10.222.0.70 () {56 vars in 1096 bytes} [Tue May 10 19:07:48 2022] GET /identity/v3/users/swift => generated 83 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 19:07:48.337075 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afe552b-cbb8-4cb6-a98e-ba7b660a32a1 None None] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:48.337075 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afe552b-cbb8-4cb6-a98e-ba7b660a32a1 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:48.337357 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afe552b-cbb8-4cb6-a98e-ba7b660a32a1 None None] PATH_INFO: `/` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:48.342688 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 309/624] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:07:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:07:48.343692 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afe552b-cbb8-4cb6-a98e-ba7b660a32a1 None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:48.347146 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c910ef-f7fa-47bd-9503-ee1ee7edfc90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:48.347949 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c910ef-f7fa-47bd-9503-ee1ee7edfc90 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:48.348229 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c910ef-f7fa-47bd-9503-ee1ee7edfc90 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:48.348542 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c910ef-f7fa-47bd-9503-ee1ee7edfc90 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:48.359104 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c910ef-f7fa-47bd-9503-ee1ee7edfc90 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:48.360720 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c910ef-f7fa-47bd-9503-ee1ee7edfc90 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:48.380140 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-04c910ef-f7fa-47bd-9503-ee1ee7edfc90 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:07:48.380140 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:07:48.380140 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:07:48.380140 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:07:48.380140 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:07:48.380140 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:07:48.380140 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:07:48.380140 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:07:48.380140 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:07:48.380140 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:07:48.380140 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:07:48.380140 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:07:48.380140 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 19:07:48.380140 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 19:07:48.380140 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 19:07:48.381324 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 19:07:48.381324 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:07:48.381324 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:07:48.381324 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:07:48.381324 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:07:48.381324 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:07:48.381324 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:07:48.381324 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:07:48.381324 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( May 10 19:07:48.381324 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:07:48.381324 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() May 10 19:07:48.381324 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:07:48.381324 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:07:48.381324 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:07:48.381324 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() May 10 19:07:48.381324 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:07:48.381324 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( May 10 19:07:48.382572 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 19:07:48.382572 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 19:07:48.382572 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:07:48.382572 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:07:48.386172 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 316/625] 10.222.0.70 () {56 vars in 1108 bytes} [Tue May 10 19:07:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 19:07:48.387712 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b802d0-44b8-433d-8295-9c0fa0e8b7a5 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:48.387999 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b802d0-44b8-433d-8295-9c0fa0e8b7a5 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:48.388277 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b802d0-44b8-433d-8295-9c0fa0e8b7a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:48.406275 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-c9b802d0-44b8-433d-8295-9c0fa0e8b7a5 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:07:48.407549 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-c9b802d0-44b8-433d-8295-9c0fa0e8b7a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:07:48.465870 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afe552b-cbb8-4cb6-a98e-ba7b660a32a1 None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:48.488622 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 317/626] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:07:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 19:07:48.490009 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b802d0-44b8-433d-8295-9c0fa0e8b7a5 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:48.522771 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0a9fcd-1a82-48bc-ad7c-b7f4884ff51c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:48.523465 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0a9fcd-1a82-48bc-ad7c-b7f4884ff51c None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:48.523743 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0a9fcd-1a82-48bc-ad7c-b7f4884ff51c None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:48.524016 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0a9fcd-1a82-48bc-ad7c-b7f4884ff51c None admin] PATH_INFO: `/v3/users` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:48.524913 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0a9fcd-1a82-48bc-ad7c-b7f4884ff51c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:07:48.525222 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0a9fcd-1a82-48bc-ad7c-b7f4884ff51c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:48.526831 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0a9fcd-1a82-48bc-ad7c-b7f4884ff51c None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:48.563615 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 310/627] 10.222.0.70 () {56 vars in 1135 bytes} [Tue May 10 19:07:48 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:07:48.563615 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0a9fcd-1a82-48bc-ad7c-b7f4884ff51c None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:48.609072 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b802d0-44b8-433d-8295-9c0fa0e8b7a5 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:48.641984 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4787fbf2-5935-4de8-9c3e-c46942028b52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:48.642749 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4787fbf2-5935-4de8-9c3e-c46942028b52 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:48.643034 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4787fbf2-5935-4de8-9c3e-c46942028b52 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:48.643312 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4787fbf2-5935-4de8-9c3e-c46942028b52 None admin] PATH_INFO: `/v3/domains` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:48.644073 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4787fbf2-5935-4de8-9c3e-c46942028b52 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:07:48.644379 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4787fbf2-5935-4de8-9c3e-c46942028b52 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:48.645785 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4787fbf2-5935-4de8-9c3e-c46942028b52 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:48.656514 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 318/628] 10.222.0.70 () {56 vars in 1109 bytes} [Tue May 10 19:07:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:07:48.662138 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4787fbf2-5935-4de8-9c3e-c46942028b52 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:48.665137 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0a9fcd-1a82-48bc-ad7c-b7f4884ff51c None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:48.698606 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca186092-3540-44de-a0d8-16a58eb5ab85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:48.699411 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca186092-3540-44de-a0d8-16a58eb5ab85 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:48.699695 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca186092-3540-44de-a0d8-16a58eb5ab85 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:48.699967 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca186092-3540-44de-a0d8-16a58eb5ab85 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:48.710382 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca186092-3540-44de-a0d8-16a58eb5ab85 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:07:48.719516 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application [None req-ca186092-3540-44de-a0d8-16a58eb5ab85 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 19:07:48.719516 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:07:48.719516 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:07:48.719516 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:07:48.719516 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:07:48.719516 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:07:48.719516 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:07:48.719516 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:07:48.719516 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:07:48.719516 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:07:48.719516 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:07:48.719516 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:07:48.719516 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:07:48.719516 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:07:48.719516 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:07:48.719516 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:07:48.720522 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:07:48.720522 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:07:48.720522 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:07:48.720522 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:07:48.720522 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:07:48.720522 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:07:48.720522 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:07:48.720522 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:07:48.720522 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:07:48.720522 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:07:48.720522 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:07:48.720522 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application with Lock( May 10 19:07:48.720522 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:07:48.720522 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._enter() May 10 19:07:48.720522 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:07:48.720522 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:07:48.721427 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:07:48.721427 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.creator() May 10 19:07:48.721427 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:07:48.721427 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application created_value = creator( May 10 19:07:48.721427 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:07:48.721427 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:07:48.721427 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:07:48.721427 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:07:48.721427 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:07:48.721427 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:07:48.721427 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 19:07:48.721427 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application May 10 19:07:48.721427 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 311/629] 10.222.0.70 () {56 vars in 1102 bytes} [Tue May 10 19:07:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:07:48.723629 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bd9bf6-4370-4eda-90f4-e754d3b1ef97 None None] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:48.724135 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bd9bf6-4370-4eda-90f4-e754d3b1ef97 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:48.724623 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bd9bf6-4370-4eda-90f4-e754d3b1ef97 None None] PATH_INFO: `/` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:48.726302 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 312/630] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:07:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:07:48.728456 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bd9bf6-4370-4eda-90f4-e754d3b1ef97 None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:48.761718 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4787fbf2-5935-4de8-9c3e-c46942028b52 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:48.793030 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eccd30-77ab-44b1-9f93-b2fed8447a90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:48.793766 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eccd30-77ab-44b1-9f93-b2fed8447a90 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:48.794052 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eccd30-77ab-44b1-9f93-b2fed8447a90 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:48.794328 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eccd30-77ab-44b1-9f93-b2fed8447a90 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:48.805262 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8eccd30-77ab-44b1-9f93-b2fed8447a90 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:48.806710 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8eccd30-77ab-44b1-9f93-b2fed8447a90 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:48.823023 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-b8eccd30-77ab-44b1-9f93-b2fed8447a90 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:07:48.823023 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:07:48.823023 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:07:48.823023 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:07:48.823023 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:07:48.823023 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:07:48.823023 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:07:48.823023 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:07:48.823023 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:07:48.823023 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:07:48.823023 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:07:48.823023 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:07:48.823023 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 19:07:48.823023 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 19:07:48.823023 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 19:07:48.824254 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 19:07:48.824254 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:07:48.824254 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:07:48.824254 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:07:48.824254 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:07:48.824254 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:07:48.824254 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:07:48.824254 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:07:48.824254 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( May 10 19:07:48.824254 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:07:48.824254 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() May 10 19:07:48.824254 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:07:48.824254 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:07:48.824254 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:07:48.824254 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() May 10 19:07:48.824254 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:07:48.824254 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( May 10 19:07:48.825215 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 19:07:48.825215 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 19:07:48.825215 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:07:48.825215 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:07:48.825437 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bd9bf6-4370-4eda-90f4-e754d3b1ef97 None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:48.825512 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 319/631] 10.222.0.70 () {56 vars in 1108 bytes} [Tue May 10 19:07:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:07:48.825895 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf7c595-4d57-422f-b9eb-3c985cc944d4 None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:48.826174 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf7c595-4d57-422f-b9eb-3c985cc944d4 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:48.826446 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf7c595-4d57-422f-b9eb-3c985cc944d4 None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:48.827715 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 320/632] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:07:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:07:48.828393 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf7c595-4d57-422f-b9eb-3c985cc944d4 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:48.863901 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f302da4-24a7-455c-8c1b-0408dd0eecc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:48.864729 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f302da4-24a7-455c-8c1b-0408dd0eecc1 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:48.865014 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f302da4-24a7-455c-8c1b-0408dd0eecc1 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:48.865298 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f302da4-24a7-455c-8c1b-0408dd0eecc1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:48.871828 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f302da4-24a7-455c-8c1b-0408dd0eecc1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:48.873306 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f302da4-24a7-455c-8c1b-0408dd0eecc1 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:48.887529 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application [None req-5f302da4-24a7-455c-8c1b-0408dd0eecc1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 19:07:48.887529 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:07:48.887529 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:07:48.887529 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:07:48.887529 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:07:48.887529 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:07:48.887529 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:07:48.887529 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:07:48.887529 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:07:48.887529 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:07:48.887529 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:07:48.887529 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:07:48.887529 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 19:07:48.887529 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 19:07:48.887529 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 19:07:48.888458 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 19:07:48.888458 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:07:48.888458 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:07:48.888458 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:07:48.888458 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:07:48.888458 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:07:48.888458 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:07:48.888458 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:07:48.888458 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application with Lock( May 10 19:07:48.888458 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:07:48.888458 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._enter() May 10 19:07:48.888458 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:07:48.888458 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:07:48.888458 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:07:48.888458 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.creator() May 10 19:07:48.888458 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:07:48.888458 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application created_value = creator( May 10 19:07:48.889365 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 19:07:48.889365 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 19:07:48.889365 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 19:07:48.889365 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 19:07:48.889365 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 19:07:48.889365 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 19:07:48.889365 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 19:07:48.889365 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application May 10 19:07:48.889365 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 313/633] 10.222.0.70 () {56 vars in 1111 bytes} [Tue May 10 19:07:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:07:48.889992 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acb54c8-0cb3-453f-81f8-7a5da6288eb5 None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:48.890280 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acb54c8-0cb3-453f-81f8-7a5da6288eb5 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:48.890558 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acb54c8-0cb3-453f-81f8-7a5da6288eb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:48.907296 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-2acb54c8-0cb3-453f-81f8-7a5da6288eb5 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:07:48.908494 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-2acb54c8-0cb3-453f-81f8-7a5da6288eb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:07:48.929138 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf7c595-4d57-422f-b9eb-3c985cc944d4 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:48.961566 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5c1da2-1796-421d-aace-53860c7739c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:48.962233 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5c1da2-1796-421d-aace-53860c7739c8 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:48.962513 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5c1da2-1796-421d-aace-53860c7739c8 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:48.962783 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5c1da2-1796-421d-aace-53860c7739c8 None admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:48.963525 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5c1da2-1796-421d-aace-53860c7739c8 None admin] RBAC: Adding query filter params (name=service) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:07:48.963825 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5c1da2-1796-421d-aace-53860c7739c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:48.965242 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5c1da2-1796-421d-aace-53860c7739c8 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:48.972750 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 321/634] 10.222.0.70 () {56 vars in 1103 bytes} [Tue May 10 19:07:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:07:48.973512 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5c1da2-1796-421d-aace-53860c7739c8 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:48.974430 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 314/635] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:07:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 19:07:48.975534 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabf1783-d2e1-4183-a58e-aab677084eed None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:48.975828 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabf1783-d2e1-4183-a58e-aab677084eed None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:48.976107 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabf1783-d2e1-4183-a58e-aab677084eed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:48.992124 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-fabf1783-d2e1-4183-a58e-aab677084eed None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:07:48.993323 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-fabf1783-d2e1-4183-a58e-aab677084eed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:07:49.055795 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 315/636] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:07:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 19:07:49.056586 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabf1783-d2e1-4183-a58e-aab677084eed None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:49.069100 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5c1da2-1796-421d-aace-53860c7739c8 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:49.100752 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406f5f33-79ee-4e6a-85e4-c63a099239e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:49.101408 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406f5f33-79ee-4e6a-85e4-c63a099239e2 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:49.101687 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406f5f33-79ee-4e6a-85e4-c63a099239e2 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:49.101958 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406f5f33-79ee-4e6a-85e4-c63a099239e2 None admin] PATH_INFO: `/v3/domains` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:49.102666 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406f5f33-79ee-4e6a-85e4-c63a099239e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:07:49.102969 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406f5f33-79ee-4e6a-85e4-c63a099239e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:49.104333 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406f5f33-79ee-4e6a-85e4-c63a099239e2 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:49.116101 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 322/637] 10.222.0.70 () {56 vars in 1109 bytes} [Tue May 10 19:07:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:07:49.116824 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406f5f33-79ee-4e6a-85e4-c63a099239e2 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:49.154297 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabf1783-d2e1-4183-a58e-aab677084eed None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:49.186403 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a606e30-042e-4230-afa7-d7837b3e4c71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:49.187056 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a606e30-042e-4230-afa7-d7837b3e4c71 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:49.187394 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a606e30-042e-4230-afa7-d7837b3e4c71 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:49.187669 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a606e30-042e-4230-afa7-d7837b3e4c71 None admin] PATH_INFO: `/v3/projects` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:49.188466 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a606e30-042e-4230-afa7-d7837b3e4c71 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:07:49.188774 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a606e30-042e-4230-afa7-d7837b3e4c71 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:49.190193 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a606e30-042e-4230-afa7-d7837b3e4c71 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:49.200966 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 316/638] 10.222.0.70 () {56 vars in 1148 bytes} [Tue May 10 19:07:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:07:49.201773 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a606e30-042e-4230-afa7-d7837b3e4c71 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:49.206594 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406f5f33-79ee-4e6a-85e4-c63a099239e2 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:49.238666 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f981a50e-0952-4010-be6b-0c487b1a2853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:49.239470 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f981a50e-0952-4010-be6b-0c487b1a2853 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:49.239751 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f981a50e-0952-4010-be6b-0c487b1a2853 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:49.240025 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f981a50e-0952-4010-be6b-0c487b1a2853 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:49.249580 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f981a50e-0952-4010-be6b-0c487b1a2853 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:49.251021 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f981a50e-0952-4010-be6b-0c487b1a2853 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:49.268210 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-f981a50e-0952-4010-be6b-0c487b1a2853 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:07:49.268210 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:07:49.268210 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:07:49.268210 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:07:49.268210 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:07:49.268210 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:07:49.268210 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:07:49.268210 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:07:49.268210 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:07:49.268210 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:07:49.268210 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:07:49.268210 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:07:49.268210 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 19:07:49.268210 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 19:07:49.268210 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 19:07:49.269886 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 19:07:49.269886 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:07:49.269886 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:07:49.269886 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:07:49.269886 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:07:49.269886 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:07:49.269886 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:07:49.269886 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:07:49.269886 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( May 10 19:07:49.269886 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:07:49.269886 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() May 10 19:07:49.269886 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:07:49.269886 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:07:49.269886 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:07:49.269886 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() May 10 19:07:49.269886 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:07:49.269886 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( May 10 19:07:49.270799 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 19:07:49.270799 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 19:07:49.270799 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:07:49.270799 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:07:49.270799 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 323/639] 10.222.0.70 () {56 vars in 1108 bytes} [Tue May 10 19:07:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:07:49.271190 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f981a50e-0952-4010-be6b-0c487b1a2853 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:49.297005 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a606e30-042e-4230-afa7-d7837b3e4c71 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:49.328951 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dfd6e7-e099-4258-8f10-85c98c8caac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:49.329671 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dfd6e7-e099-4258-8f10-85c98c8caac1 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:49.329949 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dfd6e7-e099-4258-8f10-85c98c8caac1 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:49.330216 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dfd6e7-e099-4258-8f10-85c98c8caac1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:49.340461 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dfd6e7-e099-4258-8f10-85c98c8caac1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:07:49.348080 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application [None req-a4dfd6e7-e099-4258-8f10-85c98c8caac1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 19:07:49.348080 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:07:49.348080 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:07:49.348080 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:07:49.348080 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:07:49.348080 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:07:49.348080 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:07:49.348080 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:07:49.348080 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:07:49.348080 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:07:49.348080 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:07:49.348080 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:07:49.348080 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:07:49.348080 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:07:49.348080 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:07:49.348080 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:07:49.353718 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:07:49.353718 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:07:49.353718 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:07:49.353718 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:07:49.353718 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:07:49.353718 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:07:49.353718 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:07:49.353718 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:07:49.353718 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:07:49.353718 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:07:49.353718 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:07:49.353718 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application with Lock( May 10 19:07:49.353718 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:07:49.353718 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._enter() May 10 19:07:49.353718 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:07:49.353718 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:07:49.354731 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:07:49.354731 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.creator() May 10 19:07:49.354731 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:07:49.354731 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application created_value = creator( May 10 19:07:49.354731 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:07:49.354731 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:07:49.354731 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:07:49.354731 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:07:49.354731 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:07:49.354731 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:07:49.354731 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 19:07:49.354731 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application May 10 19:07:49.354731 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 317/640] 10.222.0.70 () {56 vars in 1102 bytes} [Tue May 10 19:07:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:07:49.354731 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dfd6e7-e099-4258-8f10-85c98c8caac1 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:49.368885 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f981a50e-0952-4010-be6b-0c487b1a2853 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:49.401487 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12763d36-52ec-4e1d-89dc-2d6afb74d29f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:49.402282 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12763d36-52ec-4e1d-89dc-2d6afb74d29f None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:49.402566 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12763d36-52ec-4e1d-89dc-2d6afb74d29f None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:49.402842 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12763d36-52ec-4e1d-89dc-2d6afb74d29f None admin] PATH_INFO: `/v3/roles/service` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:49.412444 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12763d36-52ec-4e1d-89dc-2d6afb74d29f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:07:49.420051 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-12763d36-52ec-4e1d-89dc-2d6afb74d29f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 19:07:49.420051 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:07:49.420051 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:07:49.420051 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:07:49.420051 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:07:49.420051 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:07:49.420051 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:07:49.420051 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:07:49.420051 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:07:49.420051 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:07:49.420051 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:07:49.420051 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:07:49.420051 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:07:49.420051 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:07:49.420051 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:07:49.420051 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:07:49.421118 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:07:49.421118 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:07:49.421118 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:07:49.421118 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:07:49.421118 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:07:49.421118 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:07:49.421118 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:07:49.421118 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:07:49.421118 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:07:49.421118 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:07:49.421118 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:07:49.421118 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( May 10 19:07:49.421118 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:07:49.421118 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() May 10 19:07:49.421118 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:07:49.421118 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:07:49.421973 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:07:49.421973 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() May 10 19:07:49.421973 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:07:49.421973 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( May 10 19:07:49.421973 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:07:49.421973 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:07:49.421973 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:07:49.421973 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:07:49.421973 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:07:49.421973 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:07:49.421973 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 19:07:49.421973 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:07:49.421973 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 324/641] 10.222.0.70 () {56 vars in 1102 bytes} [Tue May 10 19:07:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:07:49.421973 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12763d36-52ec-4e1d-89dc-2d6afb74d29f None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:49.446264 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dfd6e7-e099-4258-8f10-85c98c8caac1 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:49.477760 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d439361-7587-44ce-87ae-9cf5755b86f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:49.478542 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d439361-7587-44ce-87ae-9cf5755b86f1 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:49.478818 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d439361-7587-44ce-87ae-9cf5755b86f1 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:49.479088 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d439361-7587-44ce-87ae-9cf5755b86f1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:49.485506 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d439361-7587-44ce-87ae-9cf5755b86f1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:49.486926 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d439361-7587-44ce-87ae-9cf5755b86f1 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:49.500902 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application [None req-1d439361-7587-44ce-87ae-9cf5755b86f1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 19:07:49.500902 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:07:49.500902 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:07:49.500902 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:07:49.500902 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:07:49.500902 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:07:49.500902 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:07:49.500902 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:07:49.500902 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:07:49.500902 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:07:49.500902 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:07:49.500902 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:07:49.500902 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 19:07:49.500902 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 19:07:49.500902 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 19:07:49.501824 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 19:07:49.501824 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:07:49.501824 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:07:49.501824 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:07:49.501824 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:07:49.501824 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:07:49.501824 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:07:49.501824 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:07:49.501824 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application with Lock( May 10 19:07:49.501824 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:07:49.501824 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._enter() May 10 19:07:49.501824 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:07:49.501824 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:07:49.501824 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:07:49.501824 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.creator() May 10 19:07:49.501824 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:07:49.501824 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application created_value = creator( May 10 19:07:49.503369 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 19:07:49.503369 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 19:07:49.503369 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 19:07:49.503369 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 19:07:49.503369 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 19:07:49.503369 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 19:07:49.503369 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 19:07:49.503369 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application May 10 19:07:49.504557 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 318/642] 10.222.0.70 () {56 vars in 1111 bytes} [Tue May 10 19:07:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:07:49.505546 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d439361-7587-44ce-87ae-9cf5755b86f1 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:49.515236 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12763d36-52ec-4e1d-89dc-2d6afb74d29f None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:49.546736 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f997e79-c448-47d1-a643-7d91f30be33f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:49.547387 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f997e79-c448-47d1-a643-7d91f30be33f None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:49.547672 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f997e79-c448-47d1-a643-7d91f30be33f None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:49.547949 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f997e79-c448-47d1-a643-7d91f30be33f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:49.548804 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f997e79-c448-47d1-a643-7d91f30be33f None admin] RBAC: Adding query filter params (role.id=445805bec1e741c9b823495ae6e364f0, scope.project.id=2ee9ec5b515440fe9b39aedf3e339c79, user.id=b9f310a468ec4058b3c95356ea60ab4c) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:07:49.549120 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f997e79-c448-47d1-a643-7d91f30be33f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:49.551058 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f997e79-c448-47d1-a643-7d91f30be33f None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:49.556564 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 325/643] 10.222.0.70 () {56 vars in 1374 bytes} [Tue May 10 19:07:49 2022] GET /identity/v3/role_assignments?user.id=b9f310a468ec4058b3c95356ea60ab4c&scope.project.id=2ee9ec5b515440fe9b39aedf3e339c79&role.id=445805bec1e741c9b823495ae6e364f0 => generated 608 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:07:49.557330 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f997e79-c448-47d1-a643-7d91f30be33f None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:49.601922 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d439361-7587-44ce-87ae-9cf5755b86f1 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:49.638272 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f31642d-4db4-4717-90c5-080142c557a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:49.639167 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f31642d-4db4-4717-90c5-080142c557a1 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:49.639453 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f31642d-4db4-4717-90c5-080142c557a1 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:49.639727 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f31642d-4db4-4717-90c5-080142c557a1 None admin] PATH_INFO: `/v3/domains` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:49.640489 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f31642d-4db4-4717-90c5-080142c557a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:07:49.640799 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f31642d-4db4-4717-90c5-080142c557a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:49.642215 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f31642d-4db4-4717-90c5-080142c557a1 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:49.656079 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 319/644] 10.222.0.70 () {56 vars in 1109 bytes} [Tue May 10 19:07:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:07:49.656992 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f31642d-4db4-4717-90c5-080142c557a1 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:49.666272 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f997e79-c448-47d1-a643-7d91f30be33f None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:49.701829 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b96045-2116-4280-97ac-5e1a45cc86bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:49.702507 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b96045-2116-4280-97ac-5e1a45cc86bb None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:49.702790 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b96045-2116-4280-97ac-5e1a45cc86bb None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:49.703063 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b96045-2116-4280-97ac-5e1a45cc86bb None admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:49.703807 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b96045-2116-4280-97ac-5e1a45cc86bb None admin] RBAC: Adding query filter params (name=service) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:07:49.704107 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b96045-2116-4280-97ac-5e1a45cc86bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:49.705524 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b96045-2116-4280-97ac-5e1a45cc86bb None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:49.714807 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 326/645] 10.222.0.70 () {56 vars in 1103 bytes} [Tue May 10 19:07:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:07:49.715665 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b96045-2116-4280-97ac-5e1a45cc86bb None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:49.764190 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f31642d-4db4-4717-90c5-080142c557a1 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:49.803192 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfc1e6f-e9c3-44b1-88dd-709b789d02b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:49.803857 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfc1e6f-e9c3-44b1-88dd-709b789d02b1 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:49.804141 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfc1e6f-e9c3-44b1-88dd-709b789d02b1 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:49.804411 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfc1e6f-e9c3-44b1-88dd-709b789d02b1 None admin] PATH_INFO: `/v3/roles` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:49.805199 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfc1e6f-e9c3-44b1-88dd-709b789d02b1 None admin] RBAC: Adding query filter params (name=service) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:07:49.805498 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfc1e6f-e9c3-44b1-88dd-709b789d02b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:49.806933 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfc1e6f-e9c3-44b1-88dd-709b789d02b1 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:49.815468 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 320/646] 10.222.0.70 () {56 vars in 1103 bytes} [Tue May 10 19:07:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:07:49.816082 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b96045-2116-4280-97ac-5e1a45cc86bb None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:49.816610 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfc1e6f-e9c3-44b1-88dd-709b789d02b1 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:49.855596 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f54442-2574-4c2c-9e3c-d12f89b836c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:49.857265 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f54442-2574-4c2c-9e3c-d12f89b836c8 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:49.857265 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f54442-2574-4c2c-9e3c-d12f89b836c8 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:49.857265 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f54442-2574-4c2c-9e3c-d12f89b836c8 None admin] PATH_INFO: `/v3/projects` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:49.857639 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f54442-2574-4c2c-9e3c-d12f89b836c8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:07:49.857921 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f54442-2574-4c2c-9e3c-d12f89b836c8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:49.859367 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f54442-2574-4c2c-9e3c-d12f89b836c8 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:49.876910 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 327/647] 10.222.0.70 () {56 vars in 1148 bytes} [Tue May 10 19:07:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:07:49.876910 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f54442-2574-4c2c-9e3c-d12f89b836c8 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:49.925569 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfc1e6f-e9c3-44b1-88dd-709b789d02b1 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:49.961447 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109d43df-6aaa-465e-9dfa-db5b78254c35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:49.962266 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109d43df-6aaa-465e-9dfa-db5b78254c35 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:49.962538 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109d43df-6aaa-465e-9dfa-db5b78254c35 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:49.962814 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109d43df-6aaa-465e-9dfa-db5b78254c35 None admin] PATH_INFO: `/v3/users/glance` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:49.970318 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109d43df-6aaa-465e-9dfa-db5b78254c35 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:49.971798 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109d43df-6aaa-465e-9dfa-db5b78254c35 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:49.984643 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f54442-2574-4c2c-9e3c-d12f89b836c8 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:49.985584 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application [None req-109d43df-6aaa-465e-9dfa-db5b78254c35 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 10 19:07:49.985584 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:07:49.985584 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:07:49.985584 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:07:49.985584 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:07:49.985584 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:07:49.985584 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:07:49.985584 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:07:49.985584 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:07:49.985584 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:07:49.985584 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:07:49.985584 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:07:49.985584 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 19:07:49.985584 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 19:07:49.985584 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 19:07:49.985584 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 19:07:49.986721 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:07:49.986721 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:07:49.986721 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 19:07:49.986721 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 19:07:49.986721 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 19:07:49.986721 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 19:07:49.986721 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:07:49.986721 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:07:49.986721 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:07:49.986721 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:07:49.986721 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:07:49.986721 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application with Lock( May 10 19:07:49.986721 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:07:49.986721 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._enter() May 10 19:07:49.986721 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:07:49.986721 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:07:49.986721 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:07:49.986721 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.creator() May 10 19:07:49.987807 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:07:49.987807 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application created_value = creator( May 10 19:07:49.987807 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 19:07:49.987807 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 19:07:49.987807 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 19:07:49.987807 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 19:07:49.987807 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 19:07:49.987807 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 19:07:49.987807 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 10 19:07:49.987807 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application May 10 19:07:49.987807 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 321/648] 10.222.0.70 () {56 vars in 1099 bytes} [Tue May 10 19:07:49 2022] GET /identity/v3/users/glance => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:07:49.987807 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109d43df-6aaa-465e-9dfa-db5b78254c35 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:50.021768 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ceac7a-548d-48c5-81f4-12da19ca7ade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:50.022564 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ceac7a-548d-48c5-81f4-12da19ca7ade None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:50.022848 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ceac7a-548d-48c5-81f4-12da19ca7ade None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:50.023119 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ceac7a-548d-48c5-81f4-12da19ca7ade None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:50.033211 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ceac7a-548d-48c5-81f4-12da19ca7ade None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:50.034686 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ceac7a-548d-48c5-81f4-12da19ca7ade None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:50.051612 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-c2ceac7a-548d-48c5-81f4-12da19ca7ade None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:07:50.051612 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:07:50.051612 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:07:50.051612 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:07:50.051612 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:07:50.051612 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:07:50.051612 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:07:50.051612 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:07:50.051612 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:07:50.051612 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:07:50.051612 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:07:50.051612 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:07:50.051612 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 19:07:50.051612 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 19:07:50.051612 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 19:07:50.052658 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 19:07:50.052658 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:07:50.052658 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:07:50.052658 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:07:50.052658 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:07:50.052658 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:07:50.052658 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:07:50.052658 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:07:50.052658 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( May 10 19:07:50.052658 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:07:50.052658 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() May 10 19:07:50.052658 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:07:50.052658 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:07:50.052658 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:07:50.052658 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() May 10 19:07:50.052658 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:07:50.052658 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( May 10 19:07:50.053583 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 19:07:50.053583 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 19:07:50.053583 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:07:50.053583 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:07:50.056757 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 328/649] 10.222.0.70 () {56 vars in 1108 bytes} [Tue May 10 19:07:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:07:50.057582 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ceac7a-548d-48c5-81f4-12da19ca7ade None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:50.102675 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109d43df-6aaa-465e-9dfa-db5b78254c35 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:50.136766 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67026463-7583-4619-a805-e1e6707f8238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:50.137493 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67026463-7583-4619-a805-e1e6707f8238 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:50.137774 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67026463-7583-4619-a805-e1e6707f8238 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:50.138048 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67026463-7583-4619-a805-e1e6707f8238 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:50.148695 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67026463-7583-4619-a805-e1e6707f8238 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:50.150300 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67026463-7583-4619-a805-e1e6707f8238 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:50.156443 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ceac7a-548d-48c5-81f4-12da19ca7ade None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:50.167428 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application [None req-67026463-7583-4619-a805-e1e6707f8238 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:07:50.167428 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:07:50.167428 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:07:50.167428 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:07:50.167428 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:07:50.167428 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:07:50.167428 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:07:50.167428 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:07:50.167428 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:07:50.167428 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:07:50.167428 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:07:50.167428 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:07:50.167428 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 19:07:50.167428 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 19:07:50.167428 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 19:07:50.168619 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 19:07:50.168619 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:07:50.168619 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:07:50.168619 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:07:50.168619 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:07:50.168619 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:07:50.168619 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:07:50.168619 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:07:50.168619 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application with Lock( May 10 19:07:50.168619 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:07:50.168619 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._enter() May 10 19:07:50.168619 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:07:50.168619 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:07:50.168619 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:07:50.168619 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.creator() May 10 19:07:50.168619 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:07:50.168619 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application created_value = creator( May 10 19:07:50.169653 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 19:07:50.169653 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 19:07:50.169653 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:07:50.169653 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application May 10 19:07:50.169653 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 322/650] 10.222.0.70 () {56 vars in 1108 bytes} [Tue May 10 19:07:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:07:50.170422 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67026463-7583-4619-a805-e1e6707f8238 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:50.195169 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed82308-57a4-487e-8886-7f30487303a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:50.196065 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed82308-57a4-487e-8886-7f30487303a4 None admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:50.196349 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed82308-57a4-487e-8886-7f30487303a4 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:50.196655 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed82308-57a4-487e-8886-7f30487303a4 None admin] PATH_INFO: `/v3/projects/2ee9ec5b515440fe9b39aedf3e339c79/users/0454aa03fa31487ea1464b9d0008212c/roles/445805bec1e741c9b823495ae6e364f0` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:50.211062 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed82308-57a4-487e-8886-7f30487303a4 None admin] RBAC: Authorizing `identity:create_grant(project_id=2ee9ec5b515440fe9b39aedf3e339c79, user_id=0454aa03fa31487ea1464b9d0008212c, role_id=445805bec1e741c9b823495ae6e364f0)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:50.212512 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed82308-57a4-487e-8886-7f30487303a4 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:50.225548 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 329/651] 10.222.0.70 () {58 vars in 1439 bytes} [Tue May 10 19:07:50 2022] PUT /identity/v3/projects/2ee9ec5b515440fe9b39aedf3e339c79/users/0454aa03fa31487ea1464b9d0008212c/roles/445805bec1e741c9b823495ae6e364f0 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:07:50.226108 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed82308-57a4-487e-8886-7f30487303a4 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:50.304593 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67026463-7583-4619-a805-e1e6707f8238 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:50.342153 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2947741-befe-432e-9f79-a2055e985e32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:50.343202 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2947741-befe-432e-9f79-a2055e985e32 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:50.343733 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2947741-befe-432e-9f79-a2055e985e32 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:50.344187 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2947741-befe-432e-9f79-a2055e985e32 None admin] PATH_INFO: `/v3/users` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:50.345260 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2947741-befe-432e-9f79-a2055e985e32 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:07:50.345757 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2947741-befe-432e-9f79-a2055e985e32 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:50.348044 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2947741-befe-432e-9f79-a2055e985e32 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:50.351994 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed82308-57a4-487e-8886-7f30487303a4 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:50.368675 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 323/652] 10.222.0.70 () {56 vars in 1137 bytes} [Tue May 10 19:07:50 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:07:50.370013 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2947741-befe-432e-9f79-a2055e985e32 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:50.398237 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce00396-0283-4a0a-bbb8-953a366e5474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:50.398833 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce00396-0283-4a0a-bbb8-953a366e5474 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:50.399111 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce00396-0283-4a0a-bbb8-953a366e5474 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:50.399380 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce00396-0283-4a0a-bbb8-953a366e5474 None admin] PATH_INFO: `/v3/domains` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:50.400142 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce00396-0283-4a0a-bbb8-953a366e5474 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:07:50.400468 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce00396-0283-4a0a-bbb8-953a366e5474 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:50.401856 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce00396-0283-4a0a-bbb8-953a366e5474 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:50.416265 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 330/653] 10.222.0.70 () {56 vars in 1109 bytes} [Tue May 10 19:07:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:07:50.417280 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce00396-0283-4a0a-bbb8-953a366e5474 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:50.501160 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2947741-befe-432e-9f79-a2055e985e32 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:50.524759 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce00396-0283-4a0a-bbb8-953a366e5474 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:50.544041 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1125cd6a-cadb-4b9d-bca7-187f785faac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:50.545292 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1125cd6a-cadb-4b9d-bca7-187f785faac1 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:50.545710 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1125cd6a-cadb-4b9d-bca7-187f785faac1 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:50.546092 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1125cd6a-cadb-4b9d-bca7-187f785faac1 None admin] PATH_INFO: `/v3/domains` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:50.547201 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1125cd6a-cadb-4b9d-bca7-187f785faac1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:07:50.547612 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1125cd6a-cadb-4b9d-bca7-187f785faac1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:50.549652 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1125cd6a-cadb-4b9d-bca7-187f785faac1 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:50.562353 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef2d17a-f5ed-4e26-b3d9-88d25b54b757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:50.563302 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef2d17a-f5ed-4e26-b3d9-88d25b54b757 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:50.563753 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef2d17a-f5ed-4e26-b3d9-88d25b54b757 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:50.564270 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef2d17a-f5ed-4e26-b3d9-88d25b54b757 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:50.567291 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 324/654] 10.222.0.70 () {56 vars in 1109 bytes} [Tue May 10 19:07:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:07:50.571754 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1125cd6a-cadb-4b9d-bca7-187f785faac1 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:50.639467 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef2d17a-f5ed-4e26-b3d9-88d25b54b757 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:50.641427 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef2d17a-f5ed-4e26-b3d9-88d25b54b757 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:50.671578 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1125cd6a-cadb-4b9d-bca7-187f785faac1 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:50.705441 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8406a707-8a8f-42ba-857f-5a9e201488a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:50.708598 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8406a707-8a8f-42ba-857f-5a9e201488a4 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:50.708975 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8406a707-8a8f-42ba-857f-5a9e201488a4 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:50.709355 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8406a707-8a8f-42ba-857f-5a9e201488a4 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:50.718841 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8406a707-8a8f-42ba-857f-5a9e201488a4 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:50.720396 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8406a707-8a8f-42ba-857f-5a9e201488a4 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:50.735461 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application [None req-8406a707-8a8f-42ba-857f-5a9e201488a4 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 10 19:07:50.735461 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:07:50.735461 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:07:50.735461 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:07:50.735461 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:07:50.735461 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:07:50.735461 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:07:50.735461 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:07:50.735461 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:07:50.735461 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:07:50.735461 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:07:50.735461 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:07:50.735461 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 19:07:50.735461 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 19:07:50.735461 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 19:07:50.735461 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 19:07:50.736500 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:07:50.736500 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:07:50.736500 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 19:07:50.736500 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 19:07:50.736500 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 19:07:50.736500 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 19:07:50.736500 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:07:50.736500 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:07:50.736500 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:07:50.736500 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:07:50.736500 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:07:50.736500 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application with Lock( May 10 19:07:50.736500 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:07:50.736500 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._enter() May 10 19:07:50.736500 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:07:50.736500 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:07:50.736500 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:07:50.736500 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.creator() May 10 19:07:50.738019 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:07:50.738019 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application created_value = creator( May 10 19:07:50.738019 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 19:07:50.738019 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 19:07:50.738019 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 19:07:50.738019 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 19:07:50.738019 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 19:07:50.738019 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 19:07:50.738019 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 10 19:07:50.738019 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application May 10 19:07:50.738019 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 325/655] 10.222.0.70 () {56 vars in 1099 bytes} [Tue May 10 19:07:50 2022] GET /identity/v3/users/cinder => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:07:50.740485 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8406a707-8a8f-42ba-857f-5a9e201488a4 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:50.745711 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 331/656] 10.222.0.70 () {58 vars in 1282 bytes} [Tue May 10 19:07:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 19:07:50.746780 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef2d17a-f5ed-4e26-b3d9-88d25b54b757 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:50.848505 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8406a707-8a8f-42ba-857f-5a9e201488a4 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:50.854261 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef2d17a-f5ed-4e26-b3d9-88d25b54b757 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:50.883705 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee403e8-1f20-41ee-8b16-670515b8802a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:50.884679 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee403e8-1f20-41ee-8b16-670515b8802a None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:50.885035 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee403e8-1f20-41ee-8b16-670515b8802a None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:50.885384 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee403e8-1f20-41ee-8b16-670515b8802a None admin] PATH_INFO: `/v3/users/neutron` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:50.893819 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee403e8-1f20-41ee-8b16-670515b8802a None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:50.895344 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee403e8-1f20-41ee-8b16-670515b8802a None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:50.900490 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc806bf-5d72-41c6-8116-2ee672f1699a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:50.901386 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc806bf-5d72-41c6-8116-2ee672f1699a None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:50.901842 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc806bf-5d72-41c6-8116-2ee672f1699a None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:50.902441 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc806bf-5d72-41c6-8116-2ee672f1699a None admin] PATH_INFO: `/v3/users` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:50.903569 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc806bf-5d72-41c6-8116-2ee672f1699a None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:07:50.904059 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc806bf-5d72-41c6-8116-2ee672f1699a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:50.905680 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc806bf-5d72-41c6-8116-2ee672f1699a None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:50.911434 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application [None req-4ee403e8-1f20-41ee-8b16-670515b8802a None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 10 19:07:50.911434 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:07:50.911434 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:07:50.911434 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:07:50.911434 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:07:50.911434 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:07:50.911434 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:07:50.911434 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:07:50.911434 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:07:50.911434 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:07:50.911434 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:07:50.911434 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:07:50.911434 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 19:07:50.911434 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 19:07:50.911434 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 19:07:50.911434 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 19:07:50.912387 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:07:50.912387 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:07:50.912387 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 19:07:50.912387 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 19:07:50.912387 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 19:07:50.912387 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 19:07:50.912387 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:07:50.912387 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:07:50.912387 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:07:50.912387 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:07:50.912387 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:07:50.912387 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application with Lock( May 10 19:07:50.912387 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:07:50.912387 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._enter() May 10 19:07:50.912387 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:07:50.912387 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:07:50.912387 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:07:50.912387 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.creator() May 10 19:07:50.913368 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:07:50.913368 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application created_value = creator( May 10 19:07:50.913368 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 19:07:50.913368 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 19:07:50.913368 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 19:07:50.913368 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 19:07:50.913368 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 19:07:50.913368 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 19:07:50.913368 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 10 19:07:50.913368 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application May 10 19:07:50.917406 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 326/657] 10.222.0.70 () {56 vars in 1102 bytes} [Tue May 10 19:07:50 2022] GET /identity/v3/users/neutron => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:07:50.919099 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee403e8-1f20-41ee-8b16-670515b8802a None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:50.929500 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 332/658] 10.222.0.70 () {56 vars in 1137 bytes} [Tue May 10 19:07:50 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:07:50.930560 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc806bf-5d72-41c6-8116-2ee672f1699a None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:51.022220 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee403e8-1f20-41ee-8b16-670515b8802a None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:51.055414 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fffccb-6338-4537-8772-18a1a68bdadf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:51.056358 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fffccb-6338-4537-8772-18a1a68bdadf None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:51.056762 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fffccb-6338-4537-8772-18a1a68bdadf None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:51.057136 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fffccb-6338-4537-8772-18a1a68bdadf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:51.058323 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc806bf-5d72-41c6-8116-2ee672f1699a None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:51.068233 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fffccb-6338-4537-8772-18a1a68bdadf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:51.069848 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fffccb-6338-4537-8772-18a1a68bdadf None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:51.087853 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application [None req-f0fffccb-6338-4537-8772-18a1a68bdadf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:07:51.087853 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:07:51.087853 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:07:51.087853 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:07:51.087853 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:07:51.087853 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:07:51.087853 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:07:51.087853 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:07:51.087853 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:07:51.087853 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:07:51.087853 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:07:51.087853 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:07:51.087853 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 19:07:51.087853 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 19:07:51.087853 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 19:07:51.089009 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 19:07:51.089009 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:07:51.089009 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:07:51.089009 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:07:51.089009 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:07:51.089009 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:07:51.089009 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:07:51.089009 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:07:51.089009 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application with Lock( May 10 19:07:51.089009 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:07:51.089009 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._enter() May 10 19:07:51.089009 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:07:51.089009 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:07:51.089009 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:07:51.089009 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.creator() May 10 19:07:51.089009 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:07:51.089009 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application created_value = creator( May 10 19:07:51.090124 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 19:07:51.090124 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 19:07:51.090124 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:07:51.090124 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application May 10 19:07:51.095386 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 327/659] 10.222.0.70 () {56 vars in 1108 bytes} [Tue May 10 19:07:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:07:51.096522 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fffccb-6338-4537-8772-18a1a68bdadf None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:51.100626 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57951aff-18ab-4b91-9070-fc82fd86b6f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:51.100907 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57951aff-18ab-4b91-9070-fc82fd86b6f3 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:51.101306 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57951aff-18ab-4b91-9070-fc82fd86b6f3 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:51.101708 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57951aff-18ab-4b91-9070-fc82fd86b6f3 None admin] PATH_INFO: `/v3/users` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:51.102647 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57951aff-18ab-4b91-9070-fc82fd86b6f3 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:07:51.103057 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57951aff-18ab-4b91-9070-fc82fd86b6f3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:51.104620 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57951aff-18ab-4b91-9070-fc82fd86b6f3 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:51.126701 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 333/660] 10.222.0.70 () {56 vars in 1139 bytes} [Tue May 10 19:07:50 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:07:51.127661 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57951aff-18ab-4b91-9070-fc82fd86b6f3 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:51.217022 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fffccb-6338-4537-8772-18a1a68bdadf None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:51.223411 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57951aff-18ab-4b91-9070-fc82fd86b6f3 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:51.251241 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f89189e-a0c9-49cd-8313-d045f328f9c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:51.252126 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f89189e-a0c9-49cd-8313-d045f328f9c5 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:51.252633 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f89189e-a0c9-49cd-8313-d045f328f9c5 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:51.253120 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f89189e-a0c9-49cd-8313-d045f328f9c5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:51.258532 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a5d56f-c24a-4c85-87d4-a2a4286e7ae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:51.259314 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a5d56f-c24a-4c85-87d4-a2a4286e7ae1 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:51.259695 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a5d56f-c24a-4c85-87d4-a2a4286e7ae1 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:51.260072 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a5d56f-c24a-4c85-87d4-a2a4286e7ae1 None admin] PATH_INFO: `/v3/domains` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:51.261076 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a5d56f-c24a-4c85-87d4-a2a4286e7ae1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:07:51.261484 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a5d56f-c24a-4c85-87d4-a2a4286e7ae1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:51.262952 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a5d56f-c24a-4c85-87d4-a2a4286e7ae1 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:51.279832 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 334/661] 10.222.0.70 () {56 vars in 1109 bytes} [Tue May 10 19:07:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:07:51.280798 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a5d56f-c24a-4c85-87d4-a2a4286e7ae1 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:51.321418 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f89189e-a0c9-49cd-8313-d045f328f9c5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:51.323123 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f89189e-a0c9-49cd-8313-d045f328f9c5 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:51.383532 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a5d56f-c24a-4c85-87d4-a2a4286e7ae1 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:51.417569 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359dee6e-eac8-42d3-8219-0a11f10a5c59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:51.418395 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359dee6e-eac8-42d3-8219-0a11f10a5c59 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:51.418784 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359dee6e-eac8-42d3-8219-0a11f10a5c59 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:51.419163 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359dee6e-eac8-42d3-8219-0a11f10a5c59 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:51.423219 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 328/662] 10.222.0.70 () {58 vars in 1282 bytes} [Tue May 10 19:07:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 19:07:51.424278 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f89189e-a0c9-49cd-8313-d045f328f9c5 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:51.488774 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359dee6e-eac8-42d3-8219-0a11f10a5c59 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:51.489998 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359dee6e-eac8-42d3-8219-0a11f10a5c59 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:51.521486 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f89189e-a0c9-49cd-8313-d045f328f9c5 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:51.555085 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62613c7a-0745-4ab8-a982-ff9d08eda5b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:51.556256 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62613c7a-0745-4ab8-a982-ff9d08eda5b0 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:51.556788 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62613c7a-0745-4ab8-a982-ff9d08eda5b0 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:51.557273 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62613c7a-0745-4ab8-a982-ff9d08eda5b0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:51.564226 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62613c7a-0745-4ab8-a982-ff9d08eda5b0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:51.566433 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62613c7a-0745-4ab8-a982-ff9d08eda5b0 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:51.580678 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application [None req-62613c7a-0745-4ab8-a982-ff9d08eda5b0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 19:07:51.580678 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:07:51.580678 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:07:51.580678 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:07:51.580678 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:07:51.580678 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:07:51.580678 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:07:51.580678 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:07:51.580678 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:07:51.580678 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:07:51.580678 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:07:51.580678 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:07:51.580678 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 19:07:51.580678 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 19:07:51.580678 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 19:07:51.582332 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 19:07:51.582332 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:07:51.582332 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:07:51.582332 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:07:51.582332 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:07:51.582332 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:07:51.582332 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:07:51.582332 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:07:51.582332 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application with Lock( May 10 19:07:51.582332 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:07:51.582332 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._enter() May 10 19:07:51.582332 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:07:51.582332 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:07:51.582332 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:07:51.582332 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.creator() May 10 19:07:51.582332 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:07:51.582332 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application created_value = creator( May 10 19:07:51.583257 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 19:07:51.583257 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 19:07:51.583257 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 19:07:51.583257 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 19:07:51.583257 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 19:07:51.583257 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 19:07:51.583257 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 19:07:51.583257 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application May 10 19:07:51.585533 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 329/663] 10.222.0.70 () {56 vars in 1111 bytes} [Tue May 10 19:07:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:07:51.586642 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62613c7a-0745-4ab8-a982-ff9d08eda5b0 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:51.597588 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 335/664] 10.222.0.70 () {58 vars in 1282 bytes} [Tue May 10 19:07:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 19:07:51.598706 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359dee6e-eac8-42d3-8219-0a11f10a5c59 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:51.705946 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359dee6e-eac8-42d3-8219-0a11f10a5c59 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:51.715212 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62613c7a-0745-4ab8-a982-ff9d08eda5b0 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:51.751137 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c93f6c-7a9b-46e5-b529-21479e8b5a43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:51.752285 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa04faf-16dd-4674-b101-69af13e55aaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:51.752412 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c93f6c-7a9b-46e5-b529-21479e8b5a43 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:51.753457 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c93f6c-7a9b-46e5-b529-21479e8b5a43 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:51.753563 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa04faf-16dd-4674-b101-69af13e55aaf None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:51.753786 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa04faf-16dd-4674-b101-69af13e55aaf None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:51.754063 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa04faf-16dd-4674-b101-69af13e55aaf None admin] PATH_INFO: `/v3/projects` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:51.754471 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c93f6c-7a9b-46e5-b529-21479e8b5a43 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:51.754859 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa04faf-16dd-4674-b101-69af13e55aaf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:07:51.755169 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa04faf-16dd-4674-b101-69af13e55aaf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:51.756832 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa04faf-16dd-4674-b101-69af13e55aaf None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:51.766028 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c93f6c-7a9b-46e5-b529-21479e8b5a43 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:51.767785 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c93f6c-7a9b-46e5-b529-21479e8b5a43 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:51.776051 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 336/665] 10.222.0.70 () {56 vars in 1148 bytes} [Tue May 10 19:07:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:07:51.777026 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa04faf-16dd-4674-b101-69af13e55aaf None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:51.787884 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application [None req-47c93f6c-7a9b-46e5-b529-21479e8b5a43 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:07:51.787884 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:07:51.787884 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:07:51.787884 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:07:51.787884 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:07:51.787884 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:07:51.787884 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:07:51.787884 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:07:51.787884 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:07:51.787884 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:07:51.787884 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:07:51.787884 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:07:51.787884 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 19:07:51.787884 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 19:07:51.787884 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 19:07:51.788832 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 19:07:51.788832 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:07:51.788832 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:07:51.788832 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:07:51.788832 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:07:51.788832 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:07:51.788832 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:07:51.788832 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:07:51.788832 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application with Lock( May 10 19:07:51.788832 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:07:51.788832 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._enter() May 10 19:07:51.788832 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:07:51.788832 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:07:51.788832 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:07:51.788832 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.creator() May 10 19:07:51.788832 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:07:51.788832 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application created_value = creator( May 10 19:07:51.789765 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 19:07:51.789765 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 19:07:51.789765 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:07:51.789765 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application May 10 19:07:51.791962 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 330/666] 10.222.0.70 () {56 vars in 1108 bytes} [Tue May 10 19:07:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:07:51.793125 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c93f6c-7a9b-46e5-b529-21479e8b5a43 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:51.891030 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa04faf-16dd-4674-b101-69af13e55aaf None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:51.896839 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c93f6c-7a9b-46e5-b529-21479e8b5a43 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:51.927458 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29be4248-8f1d-4366-b26e-b375b83e9f5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:51.928259 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29be4248-8f1d-4366-b26e-b375b83e9f5f None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:51.928576 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29be4248-8f1d-4366-b26e-b375b83e9f5f None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:51.928851 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29be4248-8f1d-4366-b26e-b375b83e9f5f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:51.930839 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0cc1a1-e970-43f0-ad2c-d0ca339432b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:51.931489 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0cc1a1-e970-43f0-ad2c-d0ca339432b1 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:51.931771 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0cc1a1-e970-43f0-ad2c-d0ca339432b1 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:51.932036 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0cc1a1-e970-43f0-ad2c-d0ca339432b1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:51.932880 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0cc1a1-e970-43f0-ad2c-d0ca339432b1 None admin] RBAC: Adding query filter params (role.id=445805bec1e741c9b823495ae6e364f0, scope.project.id=2ee9ec5b515440fe9b39aedf3e339c79, user.id=24ca97ff2a1745e58dedba4cef61b3f0) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:07:51.933181 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0cc1a1-e970-43f0-ad2c-d0ca339432b1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:51.934611 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0cc1a1-e970-43f0-ad2c-d0ca339432b1 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:51.940405 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 331/667] 10.222.0.70 () {56 vars in 1374 bytes} [Tue May 10 19:07:51 2022] GET /identity/v3/role_assignments?user.id=24ca97ff2a1745e58dedba4cef61b3f0&scope.project.id=2ee9ec5b515440fe9b39aedf3e339c79&role.id=445805bec1e741c9b823495ae6e364f0 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:07:51.940694 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29be4248-8f1d-4366-b26e-b375b83e9f5f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:51.941479 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0cc1a1-e970-43f0-ad2c-d0ca339432b1 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:51.943131 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29be4248-8f1d-4366-b26e-b375b83e9f5f None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:51.979952 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-29be4248-8f1d-4366-b26e-b375b83e9f5f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:07:51.979952 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:07:51.979952 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:07:51.979952 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:07:51.979952 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:07:51.979952 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:07:51.979952 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:07:51.979952 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:07:51.979952 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:07:51.979952 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:07:51.979952 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:07:51.979952 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:07:51.979952 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 19:07:51.979952 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 19:07:51.979952 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 19:07:51.981089 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 19:07:51.981089 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:07:51.981089 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:07:51.981089 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:07:51.981089 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:07:51.981089 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:07:51.981089 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:07:51.981089 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:07:51.981089 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( May 10 19:07:51.981089 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:07:51.981089 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() May 10 19:07:51.981089 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:07:51.981089 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:07:51.981089 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:07:51.981089 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() May 10 19:07:51.981089 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:07:51.981089 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( May 10 19:07:51.982010 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 19:07:51.982010 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 19:07:51.982010 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:07:51.982010 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:07:51.990295 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 337/668] 10.222.0.70 () {56 vars in 1108 bytes} [Tue May 10 19:07:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:07:51.992533 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25121c89-0304-4ea5-94a9-4be2f79f57e3 None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:51.992983 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25121c89-0304-4ea5-94a9-4be2f79f57e3 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:51.993410 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25121c89-0304-4ea5-94a9-4be2f79f57e3 None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:51.995879 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 338/669] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:07:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:07:51.997071 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25121c89-0304-4ea5-94a9-4be2f79f57e3 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:52.062773 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0cc1a1-e970-43f0-ad2c-d0ca339432b1 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:52.111411 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599ea0bb-3246-4e09-8342-8b7717af80f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:52.112643 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599ea0bb-3246-4e09-8342-8b7717af80f8 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:52.113051 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599ea0bb-3246-4e09-8342-8b7717af80f8 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:52.113234 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599ea0bb-3246-4e09-8342-8b7717af80f8 None admin] PATH_INFO: `/v3/domains` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:52.113959 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599ea0bb-3246-4e09-8342-8b7717af80f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:07:52.114263 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599ea0bb-3246-4e09-8342-8b7717af80f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:52.115659 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599ea0bb-3246-4e09-8342-8b7717af80f8 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:52.124362 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25121c89-0304-4ea5-94a9-4be2f79f57e3 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:52.129365 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 332/670] 10.222.0.70 () {56 vars in 1109 bytes} [Tue May 10 19:07:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:07:52.130688 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7267bde2-f985-4b15-948e-b523f069ad23 None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:52.130974 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7267bde2-f985-4b15-948e-b523f069ad23 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:52.131247 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7267bde2-f985-4b15-948e-b523f069ad23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:52.148580 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-7267bde2-f985-4b15-948e-b523f069ad23 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:07:52.149758 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-7267bde2-f985-4b15-948e-b523f069ad23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:07:52.166758 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234f9625-15bf-4c57-80ee-8e9971a0f2ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:52.167520 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234f9625-15bf-4c57-80ee-8e9971a0f2ac None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:52.167915 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234f9625-15bf-4c57-80ee-8e9971a0f2ac None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:52.168245 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234f9625-15bf-4c57-80ee-8e9971a0f2ac None admin] PATH_INFO: `/v3/domains` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:52.169082 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234f9625-15bf-4c57-80ee-8e9971a0f2ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:07:52.170187 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234f9625-15bf-4c57-80ee-8e9971a0f2ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:52.171627 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234f9625-15bf-4c57-80ee-8e9971a0f2ac None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:52.187206 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 339/671] 10.222.0.70 () {56 vars in 1109 bytes} [Tue May 10 19:07:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:07:52.188618 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234f9625-15bf-4c57-80ee-8e9971a0f2ac None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:52.236559 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 333/672] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:07:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 19:07:52.238101 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7267bde2-f985-4b15-948e-b523f069ad23 None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:52.308923 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234f9625-15bf-4c57-80ee-8e9971a0f2ac None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:52.344751 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea93cf1-ae88-4b81-a02b-dbe007882ef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:52.345632 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea93cf1-ae88-4b81-a02b-dbe007882ef9 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:52.345743 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea93cf1-ae88-4b81-a02b-dbe007882ef9 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:52.346006 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea93cf1-ae88-4b81-a02b-dbe007882ef9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:52.353363 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea93cf1-ae88-4b81-a02b-dbe007882ef9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:52.354778 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea93cf1-ae88-4b81-a02b-dbe007882ef9 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:52.366229 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7267bde2-f985-4b15-948e-b523f069ad23 None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:52.369185 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-4ea93cf1-ae88-4b81-a02b-dbe007882ef9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 19:07:52.369185 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:07:52.369185 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:07:52.369185 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:07:52.369185 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:07:52.369185 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:07:52.369185 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:07:52.369185 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:07:52.369185 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:07:52.369185 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:07:52.369185 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:07:52.369185 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:07:52.369185 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 19:07:52.369185 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 19:07:52.369185 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 19:07:52.370064 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 19:07:52.370064 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:07:52.370064 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:07:52.370064 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:07:52.370064 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:07:52.370064 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:07:52.370064 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:07:52.370064 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:07:52.370064 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( May 10 19:07:52.370064 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:07:52.370064 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() May 10 19:07:52.370064 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:07:52.370064 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:07:52.370064 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:07:52.370064 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() May 10 19:07:52.370064 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:07:52.370064 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( May 10 19:07:52.370988 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 19:07:52.370988 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 19:07:52.370988 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 19:07:52.370988 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 19:07:52.370988 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 19:07:52.370988 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 19:07:52.370988 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 19:07:52.370988 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:07:52.370988 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 340/673] 10.222.0.70 () {56 vars in 1111 bytes} [Tue May 10 19:07:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:07:52.371575 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea93cf1-ae88-4b81-a02b-dbe007882ef9 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:52.412910 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33d5442-f3d0-4cbe-8c18-f702d9fb5222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:52.413991 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33d5442-f3d0-4cbe-8c18-f702d9fb5222 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:52.414441 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33d5442-f3d0-4cbe-8c18-f702d9fb5222 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:52.414859 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33d5442-f3d0-4cbe-8c18-f702d9fb5222 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:52.423852 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33d5442-f3d0-4cbe-8c18-f702d9fb5222 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:52.426025 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33d5442-f3d0-4cbe-8c18-f702d9fb5222 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:52.444120 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application [None req-f33d5442-f3d0-4cbe-8c18-f702d9fb5222 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 19:07:52.444120 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:07:52.444120 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:07:52.444120 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:07:52.444120 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:07:52.444120 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:07:52.444120 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:07:52.444120 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:07:52.444120 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:07:52.444120 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:07:52.444120 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:07:52.444120 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:07:52.444120 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 19:07:52.444120 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 19:07:52.444120 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 19:07:52.445154 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 19:07:52.445154 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:07:52.445154 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:07:52.445154 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:07:52.445154 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:07:52.445154 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:07:52.445154 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:07:52.445154 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:07:52.445154 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application with Lock( May 10 19:07:52.445154 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:07:52.445154 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._enter() May 10 19:07:52.445154 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:07:52.445154 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:07:52.445154 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:07:52.445154 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.creator() May 10 19:07:52.445154 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:07:52.445154 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application created_value = creator( May 10 19:07:52.446058 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 19:07:52.446058 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 19:07:52.446058 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 19:07:52.446058 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 19:07:52.446058 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 19:07:52.446058 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 19:07:52.446058 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 19:07:52.446058 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application May 10 19:07:52.446058 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 334/674] 10.222.0.70 () {56 vars in 1111 bytes} [Tue May 10 19:07:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:07:52.447725 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33d5442-f3d0-4cbe-8c18-f702d9fb5222 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:52.476677 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea93cf1-ae88-4b81-a02b-dbe007882ef9 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:52.511302 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d693a001-59a3-4af7-93e3-8909fcdaa269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:52.512098 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d693a001-59a3-4af7-93e3-8909fcdaa269 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:52.512380 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d693a001-59a3-4af7-93e3-8909fcdaa269 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:52.512678 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d693a001-59a3-4af7-93e3-8909fcdaa269 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:52.523107 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d693a001-59a3-4af7-93e3-8909fcdaa269 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:07:52.530666 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-d693a001-59a3-4af7-93e3-8909fcdaa269 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 19:07:52.530666 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:07:52.530666 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:07:52.530666 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:07:52.530666 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:07:52.530666 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:07:52.530666 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:07:52.530666 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:07:52.530666 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:07:52.530666 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:07:52.530666 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:07:52.530666 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:07:52.530666 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:07:52.530666 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:07:52.530666 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:07:52.530666 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:07:52.531596 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:07:52.531596 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:07:52.531596 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:07:52.531596 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:07:52.531596 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:07:52.531596 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:07:52.531596 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:07:52.531596 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:07:52.531596 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:07:52.531596 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:07:52.531596 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:07:52.531596 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( May 10 19:07:52.531596 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:07:52.531596 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() May 10 19:07:52.531596 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:07:52.531596 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:07:52.532473 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:07:52.532473 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() May 10 19:07:52.532473 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:07:52.532473 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( May 10 19:07:52.532473 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:07:52.532473 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:07:52.532473 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:07:52.532473 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:07:52.532473 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:07:52.532473 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:07:52.532473 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 19:07:52.532473 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:07:52.532473 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 341/675] 10.222.0.70 () {56 vars in 1096 bytes} [Tue May 10 19:07:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:07:52.533187 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d693a001-59a3-4af7-93e3-8909fcdaa269 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:52.564050 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33d5442-f3d0-4cbe-8c18-f702d9fb5222 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:52.598513 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca046b6-e8ce-4695-9fb4-685c4ad4f08e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:52.599100 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca046b6-e8ce-4695-9fb4-685c4ad4f08e None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:52.599384 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca046b6-e8ce-4695-9fb4-685c4ad4f08e None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:52.599660 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca046b6-e8ce-4695-9fb4-685c4ad4f08e None admin] PATH_INFO: `/v3/projects` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:52.600460 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca046b6-e8ce-4695-9fb4-685c4ad4f08e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:07:52.600762 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca046b6-e8ce-4695-9fb4-685c4ad4f08e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:52.602194 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca046b6-e8ce-4695-9fb4-685c4ad4f08e None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:52.624819 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 335/676] 10.222.0.70 () {56 vars in 1148 bytes} [Tue May 10 19:07:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:07:52.626178 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0580e6f2-ae08-4836-8807-982108d41ff0 None None] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:52.626463 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0580e6f2-ae08-4836-8807-982108d41ff0 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:52.626736 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0580e6f2-ae08-4836-8807-982108d41ff0 None None] PATH_INFO: `/` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:52.628102 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 336/677] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:07:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:07:52.632470 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0580e6f2-ae08-4836-8807-982108d41ff0 None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:52.634860 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d693a001-59a3-4af7-93e3-8909fcdaa269 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:52.667566 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d1cf6b-a3f8-43ea-92e5-bb57614212c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:52.668224 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d1cf6b-a3f8-43ea-92e5-bb57614212c5 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:52.668531 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d1cf6b-a3f8-43ea-92e5-bb57614212c5 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:52.668804 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d1cf6b-a3f8-43ea-92e5-bb57614212c5 None admin] PATH_INFO: `/v3/projects` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:52.669576 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d1cf6b-a3f8-43ea-92e5-bb57614212c5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:07:52.669877 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d1cf6b-a3f8-43ea-92e5-bb57614212c5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:52.671297 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d1cf6b-a3f8-43ea-92e5-bb57614212c5 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:52.688623 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 342/678] 10.222.0.70 () {56 vars in 1148 bytes} [Tue May 10 19:07:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:07:52.688623 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d1cf6b-a3f8-43ea-92e5-bb57614212c5 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:52.731000 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0580e6f2-ae08-4836-8807-982108d41ff0 None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:52.765052 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0dee1f-2439-45ec-866b-3fd3d1ab8518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:52.765771 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0dee1f-2439-45ec-866b-3fd3d1ab8518 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:52.766057 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0dee1f-2439-45ec-866b-3fd3d1ab8518 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:52.766392 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0dee1f-2439-45ec-866b-3fd3d1ab8518 None admin] PATH_INFO: `/v3/roles` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:52.767129 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0dee1f-2439-45ec-866b-3fd3d1ab8518 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:07:52.767435 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0dee1f-2439-45ec-866b-3fd3d1ab8518 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:52.768875 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0dee1f-2439-45ec-866b-3fd3d1ab8518 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:52.781572 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 337/679] 10.222.0.70 () {56 vars in 1099 bytes} [Tue May 10 19:07:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:07:52.782995 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cba41e-2d03-4ee8-afa2-485c6b034167 None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:52.783289 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cba41e-2d03-4ee8-afa2-485c6b034167 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:52.783572 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cba41e-2d03-4ee8-afa2-485c6b034167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:52.788394 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d1cf6b-a3f8-43ea-92e5-bb57614212c5 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:52.800434 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-11cba41e-2d03-4ee8-afa2-485c6b034167 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:07:52.801621 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-11cba41e-2d03-4ee8-afa2-485c6b034167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:07:52.823102 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df77b1f4-1841-4e10-90c4-1705e6945f08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:52.823780 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df77b1f4-1841-4e10-90c4-1705e6945f08 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:52.824058 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df77b1f4-1841-4e10-90c4-1705e6945f08 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:52.824336 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df77b1f4-1841-4e10-90c4-1705e6945f08 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:52.825186 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df77b1f4-1841-4e10-90c4-1705e6945f08 None admin] RBAC: Adding query filter params (role.id=445805bec1e741c9b823495ae6e364f0, scope.project.id=2ee9ec5b515440fe9b39aedf3e339c79, user.id=15df2a8967aa43299c10e365f4200d37) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:07:52.825496 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df77b1f4-1841-4e10-90c4-1705e6945f08 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:52.826922 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df77b1f4-1841-4e10-90c4-1705e6945f08 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:52.840452 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 343/680] 10.222.0.70 () {56 vars in 1374 bytes} [Tue May 10 19:07:52 2022] GET /identity/v3/role_assignments?user.id=15df2a8967aa43299c10e365f4200d37&scope.project.id=2ee9ec5b515440fe9b39aedf3e339c79&role.id=445805bec1e741c9b823495ae6e364f0 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:07:52.840452 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df77b1f4-1841-4e10-90c4-1705e6945f08 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:52.888663 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 338/681] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:07:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 19:07:52.889491 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cba41e-2d03-4ee8-afa2-485c6b034167 None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:52.976512 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df77b1f4-1841-4e10-90c4-1705e6945f08 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:53.012856 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e3bc5b-e6ef-4001-8f27-4afa845c4cd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:53.014152 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e3bc5b-e6ef-4001-8f27-4afa845c4cd2 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:53.014593 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e3bc5b-e6ef-4001-8f27-4afa845c4cd2 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:53.015192 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e3bc5b-e6ef-4001-8f27-4afa845c4cd2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:53.016738 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e3bc5b-e6ef-4001-8f27-4afa845c4cd2 None admin] RBAC: Adding query filter params (role.id=445805bec1e741c9b823495ae6e364f0, scope.project.id=2ee9ec5b515440fe9b39aedf3e339c79, user.id=91f1dc79540b48c0866478cc48cd8205) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:07:53.017227 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e3bc5b-e6ef-4001-8f27-4afa845c4cd2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:53.019341 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e3bc5b-e6ef-4001-8f27-4afa845c4cd2 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:53.028275 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 344/682] 10.222.0.70 () {56 vars in 1374 bytes} [Tue May 10 19:07:52 2022] GET /identity/v3/role_assignments?user.id=91f1dc79540b48c0866478cc48cd8205&scope.project.id=2ee9ec5b515440fe9b39aedf3e339c79&role.id=445805bec1e741c9b823495ae6e364f0 => generated 608 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:07:53.029406 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e3bc5b-e6ef-4001-8f27-4afa845c4cd2 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:53.051381 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cba41e-2d03-4ee8-afa2-485c6b034167 None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:53.097191 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe72c5e-1c3b-471d-891e-4da581c074e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:53.098825 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe72c5e-1c3b-471d-891e-4da581c074e1 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:53.099327 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe72c5e-1c3b-471d-891e-4da581c074e1 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:53.099830 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe72c5e-1c3b-471d-891e-4da581c074e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:53.115023 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe72c5e-1c3b-471d-891e-4da581c074e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:53.117417 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe72c5e-1c3b-471d-891e-4da581c074e1 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:53.142632 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application [None req-1fe72c5e-1c3b-471d-891e-4da581c074e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:07:53.142632 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:07:53.142632 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:07:53.142632 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:07:53.142632 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:07:53.142632 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:07:53.142632 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:07:53.142632 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:07:53.142632 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:07:53.142632 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:07:53.142632 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:07:53.142632 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:07:53.142632 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 19:07:53.142632 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 19:07:53.142632 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 19:07:53.143664 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 19:07:53.143664 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:07:53.143664 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:07:53.143664 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:07:53.143664 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:07:53.143664 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:07:53.143664 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:07:53.143664 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:07:53.143664 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application with Lock( May 10 19:07:53.143664 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:07:53.143664 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._enter() May 10 19:07:53.143664 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:07:53.143664 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:07:53.143664 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:07:53.143664 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.creator() May 10 19:07:53.143664 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:07:53.143664 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application created_value = creator( May 10 19:07:53.144603 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 19:07:53.144603 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 19:07:53.144603 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:07:53.144603 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application May 10 19:07:53.147397 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 339/683] 10.222.0.70 () {56 vars in 1108 bytes} [Tue May 10 19:07:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:07:53.155590 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe72c5e-1c3b-471d-891e-4da581c074e1 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:53.163786 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e3bc5b-e6ef-4001-8f27-4afa845c4cd2 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:53.206710 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4710c071-2bbf-4967-b810-7f6117349473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:53.208232 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4710c071-2bbf-4967-b810-7f6117349473 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:53.209363 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4710c071-2bbf-4967-b810-7f6117349473 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:53.209877 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4710c071-2bbf-4967-b810-7f6117349473 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:53.226714 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4710c071-2bbf-4967-b810-7f6117349473 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:07:53.235515 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-4710c071-2bbf-4967-b810-7f6117349473 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 19:07:53.235515 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:07:53.235515 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:07:53.235515 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:07:53.235515 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:07:53.235515 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:07:53.235515 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:07:53.235515 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:07:53.235515 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:07:53.235515 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:07:53.235515 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:07:53.235515 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:07:53.235515 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:07:53.235515 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:07:53.235515 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:07:53.235515 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:07:53.236595 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:07:53.236595 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:07:53.236595 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:07:53.236595 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:07:53.236595 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:07:53.236595 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:07:53.236595 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:07:53.236595 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:07:53.236595 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:07:53.236595 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:07:53.236595 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:07:53.236595 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( May 10 19:07:53.236595 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:07:53.236595 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() May 10 19:07:53.236595 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:07:53.236595 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:07:53.237967 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:07:53.237967 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() May 10 19:07:53.237967 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:07:53.237967 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( May 10 19:07:53.237967 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:07:53.237967 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:07:53.237967 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:07:53.237967 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:07:53.237967 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:07:53.237967 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:07:53.237967 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 19:07:53.237967 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:07:53.237967 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 345/684] 10.222.0.70 () {56 vars in 1102 bytes} [Tue May 10 19:07:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:07:53.244681 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4710c071-2bbf-4967-b810-7f6117349473 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:53.291575 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe72c5e-1c3b-471d-891e-4da581c074e1 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:53.333144 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d907e726-b01c-4032-9139-b0af9dffa32c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:53.333818 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d907e726-b01c-4032-9139-b0af9dffa32c None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:53.334105 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d907e726-b01c-4032-9139-b0af9dffa32c None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:53.334382 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d907e726-b01c-4032-9139-b0af9dffa32c None admin] PATH_INFO: `/v3/domains` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:53.335105 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d907e726-b01c-4032-9139-b0af9dffa32c None admin] RBAC: Adding query filter params (name=Default) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:07:53.335411 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d907e726-b01c-4032-9139-b0af9dffa32c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:53.336827 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d907e726-b01c-4032-9139-b0af9dffa32c None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:53.350237 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 340/685] 10.222.0.70 () {56 vars in 1109 bytes} [Tue May 10 19:07:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:07:53.356506 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d907e726-b01c-4032-9139-b0af9dffa32c None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:53.366601 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4710c071-2bbf-4967-b810-7f6117349473 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:53.408935 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d757f4-d17f-440d-87d7-7b4606b628a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:53.409889 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d757f4-d17f-440d-87d7-7b4606b628a6 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:53.410173 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d757f4-d17f-440d-87d7-7b4606b628a6 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:53.410445 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d757f4-d17f-440d-87d7-7b4606b628a6 None admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:53.411509 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d757f4-d17f-440d-87d7-7b4606b628a6 None admin] RBAC: Adding query filter params (name=service) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:07:53.412117 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d757f4-d17f-440d-87d7-7b4606b628a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:53.413772 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d757f4-d17f-440d-87d7-7b4606b628a6 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:53.425634 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 346/686] 10.222.0.70 () {56 vars in 1103 bytes} [Tue May 10 19:07:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:07:53.433407 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d757f4-d17f-440d-87d7-7b4606b628a6 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:53.484442 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d907e726-b01c-4032-9139-b0af9dffa32c None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:53.524807 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d7b0e0-25f1-47a1-8230-2d3c3fa3bda3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:53.525610 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d7b0e0-25f1-47a1-8230-2d3c3fa3bda3 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:53.525895 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d7b0e0-25f1-47a1-8230-2d3c3fa3bda3 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:53.526170 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d7b0e0-25f1-47a1-8230-2d3c3fa3bda3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:53.534644 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d7b0e0-25f1-47a1-8230-2d3c3fa3bda3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:53.536087 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d7b0e0-25f1-47a1-8230-2d3c3fa3bda3 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:53.552090 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application [None req-d2d7b0e0-25f1-47a1-8230-2d3c3fa3bda3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 10 19:07:53.552090 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:07:53.552090 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:07:53.552090 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:07:53.552090 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:07:53.552090 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:07:53.552090 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:07:53.552090 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:07:53.552090 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:07:53.552090 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:07:53.552090 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:07:53.552090 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:07:53.552090 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 19:07:53.552090 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 19:07:53.552090 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 19:07:53.552090 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 19:07:53.554317 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:07:53.554317 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:07:53.554317 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 19:07:53.554317 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 19:07:53.554317 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 19:07:53.554317 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 19:07:53.554317 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:07:53.554317 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:07:53.554317 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:07:53.554317 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:07:53.554317 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:07:53.554317 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application with Lock( May 10 19:07:53.554317 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:07:53.554317 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._enter() May 10 19:07:53.554317 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:07:53.554317 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:07:53.554317 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:07:53.554317 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.creator() May 10 19:07:53.556591 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:07:53.556591 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application created_value = creator( May 10 19:07:53.556591 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 19:07:53.556591 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 19:07:53.556591 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 19:07:53.556591 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 19:07:53.556591 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 19:07:53.556591 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 19:07:53.556591 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 10 19:07:53.556591 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application May 10 19:07:53.556591 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 341/687] 10.222.0.70 () {56 vars in 1093 bytes} [Tue May 10 19:07:53 2022] GET /identity/v3/users/nova => generated 82 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:07:53.561739 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d7b0e0-25f1-47a1-8230-2d3c3fa3bda3 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:53.581458 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d757f4-d17f-440d-87d7-7b4606b628a6 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:53.633364 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04d862d-a665-4188-933e-11aa4a151d17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:53.634515 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04d862d-a665-4188-933e-11aa4a151d17 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:53.635025 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04d862d-a665-4188-933e-11aa4a151d17 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:53.635496 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04d862d-a665-4188-933e-11aa4a151d17 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:53.646944 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04d862d-a665-4188-933e-11aa4a151d17 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:53.648733 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04d862d-a665-4188-933e-11aa4a151d17 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:53.667542 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d7b0e0-25f1-47a1-8230-2d3c3fa3bda3 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:53.668710 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-f04d862d-a665-4188-933e-11aa4a151d17 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:07:53.668710 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:07:53.668710 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:07:53.668710 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:07:53.668710 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:07:53.668710 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:07:53.668710 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:07:53.668710 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:07:53.668710 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:07:53.668710 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:07:53.668710 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:07:53.668710 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:07:53.668710 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 19:07:53.668710 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 19:07:53.668710 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 19:07:53.669688 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 19:07:53.669688 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:07:53.669688 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:07:53.669688 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:07:53.669688 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:07:53.669688 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:07:53.669688 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:07:53.669688 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:07:53.669688 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( May 10 19:07:53.669688 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:07:53.669688 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() May 10 19:07:53.669688 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:07:53.669688 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:07:53.669688 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:07:53.669688 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() May 10 19:07:53.669688 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:07:53.669688 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( May 10 19:07:53.670598 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 19:07:53.670598 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 19:07:53.670598 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:07:53.670598 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:07:53.673013 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 347/688] 10.222.0.70 () {56 vars in 1108 bytes} [Tue May 10 19:07:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:07:53.681369 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04d862d-a665-4188-933e-11aa4a151d17 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:53.747062 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059232f5-34a6-4648-983a-f8d5fdd692cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:53.748091 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059232f5-34a6-4648-983a-f8d5fdd692cd None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:53.748616 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059232f5-34a6-4648-983a-f8d5fdd692cd None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:53.749115 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059232f5-34a6-4648-983a-f8d5fdd692cd None admin] PATH_INFO: `/v3/users` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:53.750143 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059232f5-34a6-4648-983a-f8d5fdd692cd None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:07:53.750649 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059232f5-34a6-4648-983a-f8d5fdd692cd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:53.752291 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059232f5-34a6-4648-983a-f8d5fdd692cd None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:53.770865 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 342/689] 10.222.0.70 () {56 vars in 1133 bytes} [Tue May 10 19:07:53 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:07:53.781384 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059232f5-34a6-4648-983a-f8d5fdd692cd None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:53.783295 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04d862d-a665-4188-933e-11aa4a151d17 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:53.849152 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d20594-8db7-448e-8a4c-a7a77bcec331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:53.849835 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d20594-8db7-448e-8a4c-a7a77bcec331 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:53.850119 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d20594-8db7-448e-8a4c-a7a77bcec331 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:53.850391 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d20594-8db7-448e-8a4c-a7a77bcec331 None admin] PATH_INFO: `/v3/domains` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:53.851264 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d20594-8db7-448e-8a4c-a7a77bcec331 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:07:53.851442 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d20594-8db7-448e-8a4c-a7a77bcec331 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:53.852816 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d20594-8db7-448e-8a4c-a7a77bcec331 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:53.879494 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 348/690] 10.222.0.70 () {56 vars in 1109 bytes} [Tue May 10 19:07:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:07:53.884794 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d20594-8db7-448e-8a4c-a7a77bcec331 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:53.892668 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059232f5-34a6-4648-983a-f8d5fdd692cd None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:53.929508 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59db305b-2a3d-46f0-91d3-5c24eb7e6804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:53.930669 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59db305b-2a3d-46f0-91d3-5c24eb7e6804 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:53.930954 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59db305b-2a3d-46f0-91d3-5c24eb7e6804 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:53.931226 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59db305b-2a3d-46f0-91d3-5c24eb7e6804 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:54.011530 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d20594-8db7-448e-8a4c-a7a77bcec331 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:54.049406 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db29e80-0f4c-4e83-b9a8-0f8cf505bf0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:54.050744 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db29e80-0f4c-4e83-b9a8-0f8cf505bf0b None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:54.051024 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db29e80-0f4c-4e83-b9a8-0f8cf505bf0b None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:54.051292 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db29e80-0f4c-4e83-b9a8-0f8cf505bf0b None admin] PATH_INFO: `/v3/users/swift` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:54.069288 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db29e80-0f4c-4e83-b9a8-0f8cf505bf0b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:54.070753 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db29e80-0f4c-4e83-b9a8-0f8cf505bf0b None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:54.073595 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59db305b-2a3d-46f0-91d3-5c24eb7e6804 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:54.075106 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59db305b-2a3d-46f0-91d3-5c24eb7e6804 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:54.089544 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-0db29e80-0f4c-4e83-b9a8-0f8cf505bf0b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 10 19:07:54.089544 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:07:54.089544 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:07:54.089544 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:07:54.089544 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:07:54.089544 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:07:54.089544 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:07:54.089544 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:07:54.089544 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:07:54.089544 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:07:54.089544 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:07:54.089544 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:07:54.089544 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 19:07:54.089544 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 19:07:54.089544 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 19:07:54.089544 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 19:07:54.090579 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:07:54.090579 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:07:54.090579 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 19:07:54.090579 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 19:07:54.090579 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 19:07:54.090579 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 19:07:54.090579 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:07:54.090579 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:07:54.090579 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:07:54.090579 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:07:54.090579 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:07:54.090579 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( May 10 19:07:54.090579 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:07:54.090579 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() May 10 19:07:54.090579 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:07:54.090579 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:07:54.090579 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:07:54.090579 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() May 10 19:07:54.091589 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:07:54.091589 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( May 10 19:07:54.091589 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 19:07:54.091589 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 19:07:54.091589 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 19:07:54.091589 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 19:07:54.091589 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 19:07:54.091589 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 19:07:54.091589 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 10 19:07:54.091589 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:07:54.100909 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 349/691] 10.222.0.70 () {56 vars in 1096 bytes} [Tue May 10 19:07:53 2022] GET /identity/v3/users/swift => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 19:07:54.105932 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db29e80-0f4c-4e83-b9a8-0f8cf505bf0b None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:54.202359 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 343/692] 10.222.0.70 () {58 vars in 1282 bytes} [Tue May 10 19:07:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 19:07:54.203632 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59db305b-2a3d-46f0-91d3-5c24eb7e6804 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:54.295160 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db29e80-0f4c-4e83-b9a8-0f8cf505bf0b None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:54.358990 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59db305b-2a3d-46f0-91d3-5c24eb7e6804 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:54.368245 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa8f944-7136-40d2-b07e-52aecf44d692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:54.368952 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa8f944-7136-40d2-b07e-52aecf44d692 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:54.369233 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa8f944-7136-40d2-b07e-52aecf44d692 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:54.369506 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa8f944-7136-40d2-b07e-52aecf44d692 None admin] PATH_INFO: `/v3/users` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:54.370341 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa8f944-7136-40d2-b07e-52aecf44d692 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:07:54.370646 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa8f944-7136-40d2-b07e-52aecf44d692 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:54.372087 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa8f944-7136-40d2-b07e-52aecf44d692 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:54.399316 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 350/693] 10.222.0.70 () {56 vars in 1135 bytes} [Tue May 10 19:07:54 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:07:54.401678 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa8f944-7136-40d2-b07e-52aecf44d692 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:54.426446 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59094a5c-d241-4a79-9c58-06ab4a24560b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:54.427261 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59094a5c-d241-4a79-9c58-06ab4a24560b None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:54.427541 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59094a5c-d241-4a79-9c58-06ab4a24560b None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:54.427815 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59094a5c-d241-4a79-9c58-06ab4a24560b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:54.446469 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59094a5c-d241-4a79-9c58-06ab4a24560b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:54.447937 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59094a5c-d241-4a79-9c58-06ab4a24560b None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:54.480154 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application [None req-59094a5c-d241-4a79-9c58-06ab4a24560b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:07:54.480154 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:07:54.480154 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:07:54.480154 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:07:54.480154 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:07:54.480154 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:07:54.480154 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:07:54.480154 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:07:54.480154 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:07:54.480154 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:07:54.480154 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:07:54.480154 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:07:54.480154 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 19:07:54.480154 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 19:07:54.480154 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 19:07:54.481135 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 19:07:54.481135 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:07:54.481135 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:07:54.481135 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:07:54.481135 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:07:54.481135 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:07:54.481135 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:07:54.481135 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:07:54.481135 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application with Lock( May 10 19:07:54.481135 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:07:54.481135 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._enter() May 10 19:07:54.481135 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:07:54.481135 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:07:54.481135 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:07:54.481135 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.creator() May 10 19:07:54.481135 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:07:54.481135 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application created_value = creator( May 10 19:07:54.482050 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 19:07:54.482050 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 19:07:54.482050 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:07:54.482050 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application May 10 19:07:54.490888 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 344/694] 10.222.0.70 () {56 vars in 1108 bytes} [Tue May 10 19:07:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:07:54.492446 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482d185a-102e-410c-87c2-29f4932d2379 None None] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:54.494001 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482d185a-102e-410c-87c2-29f4932d2379 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:54.494220 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482d185a-102e-410c-87c2-29f4932d2379 None None] PATH_INFO: `/` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:54.495644 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 345/695] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:07:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:07:54.497408 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482d185a-102e-410c-87c2-29f4932d2379 None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:54.557548 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa8f944-7136-40d2-b07e-52aecf44d692 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:54.595940 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91b6342-bfa5-4548-8ae2-94080ecf22f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:54.600883 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91b6342-bfa5-4548-8ae2-94080ecf22f8 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:54.601180 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91b6342-bfa5-4548-8ae2-94080ecf22f8 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:54.602530 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91b6342-bfa5-4548-8ae2-94080ecf22f8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:54.603358 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482d185a-102e-410c-87c2-29f4932d2379 None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:54.638160 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa9ca94-b956-408a-b173-c77e818798a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:54.638932 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa9ca94-b956-408a-b173-c77e818798a0 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:54.639286 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa9ca94-b956-408a-b173-c77e818798a0 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:54.639626 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa9ca94-b956-408a-b173-c77e818798a0 None admin] PATH_INFO: `/v3/domains` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:54.640443 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa9ca94-b956-408a-b173-c77e818798a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:07:54.640862 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa9ca94-b956-408a-b173-c77e818798a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:54.642397 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa9ca94-b956-408a-b173-c77e818798a0 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:54.654742 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 346/696] 10.222.0.70 () {56 vars in 1109 bytes} [Tue May 10 19:07:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:07:54.656126 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ba4c1b-a60c-4494-90b9-419d57cc2079 None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:54.656507 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ba4c1b-a60c-4494-90b9-419d57cc2079 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:54.656851 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ba4c1b-a60c-4494-90b9-419d57cc2079 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:54.675772 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-a8ba4c1b-a60c-4494-90b9-419d57cc2079 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:07:54.677058 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-a8ba4c1b-a60c-4494-90b9-419d57cc2079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:07:54.679137 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91b6342-bfa5-4548-8ae2-94080ecf22f8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:54.680639 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91b6342-bfa5-4548-8ae2-94080ecf22f8 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:54.764519 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 347/697] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:07:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 19:07:54.764519 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ba4c1b-a60c-4494-90b9-419d57cc2079 None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:54.813124 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 351/698] 10.222.0.70 () {58 vars in 1282 bytes} [Tue May 10 19:07:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 19:07:54.814316 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91b6342-bfa5-4548-8ae2-94080ecf22f8 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:54.883193 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ba4c1b-a60c-4494-90b9-419d57cc2079 None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:54.916211 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd08b036-5494-4f20-a5b6-582835cd6541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:54.917303 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd08b036-5494-4f20-a5b6-582835cd6541 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:54.917585 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd08b036-5494-4f20-a5b6-582835cd6541 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:54.917855 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd08b036-5494-4f20-a5b6-582835cd6541 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:54.926261 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd08b036-5494-4f20-a5b6-582835cd6541 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:54.928279 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd08b036-5494-4f20-a5b6-582835cd6541 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:54.936477 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91b6342-bfa5-4548-8ae2-94080ecf22f8 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:54.946285 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application [None req-fd08b036-5494-4f20-a5b6-582835cd6541 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 19:07:54.946285 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:07:54.946285 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:07:54.946285 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:07:54.946285 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:07:54.946285 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:07:54.946285 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:07:54.946285 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:07:54.946285 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:07:54.946285 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:07:54.946285 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:07:54.946285 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:07:54.946285 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 19:07:54.946285 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 19:07:54.946285 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 19:07:54.947221 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 19:07:54.947221 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:07:54.947221 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:07:54.947221 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:07:54.947221 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:07:54.947221 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:07:54.947221 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:07:54.947221 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:07:54.947221 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application with Lock( May 10 19:07:54.947221 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:07:54.947221 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._enter() May 10 19:07:54.947221 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:07:54.947221 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:07:54.947221 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:07:54.947221 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.creator() May 10 19:07:54.947221 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:07:54.947221 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application created_value = creator( May 10 19:07:54.948245 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 19:07:54.948245 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 19:07:54.948245 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 19:07:54.948245 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 19:07:54.948245 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 19:07:54.948245 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 19:07:54.948245 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 19:07:54.948245 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application May 10 19:07:54.948245 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 348/699] 10.222.0.70 () {56 vars in 1111 bytes} [Tue May 10 19:07:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:07:54.948773 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd08b036-5494-4f20-a5b6-582835cd6541 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:54.989832 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e6ee75-94bd-4ae3-a059-778d4e0f1848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:54.991452 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e6ee75-94bd-4ae3-a059-778d4e0f1848 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:54.992180 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e6ee75-94bd-4ae3-a059-778d4e0f1848 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:54.992706 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e6ee75-94bd-4ae3-a059-778d4e0f1848 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:55.005377 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e6ee75-94bd-4ae3-a059-778d4e0f1848 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:55.007701 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e6ee75-94bd-4ae3-a059-778d4e0f1848 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:55.031424 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-04e6ee75-94bd-4ae3-a059-778d4e0f1848 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:07:55.031424 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:07:55.031424 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:07:55.031424 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:07:55.031424 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:07:55.031424 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:07:55.031424 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:07:55.031424 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:07:55.031424 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:07:55.031424 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:07:55.031424 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:07:55.031424 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:07:55.031424 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 19:07:55.031424 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 19:07:55.031424 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 19:07:55.032787 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 19:07:55.032787 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:07:55.032787 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:07:55.032787 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:07:55.032787 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:07:55.032787 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:07:55.032787 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:07:55.032787 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:07:55.032787 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( May 10 19:07:55.032787 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:07:55.032787 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() May 10 19:07:55.032787 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:07:55.032787 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:07:55.032787 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:07:55.032787 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() May 10 19:07:55.032787 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:07:55.032787 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( May 10 19:07:55.033725 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 19:07:55.033725 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 19:07:55.033725 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:07:55.033725 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:07:55.033725 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 352/700] 10.222.0.70 () {56 vars in 1108 bytes} [Tue May 10 19:07:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:07:55.034092 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e6ee75-94bd-4ae3-a059-778d4e0f1848 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:55.077619 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd08b036-5494-4f20-a5b6-582835cd6541 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:55.117508 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7448ebd-eb05-4afe-bc8d-7293c4b60734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:55.118577 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7448ebd-eb05-4afe-bc8d-7293c4b60734 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:55.118868 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7448ebd-eb05-4afe-bc8d-7293c4b60734 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:55.119137 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7448ebd-eb05-4afe-bc8d-7293c4b60734 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:55.131737 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7448ebd-eb05-4afe-bc8d-7293c4b60734 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:55.133643 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7448ebd-eb05-4afe-bc8d-7293c4b60734 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:55.155755 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application [None req-a7448ebd-eb05-4afe-bc8d-7293c4b60734 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:07:55.155755 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:07:55.155755 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:07:55.155755 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:07:55.155755 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:07:55.155755 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:07:55.155755 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:07:55.155755 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:07:55.155755 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:07:55.155755 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:07:55.155755 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:07:55.155755 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:07:55.155755 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 19:07:55.155755 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 19:07:55.155755 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 19:07:55.156774 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 19:07:55.156774 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:07:55.156774 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:07:55.156774 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:07:55.156774 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:07:55.156774 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:07:55.156774 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:07:55.156774 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:07:55.156774 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application with Lock( May 10 19:07:55.156774 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:07:55.156774 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._enter() May 10 19:07:55.156774 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:07:55.156774 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:07:55.156774 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:07:55.156774 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.creator() May 10 19:07:55.156774 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:07:55.156774 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application created_value = creator( May 10 19:07:55.157699 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 19:07:55.157699 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 19:07:55.157699 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:07:55.157699 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application May 10 19:07:55.160561 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 349/701] 10.222.0.70 () {56 vars in 1108 bytes} [Tue May 10 19:07:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:07:55.161590 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7448ebd-eb05-4afe-bc8d-7293c4b60734 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:55.165365 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e6ee75-94bd-4ae3-a059-778d4e0f1848 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:55.211541 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee6e5ee-28d3-46b5-a777-380efb43bf3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:55.212803 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee6e5ee-28d3-46b5-a777-380efb43bf3b None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:55.213709 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee6e5ee-28d3-46b5-a777-380efb43bf3b None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:55.214466 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee6e5ee-28d3-46b5-a777-380efb43bf3b None admin] PATH_INFO: `/v3/projects` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:55.215603 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee6e5ee-28d3-46b5-a777-380efb43bf3b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:07:55.216099 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee6e5ee-28d3-46b5-a777-380efb43bf3b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:55.218089 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee6e5ee-28d3-46b5-a777-380efb43bf3b None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:55.234680 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 353/702] 10.222.0.70 () {56 vars in 1148 bytes} [Tue May 10 19:07:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:07:55.235792 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee6e5ee-28d3-46b5-a777-380efb43bf3b None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:55.271672 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7448ebd-eb05-4afe-bc8d-7293c4b60734 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:55.305144 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f47fec6-9920-4759-af9e-a69611df1183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:55.305904 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f47fec6-9920-4759-af9e-a69611df1183 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:55.306351 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f47fec6-9920-4759-af9e-a69611df1183 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:55.306621 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f47fec6-9920-4759-af9e-a69611df1183 None admin] PATH_INFO: `/v3/domains` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:55.307545 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f47fec6-9920-4759-af9e-a69611df1183 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:07:55.307915 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f47fec6-9920-4759-af9e-a69611df1183 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:55.309379 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f47fec6-9920-4759-af9e-a69611df1183 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:55.326995 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 350/703] 10.222.0.70 () {56 vars in 1109 bytes} [Tue May 10 19:07:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:07:55.326995 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f47fec6-9920-4759-af9e-a69611df1183 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:55.367827 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee6e5ee-28d3-46b5-a777-380efb43bf3b None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:55.414156 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b972f54-cf3c-485c-ac69-7abcb6870673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:55.415099 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b972f54-cf3c-485c-ac69-7abcb6870673 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:55.415444 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b972f54-cf3c-485c-ac69-7abcb6870673 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:55.415786 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b972f54-cf3c-485c-ac69-7abcb6870673 None admin] PATH_INFO: `/v3/domains` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:55.416803 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b972f54-cf3c-485c-ac69-7abcb6870673 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:07:55.417218 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b972f54-cf3c-485c-ac69-7abcb6870673 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:55.419053 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b972f54-cf3c-485c-ac69-7abcb6870673 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:55.434598 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f47fec6-9920-4759-af9e-a69611df1183 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:55.439778 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 354/704] 10.222.0.70 () {56 vars in 1109 bytes} [Tue May 10 19:07:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:07:55.443346 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b972f54-cf3c-485c-ac69-7abcb6870673 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:55.481252 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8421e3-6a7f-4fc8-85ea-db46e3362c0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:55.481909 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8421e3-6a7f-4fc8-85ea-db46e3362c0a None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:55.482184 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8421e3-6a7f-4fc8-85ea-db46e3362c0a None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:55.482453 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8421e3-6a7f-4fc8-85ea-db46e3362c0a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:55.483280 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8421e3-6a7f-4fc8-85ea-db46e3362c0a None admin] RBAC: Adding query filter params (role.id=634ba284303b4626b5a0402772c68f5c, scope.project.id=2ee9ec5b515440fe9b39aedf3e339c79, user.id=b9f310a468ec4058b3c95356ea60ab4c) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:07:55.483585 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8421e3-6a7f-4fc8-85ea-db46e3362c0a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:55.485068 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8421e3-6a7f-4fc8-85ea-db46e3362c0a None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:55.493732 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 351/705] 10.222.0.70 () {56 vars in 1374 bytes} [Tue May 10 19:07:55 2022] GET /identity/v3/role_assignments?user.id=b9f310a468ec4058b3c95356ea60ab4c&scope.project.id=2ee9ec5b515440fe9b39aedf3e339c79&role.id=634ba284303b4626b5a0402772c68f5c => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:07:55.494815 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8421e3-6a7f-4fc8-85ea-db46e3362c0a None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:55.618017 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b972f54-cf3c-485c-ac69-7abcb6870673 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:55.653593 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8421e3-6a7f-4fc8-85ea-db46e3362c0a None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:55.656012 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02050f7d-5266-4c06-afd6-acb66796a88b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:55.656977 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02050f7d-5266-4c06-afd6-acb66796a88b None admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:55.657473 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02050f7d-5266-4c06-afd6-acb66796a88b None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:55.657972 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02050f7d-5266-4c06-afd6-acb66796a88b None admin] PATH_INFO: `/v3/users` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:55.659481 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02050f7d-5266-4c06-afd6-acb66796a88b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:55.661475 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02050f7d-5266-4c06-afd6-acb66796a88b None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:55.693008 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 355/706] 10.222.0.70 () {60 vars in 1132 bytes} [Tue May 10 19:07:55 2022] POST /identity/v3/users => generated 254 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:07:55.693008 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da95fb6a-c254-4d68-8959-78105ce41dfe None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:55.693008 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da95fb6a-c254-4d68-8959-78105ce41dfe None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:55.693008 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da95fb6a-c254-4d68-8959-78105ce41dfe None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:55.699761 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 356/707] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:07:55 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:07:55.702496 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4343cd3f-a546-4717-8109-25a11f6fdc6e None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:55.702779 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4343cd3f-a546-4717-8109-25a11f6fdc6e None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:55.703056 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4343cd3f-a546-4717-8109-25a11f6fdc6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:55.706642 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c16ad7-bf1a-48c0-a33a-24343af63035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:55.708317 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c16ad7-bf1a-48c0-a33a-24343af63035 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:55.709163 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c16ad7-bf1a-48c0-a33a-24343af63035 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:55.709779 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c16ad7-bf1a-48c0-a33a-24343af63035 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:55.730156 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c16ad7-bf1a-48c0-a33a-24343af63035 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:55.731720 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c16ad7-bf1a-48c0-a33a-24343af63035 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:55.734104 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-4343cd3f-a546-4717-8109-25a11f6fdc6e None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:07:55.735597 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-4343cd3f-a546-4717-8109-25a11f6fdc6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:07:55.750616 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application [None req-a6c16ad7-bf1a-48c0-a33a-24343af63035 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 19:07:55.750616 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:07:55.750616 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:07:55.750616 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:07:55.750616 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:07:55.750616 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:07:55.750616 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:07:55.750616 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:07:55.750616 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:07:55.750616 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:07:55.750616 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:07:55.750616 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:07:55.750616 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 19:07:55.750616 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 19:07:55.750616 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 19:07:55.751626 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 19:07:55.751626 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:07:55.751626 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:07:55.751626 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:07:55.751626 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:07:55.751626 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:07:55.751626 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:07:55.751626 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:07:55.751626 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application with Lock( May 10 19:07:55.751626 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:07:55.751626 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._enter() May 10 19:07:55.751626 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:07:55.751626 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:07:55.751626 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:07:55.751626 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.creator() May 10 19:07:55.751626 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:07:55.751626 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application created_value = creator( May 10 19:07:55.752907 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 19:07:55.752907 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 19:07:55.752907 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 19:07:55.752907 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 19:07:55.752907 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 19:07:55.752907 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 19:07:55.752907 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 19:07:55.752907 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application May 10 19:07:55.756579 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 352/708] 10.222.0.70 () {56 vars in 1111 bytes} [Tue May 10 19:07:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:07:55.759059 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c16ad7-bf1a-48c0-a33a-24343af63035 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:55.848669 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 357/709] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:07:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 19:07:55.850133 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8292cf0b-714a-423e-90b4-a2862fcf310b None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:55.850424 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8292cf0b-714a-423e-90b4-a2862fcf310b None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:55.850698 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8292cf0b-714a-423e-90b4-a2862fcf310b None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:55.852936 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 358/710] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:07:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:07:55.859774 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f7a862-3195-4620-9d9b-d2287af2593c None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:55.860117 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f7a862-3195-4620-9d9b-d2287af2593c None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:55.860323 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f7a862-3195-4620-9d9b-d2287af2593c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:55.885982 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-e1f7a862-3195-4620-9d9b-d2287af2593c None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:07:55.886160 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c16ad7-bf1a-48c0-a33a-24343af63035 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:55.887905 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-e1f7a862-3195-4620-9d9b-d2287af2593c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:07:55.938159 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c5804f-78fd-48bf-9070-4223583ade5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:55.939149 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c5804f-78fd-48bf-9070-4223583ade5f None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:55.939334 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c5804f-78fd-48bf-9070-4223583ade5f None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:55.939622 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c5804f-78fd-48bf-9070-4223583ade5f None admin] PATH_INFO: `/v3/projects` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:55.941372 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c5804f-78fd-48bf-9070-4223583ade5f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:07:55.941500 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c5804f-78fd-48bf-9070-4223583ade5f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:55.944946 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c5804f-78fd-48bf-9070-4223583ade5f None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:55.958580 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 353/711] 10.222.0.70 () {56 vars in 1148 bytes} [Tue May 10 19:07:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:07:55.963370 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c5804f-78fd-48bf-9070-4223583ade5f None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:55.997732 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 359/712] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:07:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 19:07:55.998604 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f7a862-3195-4620-9d9b-d2287af2593c None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:56.087055 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c5804f-78fd-48bf-9070-4223583ade5f None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:56.125823 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f7a862-3195-4620-9d9b-d2287af2593c None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:56.130714 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3ef51d-b60a-498c-bcfe-96e691b422f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:56.131805 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3ef51d-b60a-498c-bcfe-96e691b422f2 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:56.132275 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3ef51d-b60a-498c-bcfe-96e691b422f2 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:56.132755 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3ef51d-b60a-498c-bcfe-96e691b422f2 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:56.133597 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3ef51d-b60a-498c-bcfe-96e691b422f2 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:56.135665 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3ef51d-b60a-498c-bcfe-96e691b422f2 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:56.154181 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application [None req-bc3ef51d-b60a-498c-bcfe-96e691b422f2 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 10 19:07:56.154181 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:07:56.154181 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 19:07:56.154181 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 19:07:56.154181 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 19:07:56.154181 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 19:07:56.154181 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 19:07:56.154181 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 19:07:56.154181 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 10 19:07:56.154181 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application May 10 19:07:56.154181 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 19:07:56.154181 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application May 10 19:07:56.154181 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:07:56.154181 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:07:56.154181 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:07:56.154181 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:07:56.155433 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:07:56.155433 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:07:56.155433 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:07:56.155433 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:07:56.155433 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:07:56.155433 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:07:56.155433 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:07:56.155433 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 19:07:56.155433 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 19:07:56.155433 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 19:07:56.155433 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 19:07:56.155433 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:07:56.155433 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:07:56.155433 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:07:56.155433 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:07:56.155433 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:07:56.156525 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:07:56.156525 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:07:56.156525 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application with Lock( May 10 19:07:56.156525 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:07:56.156525 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._enter() May 10 19:07:56.156525 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:07:56.156525 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:07:56.156525 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:07:56.156525 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.creator() May 10 19:07:56.156525 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:07:56.156525 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application created_value = creator( May 10 19:07:56.156525 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 19:07:56.156525 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 19:07:56.156525 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 10 19:07:56.156525 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application May 10 19:07:56.160272 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 354/713] 10.222.0.70 () {56 vars in 1129 bytes} [Tue May 10 19:07:55 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:07:56.161786 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3ef51d-b60a-498c-bcfe-96e691b422f2 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:56.168002 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb485348-e341-4445-b838-ce2ddd9078fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:56.168888 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb485348-e341-4445-b838-ce2ddd9078fa None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:56.169283 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb485348-e341-4445-b838-ce2ddd9078fa None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:56.169650 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb485348-e341-4445-b838-ce2ddd9078fa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:56.170581 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb485348-e341-4445-b838-ce2ddd9078fa None admin] RBAC: Adding query filter params (role.id=445805bec1e741c9b823495ae6e364f0, scope.project.id=2ee9ec5b515440fe9b39aedf3e339c79, user.id=0454aa03fa31487ea1464b9d0008212c) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:07:56.170986 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb485348-e341-4445-b838-ce2ddd9078fa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:56.172944 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb485348-e341-4445-b838-ce2ddd9078fa None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:56.188447 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 360/714] 10.222.0.70 () {56 vars in 1374 bytes} [Tue May 10 19:07:55 2022] GET /identity/v3/role_assignments?user.id=0454aa03fa31487ea1464b9d0008212c&scope.project.id=2ee9ec5b515440fe9b39aedf3e339c79&role.id=445805bec1e741c9b823495ae6e364f0 => generated 608 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:07:56.188447 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb485348-e341-4445-b838-ce2ddd9078fa None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:56.313547 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3ef51d-b60a-498c-bcfe-96e691b422f2 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:56.351111 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf9fe60-5031-4a13-ac67-2b49072a9fcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:56.351984 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf9fe60-5031-4a13-ac67-2b49072a9fcc None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:56.352264 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf9fe60-5031-4a13-ac67-2b49072a9fcc None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:56.352574 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf9fe60-5031-4a13-ac67-2b49072a9fcc None admin] PATH_INFO: `/v3/services/network` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:56.353231 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf9fe60-5031-4a13-ac67-2b49072a9fcc None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:56.354656 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf9fe60-5031-4a13-ac67-2b49072a9fcc None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:56.368493 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application [None req-aaf9fe60-5031-4a13-ac67-2b49072a9fcc None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 10 19:07:56.368493 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:07:56.368493 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 19:07:56.368493 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 19:07:56.368493 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 19:07:56.368493 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 19:07:56.368493 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 19:07:56.368493 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 19:07:56.368493 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 10 19:07:56.368493 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application May 10 19:07:56.368493 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 19:07:56.368493 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application May 10 19:07:56.368493 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:07:56.368493 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:07:56.368493 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:07:56.368493 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:07:56.368493 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:07:56.369593 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:07:56.369593 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:07:56.369593 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:07:56.369593 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:07:56.369593 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:07:56.369593 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:07:56.369593 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 19:07:56.369593 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 19:07:56.369593 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 19:07:56.369593 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 19:07:56.369593 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:07:56.369593 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:07:56.369593 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:07:56.369593 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:07:56.369593 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:07:56.369593 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:07:56.370479 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:07:56.370479 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application with Lock( May 10 19:07:56.370479 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:07:56.370479 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._enter() May 10 19:07:56.370479 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:07:56.370479 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:07:56.370479 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:07:56.370479 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.creator() May 10 19:07:56.370479 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:07:56.370479 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application created_value = creator( May 10 19:07:56.370479 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 19:07:56.370479 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 19:07:56.370479 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 10 19:07:56.370479 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application May 10 19:07:56.370479 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 355/715] 10.222.0.70 () {56 vars in 1111 bytes} [Tue May 10 19:07:56 2022] GET /identity/v3/services/network => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:07:56.375687 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf9fe60-5031-4a13-ac67-2b49072a9fcc None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:56.459209 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb485348-e341-4445-b838-ce2ddd9078fa None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:56.501031 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a1b57c-976b-4b02-9369-b3e36a0ab228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:56.502538 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a1b57c-976b-4b02-9369-b3e36a0ab228 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:56.502972 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a1b57c-976b-4b02-9369-b3e36a0ab228 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:56.503434 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a1b57c-976b-4b02-9369-b3e36a0ab228 None admin] PATH_INFO: `/v3/services` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:56.504289 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a1b57c-976b-4b02-9369-b3e36a0ab228 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:07:56.504519 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf9fe60-5031-4a13-ac67-2b49072a9fcc None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:56.505268 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a1b57c-976b-4b02-9369-b3e36a0ab228 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:56.507902 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a1b57c-976b-4b02-9369-b3e36a0ab228 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:56.513575 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 361/716] 10.222.0.70 () {56 vars in 1124 bytes} [Tue May 10 19:07:56 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:07:56.519667 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a1b57c-976b-4b02-9369-b3e36a0ab228 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:56.546739 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7fd291-454c-4eae-ac77-e1ecdfc88041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:56.547605 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7fd291-454c-4eae-ac77-e1ecdfc88041 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:56.548247 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7fd291-454c-4eae-ac77-e1ecdfc88041 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:56.548630 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7fd291-454c-4eae-ac77-e1ecdfc88041 None admin] PATH_INFO: `/v3/services` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:56.549691 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7fd291-454c-4eae-ac77-e1ecdfc88041 None admin] RBAC: Adding query filter params (name=network) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:07:56.550061 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7fd291-454c-4eae-ac77-e1ecdfc88041 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:56.552035 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7fd291-454c-4eae-ac77-e1ecdfc88041 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:56.557785 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 356/717] 10.222.0.70 () {56 vars in 1112 bytes} [Tue May 10 19:07:56 2022] GET /identity/v3/services?name=network => generated 124 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:07:56.562806 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7fd291-454c-4eae-ac77-e1ecdfc88041 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:56.635332 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a1b57c-976b-4b02-9369-b3e36a0ab228 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:56.671107 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d80835-99a9-4069-b589-3e2d8d71d05f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:56.672040 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d80835-99a9-4069-b589-3e2d8d71d05f None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:56.672504 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d80835-99a9-4069-b589-3e2d8d71d05f None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:56.672949 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d80835-99a9-4069-b589-3e2d8d71d05f None admin] PATH_INFO: `/v3/services` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:56.673816 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d80835-99a9-4069-b589-3e2d8d71d05f None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:07:56.674267 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d80835-99a9-4069-b589-3e2d8d71d05f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:56.674909 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7fd291-454c-4eae-ac77-e1ecdfc88041 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:56.675972 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d80835-99a9-4069-b589-3e2d8d71d05f None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:56.682214 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 362/718] 10.222.0.70 () {56 vars in 1124 bytes} [Tue May 10 19:07:56 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:07:56.717005 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6d422b-0333-4fa4-a906-2f985d084c50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:56.717715 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6d422b-0333-4fa4-a906-2f985d084c50 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:56.718063 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6d422b-0333-4fa4-a906-2f985d084c50 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:56.718405 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6d422b-0333-4fa4-a906-2f985d084c50 None admin] PATH_INFO: `/v3/services` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:56.719253 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6d422b-0333-4fa4-a906-2f985d084c50 None admin] RBAC: Adding query filter params (type=network) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:07:56.719646 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6d422b-0333-4fa4-a906-2f985d084c50 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:56.721183 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6d422b-0333-4fa4-a906-2f985d084c50 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:56.728112 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 357/719] 10.222.0.70 () {56 vars in 1112 bytes} [Tue May 10 19:07:56 2022] GET /identity/v3/services?type=network => generated 124 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:07:58.113174 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2a93d2-bc78-44a1-af31-cd8ebd1651f1 None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:58.114188 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2a93d2-bc78-44a1-af31-cd8ebd1651f1 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:58.114678 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2a93d2-bc78-44a1-af31-cd8ebd1651f1 None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:58.116526 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 363/720] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:07:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:07:58.121657 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d9205d-f4a1-46f6-98d5-7c15262f9758 None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:58.122068 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d9205d-f4a1-46f6-98d5-7c15262f9758 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:58.122201 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d9205d-f4a1-46f6-98d5-7c15262f9758 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:58.145358 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-f7d9205d-f4a1-46f6-98d5-7c15262f9758 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:07:58.146752 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-f7d9205d-f4a1-46f6-98d5-7c15262f9758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:07:58.214059 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 358/721] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:07:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 19:07:58.248523 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2a93d2-bc78-44a1-af31-cd8ebd1651f1 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:58.373656 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2a93d2-bc78-44a1-af31-cd8ebd1651f1 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:58.415829 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d0155b-7469-452e-9552-436c01a65b94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:58.416654 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d0155b-7469-452e-9552-436c01a65b94 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:58.416936 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d0155b-7469-452e-9552-436c01a65b94 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:58.417210 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d0155b-7469-452e-9552-436c01a65b94 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:58.433144 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d0155b-7469-452e-9552-436c01a65b94 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:07:58.440778 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-43d0155b-7469-452e-9552-436c01a65b94 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 19:07:58.440778 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:07:58.440778 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:07:58.440778 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:07:58.440778 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:07:58.440778 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:07:58.440778 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:07:58.440778 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:07:58.440778 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:07:58.440778 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:07:58.440778 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:07:58.440778 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:07:58.440778 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:07:58.440778 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:07:58.440778 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:07:58.440778 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:07:58.441806 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:07:58.441806 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:07:58.441806 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:07:58.441806 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:07:58.441806 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:07:58.441806 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:07:58.441806 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:07:58.441806 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:07:58.441806 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:07:58.441806 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:07:58.441806 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:07:58.441806 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( May 10 19:07:58.441806 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:07:58.441806 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() May 10 19:07:58.441806 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:07:58.441806 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:07:58.442647 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:07:58.442647 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() May 10 19:07:58.442647 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:07:58.442647 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( May 10 19:07:58.442647 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:07:58.442647 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:07:58.442647 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:07:58.442647 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:07:58.442647 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:07:58.442647 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:07:58.442647 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 19:07:58.442647 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:07:58.442647 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 364/722] 10.222.0.70 () {56 vars in 1096 bytes} [Tue May 10 19:07:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:07:58.445100 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a31e6bf-2326-4faf-9de6-b7ef897172a8 None None] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:58.445636 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a31e6bf-2326-4faf-9de6-b7ef897172a8 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:58.446117 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a31e6bf-2326-4faf-9de6-b7ef897172a8 None None] PATH_INFO: `/` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:58.447442 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d0155b-7469-452e-9552-436c01a65b94 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:58.448233 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 359/723] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:07:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:07:58.453456 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e203eebe-143b-4ce9-a512-3865409abc78 None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:58.454014 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e203eebe-143b-4ce9-a512-3865409abc78 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:58.454476 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e203eebe-143b-4ce9-a512-3865409abc78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:58.482078 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-e203eebe-143b-4ce9-a512-3865409abc78 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:07:58.483180 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-e203eebe-143b-4ce9-a512-3865409abc78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:07:58.546063 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d0155b-7469-452e-9552-436c01a65b94 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:58.585968 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d69bb82-f9fc-4d12-a829-3366238585a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:58.586645 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d69bb82-f9fc-4d12-a829-3366238585a4 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:58.586938 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d69bb82-f9fc-4d12-a829-3366238585a4 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:58.587197 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d69bb82-f9fc-4d12-a829-3366238585a4 None admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:58.588000 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d69bb82-f9fc-4d12-a829-3366238585a4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:07:58.588308 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d69bb82-f9fc-4d12-a829-3366238585a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:58.589706 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d69bb82-f9fc-4d12-a829-3366238585a4 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:58.606119 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 365/724] 10.222.0.70 () {56 vars in 1099 bytes} [Tue May 10 19:07:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:07:58.611393 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d69bb82-f9fc-4d12-a829-3366238585a4 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:58.634518 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 360/725] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:07:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 19:07:58.657754 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e203eebe-143b-4ce9-a512-3865409abc78 None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:58.728108 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d69bb82-f9fc-4d12-a829-3366238585a4 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:58.771025 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb881951-344b-4549-a581-06e471c05be6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:58.771753 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb881951-344b-4549-a581-06e471c05be6 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:58.772030 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb881951-344b-4549-a581-06e471c05be6 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:58.772298 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb881951-344b-4549-a581-06e471c05be6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:58.786753 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb881951-344b-4549-a581-06e471c05be6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:58.788196 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb881951-344b-4549-a581-06e471c05be6 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:58.809503 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-fb881951-344b-4549-a581-06e471c05be6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:07:58.809503 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:07:58.809503 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:07:58.809503 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:07:58.809503 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:07:58.809503 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:07:58.809503 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:07:58.809503 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:07:58.809503 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:07:58.809503 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:07:58.809503 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:07:58.809503 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:07:58.809503 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 19:07:58.809503 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 19:07:58.809503 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 19:07:58.810431 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 19:07:58.810431 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:07:58.810431 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:07:58.810431 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:07:58.810431 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:07:58.810431 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:07:58.810431 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:07:58.810431 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:07:58.810431 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( May 10 19:07:58.810431 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:07:58.810431 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() May 10 19:07:58.810431 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:07:58.810431 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:07:58.810431 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:07:58.810431 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() May 10 19:07:58.810431 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:07:58.810431 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( May 10 19:07:58.811344 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 19:07:58.811344 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 19:07:58.811344 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:07:58.811344 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:07:58.811344 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 366/726] 10.222.0.70 () {56 vars in 1108 bytes} [Tue May 10 19:07:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:07:58.817646 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb881951-344b-4549-a581-06e471c05be6 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:58.876482 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e203eebe-143b-4ce9-a512-3865409abc78 None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:58.911762 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54a8d7b-ce05-461d-835f-c57a0f5266fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:58.912597 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54a8d7b-ce05-461d-835f-c57a0f5266fa None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:58.912881 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54a8d7b-ce05-461d-835f-c57a0f5266fa None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:58.913158 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54a8d7b-ce05-461d-835f-c57a0f5266fa None admin] PATH_INFO: `/v3/roles/service` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:58.924652 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54a8d7b-ce05-461d-835f-c57a0f5266fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:07:58.932766 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application [None req-f54a8d7b-ce05-461d-835f-c57a0f5266fa None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 19:07:58.932766 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:07:58.932766 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:07:58.932766 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:07:58.932766 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:07:58.932766 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:07:58.932766 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:07:58.932766 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:07:58.932766 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:07:58.932766 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:07:58.932766 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:07:58.932766 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:07:58.932766 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:07:58.932766 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:07:58.932766 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:07:58.932766 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:07:58.933711 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:07:58.933711 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:07:58.933711 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:07:58.933711 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:07:58.933711 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:07:58.933711 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:07:58.933711 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:07:58.933711 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:07:58.933711 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:07:58.933711 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:07:58.933711 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:07:58.933711 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application with Lock( May 10 19:07:58.933711 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:07:58.933711 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._enter() May 10 19:07:58.933711 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:07:58.933711 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:07:58.934566 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:07:58.934566 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.creator() May 10 19:07:58.934566 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:07:58.934566 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application created_value = creator( May 10 19:07:58.934566 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:07:58.934566 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:07:58.934566 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:07:58.934566 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:07:58.934566 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:07:58.934566 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:07:58.934566 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 19:07:58.934566 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application May 10 19:07:58.935211 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 361/727] 10.222.0.70 () {56 vars in 1102 bytes} [Tue May 10 19:07:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 19:07:58.945426 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54a8d7b-ce05-461d-835f-c57a0f5266fa None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:59.022670 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb881951-344b-4549-a581-06e471c05be6 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:59.064689 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54a8d7b-ce05-461d-835f-c57a0f5266fa None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:59.099352 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ca2ba8-5e48-42bd-89c1-6a9074ded6d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:59.100294 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ca2ba8-5e48-42bd-89c1-6a9074ded6d8 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:59.100762 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ca2ba8-5e48-42bd-89c1-6a9074ded6d8 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:59.101185 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ca2ba8-5e48-42bd-89c1-6a9074ded6d8 None admin] PATH_INFO: `/v3/roles` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:59.102072 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ca2ba8-5e48-42bd-89c1-6a9074ded6d8 None admin] RBAC: Adding query filter params (name=service) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:07:59.102524 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ca2ba8-5e48-42bd-89c1-6a9074ded6d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:59.104040 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ca2ba8-5e48-42bd-89c1-6a9074ded6d8 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:59.105009 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe042fc-e7ef-4e92-9ef2-c2db59e1e857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:59.105741 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe042fc-e7ef-4e92-9ef2-c2db59e1e857 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:59.106031 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe042fc-e7ef-4e92-9ef2-c2db59e1e857 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:59.106307 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe042fc-e7ef-4e92-9ef2-c2db59e1e857 None admin] PATH_INFO: `/v3/domains` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:59.107029 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe042fc-e7ef-4e92-9ef2-c2db59e1e857 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:07:59.107517 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe042fc-e7ef-4e92-9ef2-c2db59e1e857 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:59.109116 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe042fc-e7ef-4e92-9ef2-c2db59e1e857 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:59.113426 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 362/728] 10.222.0.70 () {56 vars in 1103 bytes} [Tue May 10 19:07:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:07:59.119101 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ca2ba8-5e48-42bd-89c1-6a9074ded6d8 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:59.138732 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 367/729] 10.222.0.70 () {56 vars in 1109 bytes} [Tue May 10 19:07:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:07:59.145498 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe042fc-e7ef-4e92-9ef2-c2db59e1e857 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:59.237177 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ca2ba8-5e48-42bd-89c1-6a9074ded6d8 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:59.271658 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5af45dc-508a-4869-8e59-3da068c2e151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:59.272788 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5af45dc-508a-4869-8e59-3da068c2e151 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:59.273219 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5af45dc-508a-4869-8e59-3da068c2e151 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:59.273653 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5af45dc-508a-4869-8e59-3da068c2e151 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:59.285340 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5af45dc-508a-4869-8e59-3da068c2e151 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:59.287473 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5af45dc-508a-4869-8e59-3da068c2e151 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:59.306442 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application [None req-b5af45dc-508a-4869-8e59-3da068c2e151 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:07:59.306442 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:07:59.306442 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:07:59.306442 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:07:59.306442 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:07:59.306442 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:07:59.306442 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:07:59.306442 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:07:59.306442 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:07:59.306442 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:07:59.306442 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:07:59.306442 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:07:59.306442 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 19:07:59.306442 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 19:07:59.306442 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 19:07:59.307583 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 19:07:59.307583 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:07:59.307583 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:07:59.307583 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:07:59.307583 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:07:59.307583 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:07:59.307583 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:07:59.307583 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:07:59.307583 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application with Lock( May 10 19:07:59.307583 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:07:59.307583 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._enter() May 10 19:07:59.307583 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:07:59.307583 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:07:59.307583 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:07:59.307583 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.creator() May 10 19:07:59.307583 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:07:59.307583 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application created_value = creator( May 10 19:07:59.308706 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 19:07:59.308706 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 19:07:59.308706 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:07:59.308706 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application May 10 19:07:59.310962 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 363/730] 10.222.0.70 () {56 vars in 1108 bytes} [Tue May 10 19:07:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 19:07:59.321007 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5af45dc-508a-4869-8e59-3da068c2e151 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:59.338950 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe042fc-e7ef-4e92-9ef2-c2db59e1e857 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:59.401184 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cc6432-07ef-49a8-8c8d-d7099ccbdf55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:59.402126 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cc6432-07ef-49a8-8c8d-d7099ccbdf55 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:59.402603 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cc6432-07ef-49a8-8c8d-d7099ccbdf55 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:59.402948 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cc6432-07ef-49a8-8c8d-d7099ccbdf55 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:59.412031 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cc6432-07ef-49a8-8c8d-d7099ccbdf55 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:59.414206 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cc6432-07ef-49a8-8c8d-d7099ccbdf55 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:59.421288 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5af45dc-508a-4869-8e59-3da068c2e151 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:59.431715 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-f0cc6432-07ef-49a8-8c8d-d7099ccbdf55 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 10 19:07:59.431715 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:07:59.431715 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:07:59.431715 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:07:59.431715 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:07:59.431715 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:07:59.431715 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:07:59.431715 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:07:59.431715 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:07:59.431715 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:07:59.431715 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:07:59.431715 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:07:59.431715 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 19:07:59.431715 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 19:07:59.431715 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 19:07:59.431715 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 19:07:59.432902 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:07:59.432902 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:07:59.432902 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 19:07:59.432902 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 19:07:59.432902 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 19:07:59.432902 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 19:07:59.432902 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:07:59.432902 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:07:59.432902 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:07:59.432902 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:07:59.432902 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:07:59.432902 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( May 10 19:07:59.432902 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:07:59.432902 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() May 10 19:07:59.432902 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:07:59.432902 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:07:59.432902 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:07:59.432902 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() May 10 19:07:59.433929 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:07:59.433929 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( May 10 19:07:59.433929 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 19:07:59.433929 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 19:07:59.433929 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 19:07:59.433929 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 19:07:59.433929 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 19:07:59.433929 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 19:07:59.433929 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 10 19:07:59.433929 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:07:59.436502 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 368/731] 10.222.0.70 () {56 vars in 1093 bytes} [Tue May 10 19:07:59 2022] GET /identity/v3/users/nova => generated 82 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:07:59.438045 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3e5733-3dd5-4dc6-be56-0cc470c24bfd None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:59.438551 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3e5733-3dd5-4dc6-be56-0cc470c24bfd None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:59.439023 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3e5733-3dd5-4dc6-be56-0cc470c24bfd None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:59.441001 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 369/732] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:07:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:07:59.441897 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3e5733-3dd5-4dc6-be56-0cc470c24bfd None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:59.468898 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfb4709-03df-47be-a75a-6afbd29dfed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:59.469558 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfb4709-03df-47be-a75a-6afbd29dfed0 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:59.469838 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfb4709-03df-47be-a75a-6afbd29dfed0 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:59.470114 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfb4709-03df-47be-a75a-6afbd29dfed0 None admin] PATH_INFO: `/v3/domains` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:59.470818 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfb4709-03df-47be-a75a-6afbd29dfed0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:07:59.471176 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfb4709-03df-47be-a75a-6afbd29dfed0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:59.473086 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfb4709-03df-47be-a75a-6afbd29dfed0 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:59.485053 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 364/733] 10.222.0.70 () {56 vars in 1109 bytes} [Tue May 10 19:07:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:07:59.486242 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fc9358-04c5-4529-8e68-a1ff120375cb None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:59.486525 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fc9358-04c5-4529-8e68-a1ff120375cb None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:59.486825 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fc9358-04c5-4529-8e68-a1ff120375cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:59.503468 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-21fc9358-04c5-4529-8e68-a1ff120375cb None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:07:59.504668 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-21fc9358-04c5-4529-8e68-a1ff120375cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:07:59.545368 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3e5733-3dd5-4dc6-be56-0cc470c24bfd None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:59.572943 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 365/734] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:07:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 19:07:59.574202 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f090a69f-52bd-4373-9fcf-78cafaa4083b None None] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:59.574522 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f090a69f-52bd-4373-9fcf-78cafaa4083b None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:59.574801 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f090a69f-52bd-4373-9fcf-78cafaa4083b None None] PATH_INFO: `/` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:59.581071 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 366/735] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:07:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:07:59.581071 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f090a69f-52bd-4373-9fcf-78cafaa4083b None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:59.593805 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6b7955-ed6b-4e02-8622-724ec4218c59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:59.594819 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6b7955-ed6b-4e02-8622-724ec4218c59 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:59.595107 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6b7955-ed6b-4e02-8622-724ec4218c59 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:59.595380 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6b7955-ed6b-4e02-8622-724ec4218c59 None admin] PATH_INFO: `/v3/users` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:59.596258 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6b7955-ed6b-4e02-8622-724ec4218c59 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:07:59.596591 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6b7955-ed6b-4e02-8622-724ec4218c59 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:59.598024 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6b7955-ed6b-4e02-8622-724ec4218c59 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:59.620447 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 370/736] 10.222.0.70 () {56 vars in 1133 bytes} [Tue May 10 19:07:59 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:07:59.620447 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13d04a6-64c0-4621-a6ed-32f7a4d4d5b9 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:59.620447 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13d04a6-64c0-4621-a6ed-32f7a4d4d5b9 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:59.620447 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13d04a6-64c0-4621-a6ed-32f7a4d4d5b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:59.639687 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-f13d04a6-64c0-4621-a6ed-32f7a4d4d5b9 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:07:59.641175 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-f13d04a6-64c0-4621-a6ed-32f7a4d4d5b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:07:59.692340 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f090a69f-52bd-4373-9fcf-78cafaa4083b None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:59.709908 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 371/737] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:07:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 19:07:59.710967 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13d04a6-64c0-4621-a6ed-32f7a4d4d5b9 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:59.724977 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e46a2d0-36be-46c9-a5e9-c41cd874da28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:59.725796 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e46a2d0-36be-46c9-a5e9-c41cd874da28 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:59.726079 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e46a2d0-36be-46c9-a5e9-c41cd874da28 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:59.726358 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e46a2d0-36be-46c9-a5e9-c41cd874da28 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:59.733852 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e46a2d0-36be-46c9-a5e9-c41cd874da28 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:59.735318 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e46a2d0-36be-46c9-a5e9-c41cd874da28 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:59.758234 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application [None req-3e46a2d0-36be-46c9-a5e9-c41cd874da28 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 10 19:07:59.758234 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:07:59.758234 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:07:59.758234 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:07:59.758234 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:07:59.758234 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:07:59.758234 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:07:59.758234 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:07:59.758234 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:07:59.758234 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:07:59.758234 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:07:59.758234 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:07:59.758234 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 19:07:59.758234 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 19:07:59.758234 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 19:07:59.758234 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 19:07:59.759308 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:07:59.759308 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:07:59.759308 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 19:07:59.759308 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 19:07:59.759308 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 19:07:59.759308 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 19:07:59.759308 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:07:59.759308 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:07:59.759308 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:07:59.759308 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:07:59.759308 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:07:59.759308 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application with Lock( May 10 19:07:59.759308 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:07:59.759308 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._enter() May 10 19:07:59.759308 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:07:59.759308 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:07:59.759308 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:07:59.759308 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.creator() May 10 19:07:59.760303 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:07:59.760303 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application created_value = creator( May 10 19:07:59.760303 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 19:07:59.760303 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 19:07:59.760303 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 19:07:59.760303 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 19:07:59.760303 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 19:07:59.760303 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 19:07:59.760303 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 10 19:07:59.760303 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application May 10 19:07:59.760303 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 367/738] 10.222.0.70 () {56 vars in 1117 bytes} [Tue May 10 19:07:59 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:07:59.760957 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e46a2d0-36be-46c9-a5e9-c41cd874da28 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:59.813253 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13d04a6-64c0-4621-a6ed-32f7a4d4d5b9 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:59.845486 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f8ce00-51ac-49b1-8235-107df05a3813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:59.846769 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f8ce00-51ac-49b1-8235-107df05a3813 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:59.847046 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f8ce00-51ac-49b1-8235-107df05a3813 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:59.847323 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f8ce00-51ac-49b1-8235-107df05a3813 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:59.854497 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e46a2d0-36be-46c9-a5e9-c41cd874da28 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:07:59.856839 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f8ce00-51ac-49b1-8235-107df05a3813 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:07:59.864315 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-48f8ce00-51ac-49b1-8235-107df05a3813 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 19:07:59.864315 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:07:59.864315 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:07:59.864315 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:07:59.864315 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:07:59.864315 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:07:59.864315 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:07:59.864315 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:07:59.864315 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:07:59.864315 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:07:59.864315 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:07:59.864315 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:07:59.864315 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:07:59.864315 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:07:59.864315 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:07:59.864315 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:07:59.865356 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:07:59.865356 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:07:59.865356 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:07:59.865356 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:07:59.865356 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:07:59.865356 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:07:59.865356 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:07:59.865356 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:07:59.865356 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:07:59.865356 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:07:59.865356 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:07:59.865356 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( May 10 19:07:59.865356 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:07:59.865356 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() May 10 19:07:59.865356 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:07:59.865356 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:07:59.866269 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:07:59.866269 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() May 10 19:07:59.866269 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:07:59.866269 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( May 10 19:07:59.866269 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:07:59.866269 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:07:59.866269 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:07:59.866269 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:07:59.866269 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:07:59.866269 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:07:59.866269 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 19:07:59.866269 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:07:59.866269 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 372/739] 10.222.0.70 () {56 vars in 1096 bytes} [Tue May 10 19:07:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:07:59.866988 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588928bb-2360-4480-a7f3-ee975177a216 None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:59.866988 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588928bb-2360-4480-a7f3-ee975177a216 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:59.867265 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588928bb-2360-4480-a7f3-ee975177a216 None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:59.868511 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 373/740] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:07:59 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:07:59.869182 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588928bb-2360-4480-a7f3-ee975177a216 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:59.894841 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f54b81-da69-462c-b9ac-841eb31f8f47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:07:59.895629 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f54b81-da69-462c-b9ac-841eb31f8f47 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:59.895911 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f54b81-da69-462c-b9ac-841eb31f8f47 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:59.896184 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f54b81-da69-462c-b9ac-841eb31f8f47 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:59.906135 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f54b81-da69-462c-b9ac-841eb31f8f47 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:07:59.907565 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f54b81-da69-462c-b9ac-841eb31f8f47 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:07:59.925227 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application [None req-46f54b81-da69-462c-b9ac-841eb31f8f47 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:07:59.925227 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:07:59.925227 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:07:59.925227 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:07:59.925227 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:07:59.925227 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:07:59.925227 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:07:59.925227 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:07:59.925227 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:07:59.925227 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:07:59.925227 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:07:59.925227 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:07:59.925227 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 19:07:59.925227 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 19:07:59.925227 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 19:07:59.926265 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 19:07:59.926265 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:07:59.926265 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:07:59.926265 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:07:59.926265 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:07:59.926265 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:07:59.926265 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:07:59.926265 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:07:59.926265 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application with Lock( May 10 19:07:59.926265 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:07:59.926265 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._enter() May 10 19:07:59.926265 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:07:59.926265 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:07:59.926265 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:07:59.926265 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.creator() May 10 19:07:59.926265 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:07:59.926265 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application created_value = creator( May 10 19:07:59.927218 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 19:07:59.927218 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 19:07:59.927218 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:07:59.927218 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application May 10 19:07:59.927218 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 368/741] 10.222.0.70 () {56 vars in 1108 bytes} [Tue May 10 19:07:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:07:59.927501 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f54b81-da69-462c-b9ac-841eb31f8f47 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:07:59.972055 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588928bb-2360-4480-a7f3-ee975177a216 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:00.003204 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e224ad6c-bb1d-452c-8233-b3233da59a13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:00.003866 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e224ad6c-bb1d-452c-8233-b3233da59a13 None admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:00.004145 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e224ad6c-bb1d-452c-8233-b3233da59a13 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:00.004441 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e224ad6c-bb1d-452c-8233-b3233da59a13 None admin] PATH_INFO: `/v3/services` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:00.005151 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e224ad6c-bb1d-452c-8233-b3233da59a13 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:00.006513 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e224ad6c-bb1d-452c-8233-b3233da59a13 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:00.021793 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 374/742] 10.222.0.70 () {60 vars in 1141 bytes} [Tue May 10 19:07:59 2022] POST /identity/v3/services => generated 251 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:08:00.022605 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e224ad6c-bb1d-452c-8233-b3233da59a13 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:00.031013 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f54b81-da69-462c-b9ac-841eb31f8f47 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:00.078918 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5ccfa2-a8a9-4bde-8bd3-c20738a8a3b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:00.079575 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5ccfa2-a8a9-4bde-8bd3-c20738a8a3b8 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:00.079874 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5ccfa2-a8a9-4bde-8bd3-c20738a8a3b8 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:00.080154 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5ccfa2-a8a9-4bde-8bd3-c20738a8a3b8 None admin] PATH_INFO: `/v3/users` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:00.081544 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5ccfa2-a8a9-4bde-8bd3-c20738a8a3b8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:08:00.082111 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5ccfa2-a8a9-4bde-8bd3-c20738a8a3b8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:00.083610 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5ccfa2-a8a9-4bde-8bd3-c20738a8a3b8 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:00.108072 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 369/743] 10.222.0.70 () {56 vars in 1149 bytes} [Tue May 10 19:07:59 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:08:00.108072 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88108b52-8c7d-4f7f-81d8-56b4e63ceb4c None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:00.108072 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88108b52-8c7d-4f7f-81d8-56b4e63ceb4c None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:00.108072 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88108b52-8c7d-4f7f-81d8-56b4e63ceb4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:00.124815 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-88108b52-8c7d-4f7f-81d8-56b4e63ceb4c None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:08:00.126041 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-88108b52-8c7d-4f7f-81d8-56b4e63ceb4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:08:00.154523 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e224ad6c-bb1d-452c-8233-b3233da59a13 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:00.190773 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb283fca-e28e-402a-bc0b-589ccc60324b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:00.191622 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb283fca-e28e-402a-bc0b-589ccc60324b None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:00.191913 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb283fca-e28e-402a-bc0b-589ccc60324b None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:00.192193 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb283fca-e28e-402a-bc0b-589ccc60324b None admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:00.192979 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb283fca-e28e-402a-bc0b-589ccc60324b None admin] RBAC: Adding query filter params (name=admin) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:08:00.193290 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb283fca-e28e-402a-bc0b-589ccc60324b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:00.194748 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb283fca-e28e-402a-bc0b-589ccc60324b None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:00.205051 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 370/744] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:08:00 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 19:08:00.205051 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88108b52-8c7d-4f7f-81d8-56b4e63ceb4c None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:00.205304 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 375/745] 10.222.0.70 () {56 vars in 1099 bytes} [Tue May 10 19:08:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:08:00.205304 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb283fca-e28e-402a-bc0b-589ccc60324b None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:00.307258 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb283fca-e28e-402a-bc0b-589ccc60324b None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:00.312704 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88108b52-8c7d-4f7f-81d8-56b4e63ceb4c None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:00.340712 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268d8ff7-25c5-4bc6-8652-0f36c03f769d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:00.341300 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268d8ff7-25c5-4bc6-8652-0f36c03f769d None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:00.341586 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268d8ff7-25c5-4bc6-8652-0f36c03f769d None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:00.341865 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268d8ff7-25c5-4bc6-8652-0f36c03f769d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:00.347014 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6691beb2-efd0-4a9d-a89c-fd7d3e31d4cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:00.347922 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6691beb2-efd0-4a9d-a89c-fd7d3e31d4cf None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:00.348455 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6691beb2-efd0-4a9d-a89c-fd7d3e31d4cf None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:00.348936 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6691beb2-efd0-4a9d-a89c-fd7d3e31d4cf None admin] PATH_INFO: `/v3/domains` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:00.349849 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6691beb2-efd0-4a9d-a89c-fd7d3e31d4cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:08:00.350366 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6691beb2-efd0-4a9d-a89c-fd7d3e31d4cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:00.351843 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6691beb2-efd0-4a9d-a89c-fd7d3e31d4cf None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:00.363353 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 371/746] 10.222.0.70 () {56 vars in 1109 bytes} [Tue May 10 19:08:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:08:00.364138 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6691beb2-efd0-4a9d-a89c-fd7d3e31d4cf None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:00.417872 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268d8ff7-25c5-4bc6-8652-0f36c03f769d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:00.419272 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268d8ff7-25c5-4bc6-8652-0f36c03f769d None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:00.464301 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6691beb2-efd0-4a9d-a89c-fd7d3e31d4cf None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:00.496261 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b225aa52-7973-4d0d-ace1-86819ef0ed4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:00.497103 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b225aa52-7973-4d0d-ace1-86819ef0ed4d None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:00.497383 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b225aa52-7973-4d0d-ace1-86819ef0ed4d None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:00.497657 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b225aa52-7973-4d0d-ace1-86819ef0ed4d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:00.508487 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b225aa52-7973-4d0d-ace1-86819ef0ed4d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:00.509938 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b225aa52-7973-4d0d-ace1-86819ef0ed4d None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:00.518453 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 376/747] 10.222.0.70 () {58 vars in 1282 bytes} [Tue May 10 19:08:00 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 19:08:00.518453 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268d8ff7-25c5-4bc6-8652-0f36c03f769d None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:00.526590 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application [None req-b225aa52-7973-4d0d-ace1-86819ef0ed4d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:08:00.526590 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:08:00.526590 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:08:00.526590 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:08:00.526590 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:08:00.526590 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:08:00.526590 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:08:00.526590 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:08:00.526590 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:08:00.526590 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:08:00.526590 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:08:00.526590 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:08:00.526590 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 19:08:00.526590 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 19:08:00.526590 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 19:08:00.527510 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 19:08:00.527510 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:08:00.527510 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:08:00.527510 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:08:00.527510 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:08:00.527510 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:08:00.527510 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:08:00.527510 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:08:00.527510 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application with Lock( May 10 19:08:00.527510 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:08:00.527510 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._enter() May 10 19:08:00.527510 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:08:00.527510 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:08:00.527510 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:08:00.527510 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.creator() May 10 19:08:00.527510 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:08:00.527510 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application created_value = creator( May 10 19:08:00.528443 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 19:08:00.528443 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 19:08:00.528443 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:08:00.528443 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application May 10 19:08:00.528443 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 372/748] 10.222.0.70 () {56 vars in 1108 bytes} [Tue May 10 19:08:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:08:00.529156 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b225aa52-7973-4d0d-ace1-86819ef0ed4d None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:00.624252 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268d8ff7-25c5-4bc6-8652-0f36c03f769d None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:00.626729 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b225aa52-7973-4d0d-ace1-86819ef0ed4d None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:00.657491 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b06141e-63e9-45f2-9f0d-e2bdb79383d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:00.658157 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b06141e-63e9-45f2-9f0d-e2bdb79383d9 None admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:00.658439 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b06141e-63e9-45f2-9f0d-e2bdb79383d9 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:00.659266 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b06141e-63e9-45f2-9f0d-e2bdb79383d9 None admin] PATH_INFO: `/v3/services` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:00.659982 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b06141e-63e9-45f2-9f0d-e2bdb79383d9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:00.661391 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b06141e-63e9-45f2-9f0d-e2bdb79383d9 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:00.663172 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ffcd27-c4e0-40d4-9211-cb1b19c20780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:00.663970 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ffcd27-c4e0-40d4-9211-cb1b19c20780 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:00.664260 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ffcd27-c4e0-40d4-9211-cb1b19c20780 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:00.664579 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ffcd27-c4e0-40d4-9211-cb1b19c20780 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:00.671610 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ffcd27-c4e0-40d4-9211-cb1b19c20780 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:00.673110 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ffcd27-c4e0-40d4-9211-cb1b19c20780 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:00.680729 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 377/749] 10.222.0.70 () {60 vars in 1141 bytes} [Tue May 10 19:08:00 2022] POST /identity/v3/services => generated 240 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:08:00.680729 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b06141e-63e9-45f2-9f0d-e2bdb79383d9 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:00.700273 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application [None req-39ffcd27-c4e0-40d4-9211-cb1b19c20780 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 19:08:00.700273 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:08:00.700273 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:08:00.700273 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:08:00.700273 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:08:00.700273 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:08:00.700273 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:08:00.700273 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:08:00.700273 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:08:00.700273 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:08:00.700273 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:08:00.700273 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:08:00.700273 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 19:08:00.700273 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 19:08:00.700273 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 19:08:00.701295 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 19:08:00.701295 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:08:00.701295 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:08:00.701295 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:08:00.701295 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:08:00.701295 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:08:00.701295 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:08:00.701295 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:08:00.701295 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application with Lock( May 10 19:08:00.701295 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:08:00.701295 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._enter() May 10 19:08:00.701295 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:08:00.701295 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:08:00.701295 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:08:00.701295 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.creator() May 10 19:08:00.701295 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:08:00.701295 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application created_value = creator( May 10 19:08:00.702221 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 19:08:00.702221 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 19:08:00.702221 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 19:08:00.702221 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 19:08:00.702221 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 19:08:00.702221 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 19:08:00.702221 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 19:08:00.702221 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application May 10 19:08:00.702658 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 373/750] 10.222.0.70 () {56 vars in 1111 bytes} [Tue May 10 19:08:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:08:00.703315 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ffcd27-c4e0-40d4-9211-cb1b19c20780 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:00.794651 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b06141e-63e9-45f2-9f0d-e2bdb79383d9 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:00.836131 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1bad39-4a32-44ca-85db-516d1675906f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:00.837727 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1bad39-4a32-44ca-85db-516d1675906f None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:00.838007 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1bad39-4a32-44ca-85db-516d1675906f None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:00.838274 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1bad39-4a32-44ca-85db-516d1675906f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:00.842380 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ffcd27-c4e0-40d4-9211-cb1b19c20780 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:00.850158 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1bad39-4a32-44ca-85db-516d1675906f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:00.851839 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1bad39-4a32-44ca-85db-516d1675906f None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:00.870783 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-2d1bad39-4a32-44ca-85db-516d1675906f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:08:00.870783 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:08:00.870783 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:08:00.870783 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:08:00.870783 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:08:00.870783 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:08:00.870783 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:08:00.870783 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:08:00.870783 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:08:00.870783 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:08:00.870783 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:08:00.870783 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:08:00.870783 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 19:08:00.870783 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 19:08:00.870783 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 19:08:00.871786 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 19:08:00.871786 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:08:00.871786 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:08:00.871786 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:08:00.871786 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:08:00.871786 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:08:00.871786 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:08:00.871786 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:08:00.871786 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( May 10 19:08:00.871786 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:08:00.871786 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() May 10 19:08:00.871786 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:08:00.871786 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:08:00.871786 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:08:00.871786 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() May 10 19:08:00.871786 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:08:00.871786 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( May 10 19:08:00.872741 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 19:08:00.872741 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 19:08:00.872741 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:08:00.872741 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:08:00.877347 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 378/751] 10.222.0.70 () {56 vars in 1108 bytes} [Tue May 10 19:08:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:08:00.878781 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1bad39-4a32-44ca-85db-516d1675906f None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:00.887003 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed024e8-f7df-4baf-b71f-c5a759560da9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:00.887685 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed024e8-f7df-4baf-b71f-c5a759560da9 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:00.888458 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed024e8-f7df-4baf-b71f-c5a759560da9 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:00.888762 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed024e8-f7df-4baf-b71f-c5a759560da9 None admin] PATH_INFO: `/v3/domains` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:00.889487 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed024e8-f7df-4baf-b71f-c5a759560da9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:08:00.889791 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed024e8-f7df-4baf-b71f-c5a759560da9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:00.891546 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed024e8-f7df-4baf-b71f-c5a759560da9 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:00.907735 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 374/752] 10.222.0.70 () {56 vars in 1109 bytes} [Tue May 10 19:08:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:08:00.909253 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed024e8-f7df-4baf-b71f-c5a759560da9 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:01.008995 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1bad39-4a32-44ca-85db-516d1675906f None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:01.026163 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed024e8-f7df-4baf-b71f-c5a759560da9 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:01.045641 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd916792-8283-4b4a-98e7-ee2c10921954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:01.046309 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd916792-8283-4b4a-98e7-ee2c10921954 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:01.046590 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd916792-8283-4b4a-98e7-ee2c10921954 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:01.046865 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd916792-8283-4b4a-98e7-ee2c10921954 None admin] PATH_INFO: `/v3/projects` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:01.047655 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd916792-8283-4b4a-98e7-ee2c10921954 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:08:01.047963 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd916792-8283-4b4a-98e7-ee2c10921954 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:01.049467 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd916792-8283-4b4a-98e7-ee2c10921954 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:01.061906 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 379/753] 10.222.0.70 () {56 vars in 1148 bytes} [Tue May 10 19:08:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:08:01.062728 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd916792-8283-4b4a-98e7-ee2c10921954 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:01.063298 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7475441-11ae-4813-bedb-c2fd783ebb43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:01.064090 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7475441-11ae-4813-bedb-c2fd783ebb43 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:01.064467 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7475441-11ae-4813-bedb-c2fd783ebb43 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:01.064854 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7475441-11ae-4813-bedb-c2fd783ebb43 None admin] PATH_INFO: `/v3/domains` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:01.065698 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7475441-11ae-4813-bedb-c2fd783ebb43 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:08:01.066076 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7475441-11ae-4813-bedb-c2fd783ebb43 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:01.067598 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7475441-11ae-4813-bedb-c2fd783ebb43 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:01.080855 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 375/754] 10.222.0.70 () {56 vars in 1109 bytes} [Tue May 10 19:08:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:08:01.082070 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7475441-11ae-4813-bedb-c2fd783ebb43 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:01.160572 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd916792-8283-4b4a-98e7-ee2c10921954 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:01.180908 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7475441-11ae-4813-bedb-c2fd783ebb43 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:01.195455 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62475b1-ef48-4e8a-ae80-3ac84dd14d4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:01.196270 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62475b1-ef48-4e8a-ae80-3ac84dd14d4f None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:01.196583 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62475b1-ef48-4e8a-ae80-3ac84dd14d4f None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:01.196857 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62475b1-ef48-4e8a-ae80-3ac84dd14d4f None admin] PATH_INFO: `/v3/users/swift` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:01.204882 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62475b1-ef48-4e8a-ae80-3ac84dd14d4f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:01.206412 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62475b1-ef48-4e8a-ae80-3ac84dd14d4f None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:01.218946 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d683565f-a77a-48e8-ac51-589fe7ce4d0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:01.219965 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d683565f-a77a-48e8-ac51-589fe7ce4d0d None admin] REQUEST_METHOD: `PUT` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:01.220389 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d683565f-a77a-48e8-ac51-589fe7ce4d0d None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:01.220772 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d683565f-a77a-48e8-ac51-589fe7ce4d0d None admin] PATH_INFO: `/v3/projects/2ee9ec5b515440fe9b39aedf3e339c79/users/b9f310a468ec4058b3c95356ea60ab4c/roles/634ba284303b4626b5a0402772c68f5c` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:01.221632 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-c62475b1-ef48-4e8a-ae80-3ac84dd14d4f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 10 19:08:01.221632 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:08:01.221632 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:08:01.221632 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:08:01.221632 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:08:01.221632 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:08:01.221632 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:08:01.221632 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:08:01.221632 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:08:01.221632 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:08:01.221632 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:08:01.221632 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:08:01.221632 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 19:08:01.221632 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 19:08:01.221632 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 19:08:01.221632 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 19:08:01.223410 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:08:01.223410 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:08:01.223410 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 19:08:01.223410 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 19:08:01.223410 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 19:08:01.223410 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 19:08:01.223410 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:08:01.223410 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:08:01.223410 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:08:01.223410 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:08:01.223410 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:08:01.223410 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( May 10 19:08:01.223410 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:08:01.223410 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() May 10 19:08:01.223410 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:08:01.223410 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:08:01.223410 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:08:01.223410 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() May 10 19:08:01.225204 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:08:01.225204 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( May 10 19:08:01.225204 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 19:08:01.225204 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 19:08:01.225204 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 19:08:01.225204 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 19:08:01.225204 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 19:08:01.225204 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 19:08:01.225204 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 10 19:08:01.225204 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:08:01.225204 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 380/755] 10.222.0.70 () {56 vars in 1096 bytes} [Tue May 10 19:08:01 2022] GET /identity/v3/users/swift => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:08:01.225204 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62475b1-ef48-4e8a-ae80-3ac84dd14d4f None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:01.232445 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d683565f-a77a-48e8-ac51-589fe7ce4d0d None admin] RBAC: Authorizing `identity:create_grant(project_id=2ee9ec5b515440fe9b39aedf3e339c79, user_id=b9f310a468ec4058b3c95356ea60ab4c, role_id=634ba284303b4626b5a0402772c68f5c)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:01.232445 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d683565f-a77a-48e8-ac51-589fe7ce4d0d None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:01.247830 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 376/756] 10.222.0.70 () {58 vars in 1439 bytes} [Tue May 10 19:08:01 2022] PUT /identity/v3/projects/2ee9ec5b515440fe9b39aedf3e339c79/users/b9f310a468ec4058b3c95356ea60ab4c/roles/634ba284303b4626b5a0402772c68f5c => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:08:01.248956 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d683565f-a77a-48e8-ac51-589fe7ce4d0d None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:01.328314 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62475b1-ef48-4e8a-ae80-3ac84dd14d4f None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:01.358290 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d683565f-a77a-48e8-ac51-589fe7ce4d0d None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:01.365445 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e10bb8d-4df4-45c3-89e9-95fce75d8341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:01.366253 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e10bb8d-4df4-45c3-89e9-95fce75d8341 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:01.366532 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e10bb8d-4df4-45c3-89e9-95fce75d8341 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:01.366808 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e10bb8d-4df4-45c3-89e9-95fce75d8341 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:01.374188 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e10bb8d-4df4-45c3-89e9-95fce75d8341 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:01.375664 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e10bb8d-4df4-45c3-89e9-95fce75d8341 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:01.390647 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-7e10bb8d-4df4-45c3-89e9-95fce75d8341 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 19:08:01.390647 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:08:01.390647 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:08:01.390647 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:08:01.390647 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:08:01.390647 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:08:01.390647 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:08:01.390647 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:08:01.390647 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:08:01.390647 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:08:01.390647 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:08:01.390647 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:08:01.390647 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 19:08:01.390647 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 19:08:01.390647 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 19:08:01.392766 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 19:08:01.392766 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:08:01.392766 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:08:01.392766 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:08:01.392766 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:08:01.392766 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:08:01.392766 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:08:01.392766 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:08:01.392766 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( May 10 19:08:01.392766 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:08:01.392766 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() May 10 19:08:01.392766 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:08:01.392766 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:08:01.392766 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:08:01.392766 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() May 10 19:08:01.392766 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:08:01.392766 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( May 10 19:08:01.395003 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 19:08:01.395003 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 19:08:01.395003 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 19:08:01.395003 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 19:08:01.395003 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 19:08:01.395003 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 19:08:01.395003 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 19:08:01.395003 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:08:01.395003 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 381/757] 10.222.0.70 () {56 vars in 1111 bytes} [Tue May 10 19:08:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:08:01.396127 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3392dd-c0fb-4a2f-b5af-3c293815f27f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:01.400443 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3392dd-c0fb-4a2f-b5af-3c293815f27f None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:01.400443 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3392dd-c0fb-4a2f-b5af-3c293815f27f None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:01.400443 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3392dd-c0fb-4a2f-b5af-3c293815f27f None admin] PATH_INFO: `/v3/users` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:01.400966 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e10bb8d-4df4-45c3-89e9-95fce75d8341 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:01.401128 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3392dd-c0fb-4a2f-b5af-3c293815f27f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:08:01.401128 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3392dd-c0fb-4a2f-b5af-3c293815f27f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:01.401128 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3392dd-c0fb-4a2f-b5af-3c293815f27f None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:01.420019 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 377/758] 10.222.0.70 () {56 vars in 1135 bytes} [Tue May 10 19:08:01 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:08:01.425789 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3392dd-c0fb-4a2f-b5af-3c293815f27f None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:01.511110 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e10bb8d-4df4-45c3-89e9-95fce75d8341 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:01.532795 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3392dd-c0fb-4a2f-b5af-3c293815f27f None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:01.545841 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ce1f90-980e-45fd-a965-d3e101cea643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:01.546515 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ce1f90-980e-45fd-a965-d3e101cea643 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:01.546796 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ce1f90-980e-45fd-a965-d3e101cea643 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:01.547072 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ce1f90-980e-45fd-a965-d3e101cea643 None admin] PATH_INFO: `/v3/projects` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:01.547876 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ce1f90-980e-45fd-a965-d3e101cea643 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:08:01.548184 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ce1f90-980e-45fd-a965-d3e101cea643 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:01.550225 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ce1f90-980e-45fd-a965-d3e101cea643 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:01.570438 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b857839-cf81-4b08-b2c7-06432ac2821e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:01.571168 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b857839-cf81-4b08-b2c7-06432ac2821e None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:01.571462 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b857839-cf81-4b08-b2c7-06432ac2821e None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:01.571745 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b857839-cf81-4b08-b2c7-06432ac2821e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:01.649795 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b857839-cf81-4b08-b2c7-06432ac2821e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:01.651294 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b857839-cf81-4b08-b2c7-06432ac2821e None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:01.687858 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 382/759] 10.222.0.70 () {56 vars in 1148 bytes} [Tue May 10 19:08:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:08:01.693756 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ce1f90-980e-45fd-a965-d3e101cea643 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:01.758093 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 378/760] 10.222.0.70 () {58 vars in 1282 bytes} [Tue May 10 19:08:01 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 19:08:01.763592 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b857839-cf81-4b08-b2c7-06432ac2821e None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:01.802987 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ce1f90-980e-45fd-a965-d3e101cea643 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:01.836997 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a01bff-fad9-4c8f-8a79-ceecc56e0faf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:01.837657 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a01bff-fad9-4c8f-8a79-ceecc56e0faf None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:01.837935 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a01bff-fad9-4c8f-8a79-ceecc56e0faf None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:01.838205 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a01bff-fad9-4c8f-8a79-ceecc56e0faf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:01.839029 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a01bff-fad9-4c8f-8a79-ceecc56e0faf None admin] RBAC: Adding query filter params (role.id=445805bec1e741c9b823495ae6e364f0, scope.project.id=2ee9ec5b515440fe9b39aedf3e339c79, user.id=058e52f1bf0b4aba965d945815d4acb3) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:08:01.839336 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a01bff-fad9-4c8f-8a79-ceecc56e0faf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:01.840794 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a01bff-fad9-4c8f-8a79-ceecc56e0faf None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:01.846626 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 383/761] 10.222.0.70 () {56 vars in 1374 bytes} [Tue May 10 19:08:01 2022] GET /identity/v3/role_assignments?user.id=058e52f1bf0b4aba965d945815d4acb3&scope.project.id=2ee9ec5b515440fe9b39aedf3e339c79&role.id=445805bec1e741c9b823495ae6e364f0 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:08:01.864889 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b857839-cf81-4b08-b2c7-06432ac2821e None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:02.030362 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7890be9-c482-461d-94b6-d2d995149f72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:02.031181 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7890be9-c482-461d-94b6-d2d995149f72 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:02.031462 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7890be9-c482-461d-94b6-d2d995149f72 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:02.032099 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7890be9-c482-461d-94b6-d2d995149f72 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:02.043779 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7890be9-c482-461d-94b6-d2d995149f72 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:02.045353 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7890be9-c482-461d-94b6-d2d995149f72 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:02.065402 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application [None req-e7890be9-c482-461d-94b6-d2d995149f72 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:08:02.065402 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:08:02.065402 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:08:02.065402 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:08:02.065402 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:08:02.065402 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:08:02.065402 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:08:02.065402 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:08:02.065402 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:08:02.065402 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:08:02.065402 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:08:02.065402 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:08:02.065402 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 19:08:02.065402 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 19:08:02.065402 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 19:08:02.067481 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 19:08:02.067481 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:08:02.067481 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:08:02.067481 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:08:02.067481 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:08:02.067481 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:08:02.067481 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:08:02.067481 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:08:02.067481 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application with Lock( May 10 19:08:02.067481 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:08:02.067481 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._enter() May 10 19:08:02.067481 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:08:02.067481 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:08:02.067481 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:08:02.067481 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.creator() May 10 19:08:02.067481 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:08:02.067481 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application created_value = creator( May 10 19:08:02.069612 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 19:08:02.069612 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 19:08:02.069612 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:08:02.069612 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application May 10 19:08:02.069612 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 379/762] 10.222.0.70 () {56 vars in 1108 bytes} [Tue May 10 19:08:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 19:08:02.073586 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a01bff-fad9-4c8f-8a79-ceecc56e0faf None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:02.201077 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a01bff-fad9-4c8f-8a79-ceecc56e0faf None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:02.237301 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5e4b17-6e1f-4fca-83c9-69e24e584faa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:02.237901 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5e4b17-6e1f-4fca-83c9-69e24e584faa None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:02.238186 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5e4b17-6e1f-4fca-83c9-69e24e584faa None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:02.238460 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5e4b17-6e1f-4fca-83c9-69e24e584faa None admin] PATH_INFO: `/v3/domains` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:02.239192 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5e4b17-6e1f-4fca-83c9-69e24e584faa None admin] RBAC: Adding query filter params (name=Default) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:08:02.239486 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5e4b17-6e1f-4fca-83c9-69e24e584faa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:02.240874 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5e4b17-6e1f-4fca-83c9-69e24e584faa None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:02.253074 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 384/763] 10.222.0.70 () {56 vars in 1109 bytes} [Tue May 10 19:08:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:08:02.258141 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7890be9-c482-461d-94b6-d2d995149f72 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:02.402378 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7890be9-c482-461d-94b6-d2d995149f72 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:02.450640 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f40dc6c-e3b4-49d7-b096-9df07bd6742b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:02.451442 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f40dc6c-e3b4-49d7-b096-9df07bd6742b None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:02.451726 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f40dc6c-e3b4-49d7-b096-9df07bd6742b None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:02.451995 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f40dc6c-e3b4-49d7-b096-9df07bd6742b None admin] PATH_INFO: `/v3/projects/service` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:02.459705 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f40dc6c-e3b4-49d7-b096-9df07bd6742b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:02.461224 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f40dc6c-e3b4-49d7-b096-9df07bd6742b None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:02.479581 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application [None req-4f40dc6c-e3b4-49d7-b096-9df07bd6742b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 19:08:02.479581 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:08:02.479581 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:08:02.479581 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:08:02.479581 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:08:02.479581 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:08:02.479581 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:08:02.479581 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:08:02.479581 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:08:02.479581 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:08:02.479581 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:08:02.479581 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:08:02.479581 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 19:08:02.479581 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 19:08:02.479581 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 19:08:02.481672 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 19:08:02.481672 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:08:02.481672 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:08:02.481672 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:08:02.481672 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:08:02.481672 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:08:02.481672 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:08:02.481672 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:08:02.481672 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application with Lock( May 10 19:08:02.481672 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:08:02.481672 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._enter() May 10 19:08:02.481672 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:08:02.481672 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:08:02.481672 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:08:02.481672 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.creator() May 10 19:08:02.481672 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:08:02.481672 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application created_value = creator( May 10 19:08:02.483763 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 19:08:02.483763 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 19:08:02.483763 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 19:08:02.483763 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 19:08:02.483763 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 19:08:02.483763 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 19:08:02.483763 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 19:08:02.483763 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application May 10 19:08:02.483763 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 380/764] 10.222.0.70 () {56 vars in 1111 bytes} [Tue May 10 19:08:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:08:02.486735 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5e4b17-6e1f-4fca-83c9-69e24e584faa None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:02.600020 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5e4b17-6e1f-4fca-83c9-69e24e584faa None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:02.639903 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32f8fe1-da04-464c-bb1b-5c40b0b7bb20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:02.640610 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32f8fe1-da04-464c-bb1b-5c40b0b7bb20 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:02.640893 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32f8fe1-da04-464c-bb1b-5c40b0b7bb20 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:02.641168 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32f8fe1-da04-464c-bb1b-5c40b0b7bb20 None admin] PATH_INFO: `/v3/projects` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:02.641956 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32f8fe1-da04-464c-bb1b-5c40b0b7bb20 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:08:02.642260 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32f8fe1-da04-464c-bb1b-5c40b0b7bb20 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:02.644316 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32f8fe1-da04-464c-bb1b-5c40b0b7bb20 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:02.656361 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 385/765] 10.222.0.70 () {56 vars in 1148 bytes} [Tue May 10 19:08:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:08:02.662700 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f40dc6c-e3b4-49d7-b096-9df07bd6742b None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:02.792832 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f40dc6c-e3b4-49d7-b096-9df07bd6742b None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:02.828947 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2790ffa9-43a3-4c1b-9081-3efe92def5f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:02.829612 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2790ffa9-43a3-4c1b-9081-3efe92def5f0 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:02.829895 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2790ffa9-43a3-4c1b-9081-3efe92def5f0 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:02.830173 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2790ffa9-43a3-4c1b-9081-3efe92def5f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:02.831044 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2790ffa9-43a3-4c1b-9081-3efe92def5f0 None admin] RBAC: Adding query filter params (role.id=634ba284303b4626b5a0402772c68f5c, scope.project.id=2ee9ec5b515440fe9b39aedf3e339c79, user.id=0454aa03fa31487ea1464b9d0008212c) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:08:02.831356 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2790ffa9-43a3-4c1b-9081-3efe92def5f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:02.833080 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2790ffa9-43a3-4c1b-9081-3efe92def5f0 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:02.839179 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 381/766] 10.222.0.70 () {56 vars in 1374 bytes} [Tue May 10 19:08:02 2022] GET /identity/v3/role_assignments?user.id=0454aa03fa31487ea1464b9d0008212c&scope.project.id=2ee9ec5b515440fe9b39aedf3e339c79&role.id=634ba284303b4626b5a0402772c68f5c => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:08:02.902506 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc159b2e-fc20-49df-bdb4-d9e348748d2e None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:02.902817 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc159b2e-fc20-49df-bdb4-d9e348748d2e None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:02.903074 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc159b2e-fc20-49df-bdb4-d9e348748d2e None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:02.904513 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 386/767] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:08:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:08:02.910578 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d4f1fe-02fe-4b69-9787-692755d9471d None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:02.910884 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d4f1fe-02fe-4b69-9787-692755d9471d None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:02.911130 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d4f1fe-02fe-4b69-9787-692755d9471d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:02.928160 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-76d4f1fe-02fe-4b69-9787-692755d9471d None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:08:02.933618 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-76d4f1fe-02fe-4b69-9787-692755d9471d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:08:03.022267 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 382/768] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:08:02 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 19:08:03.064168 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc159b2e-fc20-49df-bdb4-d9e348748d2e None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:03.194327 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc159b2e-fc20-49df-bdb4-d9e348748d2e None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:03.243787 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa67e07-3832-42e5-8ff3-6d27f1ca0418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:03.244628 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa67e07-3832-42e5-8ff3-6d27f1ca0418 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:03.244914 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa67e07-3832-42e5-8ff3-6d27f1ca0418 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:03.245187 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa67e07-3832-42e5-8ff3-6d27f1ca0418 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:03.245839 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa67e07-3832-42e5-8ff3-6d27f1ca0418 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:03.247288 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa67e07-3832-42e5-8ff3-6d27f1ca0418 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:03.265269 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-caa67e07-3832-42e5-8ff3-6d27f1ca0418 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 10 19:08:03.265269 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:08:03.265269 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 19:08:03.265269 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 19:08:03.265269 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 19:08:03.265269 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 19:08:03.265269 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 19:08:03.265269 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 19:08:03.265269 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 10 19:08:03.265269 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:08:03.265269 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 19:08:03.265269 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:08:03.265269 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:08:03.265269 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:08:03.265269 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:08:03.265269 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:08:03.267407 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:08:03.267407 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:08:03.267407 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:08:03.267407 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:08:03.267407 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:08:03.267407 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:08:03.267407 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:08:03.267407 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 19:08:03.267407 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 19:08:03.267407 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 19:08:03.267407 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 19:08:03.267407 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:08:03.267407 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:08:03.267407 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:08:03.267407 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:08:03.267407 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:08:03.269941 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:08:03.269941 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:08:03.269941 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( May 10 19:08:03.269941 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:08:03.269941 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() May 10 19:08:03.269941 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:08:03.269941 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:08:03.269941 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:08:03.269941 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() May 10 19:08:03.269941 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:08:03.269941 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( May 10 19:08:03.269941 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 19:08:03.269941 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 19:08:03.269941 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 10 19:08:03.269941 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:08:03.269941 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 387/769] 10.222.0.70 () {56 vars in 1129 bytes} [Tue May 10 19:08:03 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:08:03.276452 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d4f1fe-02fe-4b69-9787-692755d9471d None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:03.376274 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47cfbd7-a43b-4567-923d-33fe40fbf654 None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:03.376274 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47cfbd7-a43b-4567-923d-33fe40fbf654 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:03.376274 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47cfbd7-a43b-4567-923d-33fe40fbf654 None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:03.376274 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 388/770] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:08:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 19:08:03.383953 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1781a8ef-4f27-49d8-9c2c-4ad4c8cb45a2 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:03.383953 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1781a8ef-4f27-49d8-9c2c-4ad4c8cb45a2 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:03.383953 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1781a8ef-4f27-49d8-9c2c-4ad4c8cb45a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:03.399995 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-1781a8ef-4f27-49d8-9c2c-4ad4c8cb45a2 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:08:03.401542 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-1781a8ef-4f27-49d8-9c2c-4ad4c8cb45a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:08:03.420249 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d4f1fe-02fe-4b69-9787-692755d9471d None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:03.451257 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c7af68-46c3-4430-b643-c04607e72851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:03.451843 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c7af68-46c3-4430-b643-c04607e72851 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:03.452124 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c7af68-46c3-4430-b643-c04607e72851 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:03.452399 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c7af68-46c3-4430-b643-c04607e72851 None admin] PATH_INFO: `/v3/services` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:03.453181 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c7af68-46c3-4430-b643-c04607e72851 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:08:03.456445 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c7af68-46c3-4430-b643-c04607e72851 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:03.456445 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c7af68-46c3-4430-b643-c04607e72851 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:03.464624 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 383/771] 10.222.0.70 () {56 vars in 1124 bytes} [Tue May 10 19:08:03 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:08:03.466821 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c7af68-46c3-4430-b643-c04607e72851 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:03.567177 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 389/772] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:08:03 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 19:08:03.569115 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c7af68-46c3-4430-b643-c04607e72851 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:03.603230 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1781a8ef-4f27-49d8-9c2c-4ad4c8cb45a2 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:03.604128 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddbfdd1-1688-4117-8e24-267b59509292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:03.604877 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddbfdd1-1688-4117-8e24-267b59509292 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:03.605165 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddbfdd1-1688-4117-8e24-267b59509292 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:03.605442 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddbfdd1-1688-4117-8e24-267b59509292 None admin] PATH_INFO: `/v3/services` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:03.606141 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddbfdd1-1688-4117-8e24-267b59509292 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:08:03.606441 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddbfdd1-1688-4117-8e24-267b59509292 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:03.607817 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddbfdd1-1688-4117-8e24-267b59509292 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:03.616534 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 384/773] 10.222.0.70 () {56 vars in 1124 bytes} [Tue May 10 19:08:03 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:08:03.619075 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddbfdd1-1688-4117-8e24-267b59509292 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:03.717493 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddbfdd1-1688-4117-8e24-267b59509292 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:03.725733 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1781a8ef-4f27-49d8-9c2c-4ad4c8cb45a2 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:03.751047 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a06144-65b7-4040-8697-9fcf1a24c8ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:03.751754 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a06144-65b7-4040-8697-9fcf1a24c8ad None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:03.752039 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a06144-65b7-4040-8697-9fcf1a24c8ad None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:03.752918 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a06144-65b7-4040-8697-9fcf1a24c8ad None admin] PATH_INFO: `/v3/endpoints` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:03.753705 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a06144-65b7-4040-8697-9fcf1a24c8ad None admin] RBAC: Adding query filter params (interface=public, service_id=8b6313f29a4e4ed28a513c66f1058d06, region_id=RegionOne) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:08:03.754010 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a06144-65b7-4040-8697-9fcf1a24c8ad None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:03.755369 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a06144-65b7-4040-8697-9fcf1a24c8ad None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:03.767379 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 385/774] 10.222.0.70 () {56 vars in 1251 bytes} [Tue May 10 19:08:03 2022] GET /identity/v3/endpoints?service_id=8b6313f29a4e4ed28a513c66f1058d06&interface=public®ion_id=RegionOne => generated 194 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:08:03.768727 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a06144-65b7-4040-8697-9fcf1a24c8ad None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:03.769238 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f3e55b-8fef-4526-8cbe-12279ba0d312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:03.770054 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f3e55b-8fef-4526-8cbe-12279ba0d312 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:03.770334 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f3e55b-8fef-4526-8cbe-12279ba0d312 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:03.770606 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f3e55b-8fef-4526-8cbe-12279ba0d312 None admin] PATH_INFO: `/v3/services/network` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:03.771261 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f3e55b-8fef-4526-8cbe-12279ba0d312 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:03.772651 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f3e55b-8fef-4526-8cbe-12279ba0d312 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:03.794706 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-f8f3e55b-8fef-4526-8cbe-12279ba0d312 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 10 19:08:03.794706 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:08:03.794706 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 19:08:03.794706 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 19:08:03.794706 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 19:08:03.794706 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 19:08:03.794706 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 19:08:03.794706 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 19:08:03.794706 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 10 19:08:03.794706 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:08:03.794706 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 19:08:03.794706 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:08:03.794706 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:08:03.794706 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:08:03.794706 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:08:03.794706 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:08:03.794706 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:08:03.797052 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:08:03.797052 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:08:03.797052 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:08:03.797052 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:08:03.797052 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:08:03.797052 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:08:03.797052 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 19:08:03.797052 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 19:08:03.797052 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 19:08:03.797052 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 19:08:03.797052 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:08:03.797052 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:08:03.797052 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:08:03.797052 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:08:03.797052 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:08:03.797052 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:08:03.799051 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:08:03.799051 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( May 10 19:08:03.799051 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:08:03.799051 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() May 10 19:08:03.799051 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:08:03.799051 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:08:03.799051 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:08:03.799051 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() May 10 19:08:03.799051 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:08:03.799051 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( May 10 19:08:03.799051 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 19:08:03.799051 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 19:08:03.799051 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 10 19:08:03.799051 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:08:03.799051 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 390/775] 10.222.0.70 () {56 vars in 1111 bytes} [Tue May 10 19:08:03 2022] GET /identity/v3/services/network => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 19:08:03.806737 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f3e55b-8fef-4526-8cbe-12279ba0d312 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:03.868018 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a06144-65b7-4040-8697-9fcf1a24c8ad None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:03.905044 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6105a24-fa4e-4d39-a88d-8d4345c2a76b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:03.905713 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6105a24-fa4e-4d39-a88d-8d4345c2a76b None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:03.905995 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6105a24-fa4e-4d39-a88d-8d4345c2a76b None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:03.906269 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6105a24-fa4e-4d39-a88d-8d4345c2a76b None admin] PATH_INFO: `/v3/services` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:03.906936 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6105a24-fa4e-4d39-a88d-8d4345c2a76b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:03.910208 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6105a24-fa4e-4d39-a88d-8d4345c2a76b None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:03.929834 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 386/776] 10.222.0.70 () {56 vars in 1087 bytes} [Tue May 10 19:08:03 2022] GET /identity/v3/services => generated 772 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:08:04.010363 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f3e55b-8fef-4526-8cbe-12279ba0d312 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:04.058194 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ed83ff-e941-4047-a364-3d0fe5104cc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:04.058870 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ed83ff-e941-4047-a364-3d0fe5104cc5 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:04.059149 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ed83ff-e941-4047-a364-3d0fe5104cc5 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:04.059418 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ed83ff-e941-4047-a364-3d0fe5104cc5 None admin] PATH_INFO: `/v3/services` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:04.060127 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ed83ff-e941-4047-a364-3d0fe5104cc5 None admin] RBAC: Adding query filter params (name=network) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:08:04.060445 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ed83ff-e941-4047-a364-3d0fe5104cc5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:04.061838 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ed83ff-e941-4047-a364-3d0fe5104cc5 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:04.067185 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 391/777] 10.222.0.70 () {56 vars in 1112 bytes} [Tue May 10 19:08:03 2022] GET /identity/v3/services?name=network => generated 124 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:08:04.073544 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6105a24-fa4e-4d39-a88d-8d4345c2a76b None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:04.200163 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6105a24-fa4e-4d39-a88d-8d4345c2a76b None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:04.234878 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce16ce60-c55d-4e20-8b0a-089a18ab0579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:04.235554 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce16ce60-c55d-4e20-8b0a-089a18ab0579 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:04.235837 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce16ce60-c55d-4e20-8b0a-089a18ab0579 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:04.236113 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce16ce60-c55d-4e20-8b0a-089a18ab0579 None admin] PATH_INFO: `/v3/services` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:04.236921 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce16ce60-c55d-4e20-8b0a-089a18ab0579 None admin] RBAC: Adding query filter params (type=network) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:08:04.237231 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce16ce60-c55d-4e20-8b0a-089a18ab0579 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:04.238611 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce16ce60-c55d-4e20-8b0a-089a18ab0579 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:04.244531 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 387/778] 10.222.0.70 () {56 vars in 1112 bytes} [Tue May 10 19:08:04 2022] GET /identity/v3/services?type=network => generated 350 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:08:04.249822 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b547568d-bfd5-4618-bfdf-82d36d59107d None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:04.250337 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b547568d-bfd5-4618-bfdf-82d36d59107d None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:04.250416 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b547568d-bfd5-4618-bfdf-82d36d59107d None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:04.252010 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 392/779] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:08:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:08:04.253597 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce16ce60-c55d-4e20-8b0a-089a18ab0579 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:04.257803 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1674c704-6998-4ead-9afc-9c493b4dcf5c None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:04.258094 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1674c704-6998-4ead-9afc-9c493b4dcf5c None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:04.258376 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1674c704-6998-4ead-9afc-9c493b4dcf5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:04.297620 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-1674c704-6998-4ead-9afc-9c493b4dcf5c None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:08:04.298765 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-1674c704-6998-4ead-9afc-9c493b4dcf5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:08:04.357037 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce16ce60-c55d-4e20-8b0a-089a18ab0579 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:04.388829 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 393/780] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:08:04 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 19:08:04.405662 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015a0666-cd20-43b5-bda4-ff8cc176e588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:04.406439 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015a0666-cd20-43b5-bda4-ff8cc176e588 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:04.406724 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015a0666-cd20-43b5-bda4-ff8cc176e588 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:04.407002 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015a0666-cd20-43b5-bda4-ff8cc176e588 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:04.407807 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015a0666-cd20-43b5-bda4-ff8cc176e588 None admin] RBAC: Adding query filter params (interface=public, service_id=cc647d324637486287ffa829551ba0ee, region_id=RegionOne) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:08:04.408163 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015a0666-cd20-43b5-bda4-ff8cc176e588 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:04.410164 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015a0666-cd20-43b5-bda4-ff8cc176e588 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:04.412644 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1674c704-6998-4ead-9afc-9c493b4dcf5c None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:04.416530 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 388/781] 10.222.0.70 () {56 vars in 1251 bytes} [Tue May 10 19:08:04 2022] GET /identity/v3/endpoints?service_id=cc647d324637486287ffa829551ba0ee&interface=public®ion_id=RegionOne => generated 194 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:08:04.428758 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015a0666-cd20-43b5-bda4-ff8cc176e588 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:04.511665 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1674c704-6998-4ead-9afc-9c493b4dcf5c None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:04.538486 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015a0666-cd20-43b5-bda4-ff8cc176e588 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:04.546232 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77545a9c-791a-45cb-8650-17c23264d1c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:04.547325 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77545a9c-791a-45cb-8650-17c23264d1c3 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:04.547887 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77545a9c-791a-45cb-8650-17c23264d1c3 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:04.548355 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77545a9c-791a-45cb-8650-17c23264d1c3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:04.573359 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77545a9c-791a-45cb-8650-17c23264d1c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:08:04.578355 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cafb43-670d-48c6-b3a1-8bc33b20947b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:04.579273 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cafb43-670d-48c6-b3a1-8bc33b20947b None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:04.579568 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cafb43-670d-48c6-b3a1-8bc33b20947b None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:04.579849 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cafb43-670d-48c6-b3a1-8bc33b20947b None admin] PATH_INFO: `/v3/services` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:04.581356 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cafb43-670d-48c6-b3a1-8bc33b20947b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:04.582375 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-77545a9c-791a-45cb-8650-17c23264d1c3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 19:08:04.582375 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:08:04.582375 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:08:04.582375 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:08:04.582375 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:08:04.582375 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:08:04.582375 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:08:04.582375 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:08:04.582375 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:08:04.582375 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:08:04.582375 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:08:04.582375 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:08:04.582375 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:08:04.582375 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:08:04.582375 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:08:04.582375 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:08:04.583302 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:08:04.583302 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:08:04.583302 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:08:04.583302 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:08:04.583302 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:08:04.583302 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:08:04.583302 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:08:04.583302 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:08:04.583302 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:08:04.583302 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:08:04.583302 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:08:04.583302 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( May 10 19:08:04.583302 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:08:04.583302 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() May 10 19:08:04.583302 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:08:04.583302 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:08:04.584154 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:08:04.584154 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() May 10 19:08:04.584154 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:08:04.584154 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( May 10 19:08:04.584154 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:08:04.584154 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:08:04.584154 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:08:04.584154 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:08:04.584154 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:08:04.584154 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:08:04.584154 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 19:08:04.584154 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:08:04.585359 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cafb43-670d-48c6-b3a1-8bc33b20947b None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:04.585445 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 394/782] 10.222.0.70 () {56 vars in 1096 bytes} [Tue May 10 19:08:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 19:08:04.589216 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 389/783] 10.222.0.70 () {56 vars in 1087 bytes} [Tue May 10 19:08:04 2022] GET /identity/v3/services => generated 772 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:08:04.590035 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ed780b-7a4b-4427-ace4-cd5386ab6c64 None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:04.590196 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cafb43-670d-48c6-b3a1-8bc33b20947b None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:04.590361 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ed780b-7a4b-4427-ace4-cd5386ab6c64 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:04.590584 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ed780b-7a4b-4427-ace4-cd5386ab6c64 None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:04.592234 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 395/784] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:08:04 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:08:04.597947 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc576f3-2cc9-4d5c-a246-8d32ce800877 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:04.598215 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc576f3-2cc9-4d5c-a246-8d32ce800877 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:04.598489 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc576f3-2cc9-4d5c-a246-8d32ce800877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:04.616838 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-0cc576f3-2cc9-4d5c-a246-8d32ce800877 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:08:04.618044 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-0cc576f3-2cc9-4d5c-a246-8d32ce800877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:08:04.700452 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 396/785] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:08:04 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 19:08:04.717320 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cafb43-670d-48c6-b3a1-8bc33b20947b None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:04.735148 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc576f3-2cc9-4d5c-a246-8d32ce800877 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:04.760125 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce8eab2-6db5-4fd7-850a-9326e3c46d50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:04.760873 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce8eab2-6db5-4fd7-850a-9326e3c46d50 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:04.761157 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce8eab2-6db5-4fd7-850a-9326e3c46d50 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:04.761430 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce8eab2-6db5-4fd7-850a-9326e3c46d50 None admin] PATH_INFO: `/v3/roles` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:04.764727 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce8eab2-6db5-4fd7-850a-9326e3c46d50 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:08:04.765089 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce8eab2-6db5-4fd7-850a-9326e3c46d50 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:04.769368 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce8eab2-6db5-4fd7-850a-9326e3c46d50 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:04.787801 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 390/786] 10.222.0.70 () {56 vars in 1099 bytes} [Tue May 10 19:08:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:08:04.794252 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce8eab2-6db5-4fd7-850a-9326e3c46d50 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:04.902795 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc576f3-2cc9-4d5c-a246-8d32ce800877 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:04.928308 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce8eab2-6db5-4fd7-850a-9326e3c46d50 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:04.946676 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2dabb0-2338-4bd1-9838-ee4d52eb67ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:04.947494 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2dabb0-2338-4bd1-9838-ee4d52eb67ed None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:04.949765 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2dabb0-2338-4bd1-9838-ee4d52eb67ed None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:04.949765 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2dabb0-2338-4bd1-9838-ee4d52eb67ed None admin] PATH_INFO: `/v3/roles/service` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:04.960669 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2dabb0-2338-4bd1-9838-ee4d52eb67ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:08:04.971560 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-fb2dabb0-2338-4bd1-9838-ee4d52eb67ed None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 19:08:04.971560 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:08:04.971560 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:08:04.971560 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:08:04.971560 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:08:04.971560 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:08:04.971560 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:08:04.971560 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:08:04.971560 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:08:04.971560 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:08:04.971560 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:08:04.971560 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:08:04.971560 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:08:04.971560 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:08:04.971560 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:08:04.971560 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:08:04.972819 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:08:04.972819 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:08:04.972819 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:08:04.972819 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:08:04.972819 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:08:04.972819 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:08:04.972819 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:08:04.972819 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:08:04.972819 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:08:04.972819 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:08:04.972819 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:08:04.972819 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( May 10 19:08:04.972819 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:08:04.972819 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() May 10 19:08:04.972819 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:08:04.972819 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:08:04.973681 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:08:04.973681 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() May 10 19:08:04.973681 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:08:04.973681 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( May 10 19:08:04.973681 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:08:04.973681 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:08:04.973681 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:08:04.973681 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:08:04.973681 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:08:04.973681 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:08:04.973681 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 19:08:04.973681 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:08:04.973681 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 397/787] 10.222.0.70 () {56 vars in 1102 bytes} [Tue May 10 19:08:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:08:04.978378 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa446ea9-c818-4094-a2d8-2f6a733736ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:04.978757 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2dabb0-2338-4bd1-9838-ee4d52eb67ed None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:04.988451 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa446ea9-c818-4094-a2d8-2f6a733736ec None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:04.988451 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa446ea9-c818-4094-a2d8-2f6a733736ec None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:04.988451 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa446ea9-c818-4094-a2d8-2f6a733736ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:05.002709 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa446ea9-c818-4094-a2d8-2f6a733736ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:05.004229 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa446ea9-c818-4094-a2d8-2f6a733736ec None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:05.021429 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application [None req-fa446ea9-c818-4094-a2d8-2f6a733736ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:08:05.021429 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:08:05.021429 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:08:05.021429 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:08:05.021429 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:08:05.021429 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:08:05.021429 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:08:05.021429 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:08:05.021429 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:08:05.021429 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:08:05.021429 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:08:05.021429 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:08:05.021429 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 19:08:05.021429 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 19:08:05.021429 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 19:08:05.022383 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 19:08:05.022383 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:08:05.022383 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:08:05.022383 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:08:05.022383 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:08:05.022383 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:08:05.022383 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:08:05.022383 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:08:05.022383 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application with Lock( May 10 19:08:05.022383 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:08:05.022383 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._enter() May 10 19:08:05.022383 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:08:05.022383 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:08:05.022383 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:08:05.022383 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.creator() May 10 19:08:05.022383 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:08:05.022383 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application created_value = creator( May 10 19:08:05.023389 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 19:08:05.023389 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 19:08:05.023389 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:08:05.023389 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application May 10 19:08:05.023389 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 391/788] 10.222.0.70 () {56 vars in 1108 bytes} [Tue May 10 19:08:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:08:05.029730 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa446ea9-c818-4094-a2d8-2f6a733736ec None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:05.145824 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2dabb0-2338-4bd1-9838-ee4d52eb67ed None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:05.178779 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa446ea9-c818-4094-a2d8-2f6a733736ec None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:05.202621 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1944219a-6aae-44c1-9729-890614d73f9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:05.203358 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1944219a-6aae-44c1-9729-890614d73f9f None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:05.203641 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1944219a-6aae-44c1-9729-890614d73f9f None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:05.203911 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1944219a-6aae-44c1-9729-890614d73f9f None admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:05.204743 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1944219a-6aae-44c1-9729-890614d73f9f None admin] RBAC: Adding query filter params (name=service) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:08:05.205087 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1944219a-6aae-44c1-9729-890614d73f9f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:05.206529 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1944219a-6aae-44c1-9729-890614d73f9f None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:05.214153 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e286623-482a-42c3-89d5-f696ab24a60e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:05.215113 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e286623-482a-42c3-89d5-f696ab24a60e None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:05.215593 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e286623-482a-42c3-89d5-f696ab24a60e None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:05.216084 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e286623-482a-42c3-89d5-f696ab24a60e None admin] PATH_INFO: `/v3/domains` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:05.217040 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e286623-482a-42c3-89d5-f696ab24a60e None admin] RBAC: Adding query filter params (name=Default) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:08:05.217540 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e286623-482a-42c3-89d5-f696ab24a60e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:05.219117 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e286623-482a-42c3-89d5-f696ab24a60e None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:05.223662 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 398/789] 10.222.0.70 () {56 vars in 1103 bytes} [Tue May 10 19:08:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:08:05.228829 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1944219a-6aae-44c1-9729-890614d73f9f None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:05.233039 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 392/790] 10.222.0.70 () {56 vars in 1109 bytes} [Tue May 10 19:08:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:08:05.238933 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e286623-482a-42c3-89d5-f696ab24a60e None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:05.418286 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e286623-482a-42c3-89d5-f696ab24a60e None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:05.430973 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1944219a-6aae-44c1-9729-890614d73f9f None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:05.493497 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04bd42e-5beb-4f4d-bd3e-cb1b9b4d5a00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:05.495449 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04bd42e-5beb-4f4d-bd3e-cb1b9b4d5a00 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:05.496459 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04bd42e-5beb-4f4d-bd3e-cb1b9b4d5a00 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:05.497356 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04bd42e-5beb-4f4d-bd3e-cb1b9b4d5a00 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:05.499631 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb72de3-b0a9-4b0e-b829-269b610d4510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:05.501183 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb72de3-b0a9-4b0e-b829-269b610d4510 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:05.503732 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb72de3-b0a9-4b0e-b829-269b610d4510 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:05.504237 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb72de3-b0a9-4b0e-b829-269b610d4510 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:05.510728 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04bd42e-5beb-4f4d-bd3e-cb1b9b4d5a00 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:05.513169 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04bd42e-5beb-4f4d-bd3e-cb1b9b4d5a00 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:05.527805 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb72de3-b0a9-4b0e-b829-269b610d4510 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:05.529590 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb72de3-b0a9-4b0e-b829-269b610d4510 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:05.538458 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application [None req-a04bd42e-5beb-4f4d-bd3e-cb1b9b4d5a00 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 10 19:08:05.538458 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:08:05.538458 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:08:05.538458 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:08:05.538458 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:08:05.538458 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:08:05.538458 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:08:05.538458 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:08:05.538458 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:08:05.538458 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:08:05.538458 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:08:05.538458 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:08:05.538458 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 19:08:05.538458 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 19:08:05.538458 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 19:08:05.538458 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 19:08:05.539426 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:08:05.539426 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:08:05.539426 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 19:08:05.539426 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 19:08:05.539426 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 19:08:05.539426 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 19:08:05.539426 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:08:05.539426 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:08:05.539426 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:08:05.539426 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:08:05.539426 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:08:05.539426 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application with Lock( May 10 19:08:05.539426 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:08:05.539426 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._enter() May 10 19:08:05.539426 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:08:05.539426 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:08:05.539426 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:08:05.539426 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.creator() May 10 19:08:05.540456 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:08:05.540456 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application created_value = creator( May 10 19:08:05.540456 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 19:08:05.540456 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 19:08:05.540456 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 19:08:05.540456 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 19:08:05.540456 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 19:08:05.540456 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 19:08:05.540456 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 10 19:08:05.540456 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application May 10 19:08:05.550060 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 393/791] 10.222.0.70 () {56 vars in 1093 bytes} [Tue May 10 19:08:05 2022] GET /identity/v3/users/nova => generated 82 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:08:05.555168 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04bd42e-5beb-4f4d-bd3e-cb1b9b4d5a00 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:05.558969 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-6eb72de3-b0a9-4b0e-b829-269b610d4510 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:08:05.558969 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:08:05.558969 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:08:05.558969 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:08:05.558969 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:08:05.558969 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:08:05.558969 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:08:05.558969 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:08:05.558969 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:08:05.558969 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:08:05.558969 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:08:05.558969 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:08:05.558969 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 19:08:05.558969 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 19:08:05.558969 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 19:08:05.560062 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 19:08:05.560062 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:08:05.560062 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:08:05.560062 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:08:05.560062 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:08:05.560062 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:08:05.560062 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:08:05.560062 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:08:05.560062 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( May 10 19:08:05.560062 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:08:05.560062 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() May 10 19:08:05.560062 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:08:05.560062 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:08:05.560062 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:08:05.560062 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() May 10 19:08:05.560062 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:08:05.560062 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( May 10 19:08:05.561228 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 19:08:05.561228 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 19:08:05.561228 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:08:05.561228 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:08:05.563196 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 399/792] 10.222.0.70 () {56 vars in 1108 bytes} [Tue May 10 19:08:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 19:08:05.568822 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb72de3-b0a9-4b0e-b829-269b610d4510 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:05.690966 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04bd42e-5beb-4f4d-bd3e-cb1b9b4d5a00 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:05.704937 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb72de3-b0a9-4b0e-b829-269b610d4510 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:05.729916 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c351cddf-a88f-4107-aa0f-1b12d8217510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:05.730875 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c351cddf-a88f-4107-aa0f-1b12d8217510 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:05.731310 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c351cddf-a88f-4107-aa0f-1b12d8217510 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:05.731735 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c351cddf-a88f-4107-aa0f-1b12d8217510 None admin] PATH_INFO: `/v3/users` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:05.732755 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c351cddf-a88f-4107-aa0f-1b12d8217510 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:08:05.733211 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c351cddf-a88f-4107-aa0f-1b12d8217510 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:05.734817 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c351cddf-a88f-4107-aa0f-1b12d8217510 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:05.748094 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2460642-2342-48fe-be76-aba77f657f06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:05.748975 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2460642-2342-48fe-be76-aba77f657f06 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:05.749410 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2460642-2342-48fe-be76-aba77f657f06 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:05.749832 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2460642-2342-48fe-be76-aba77f657f06 None admin] PATH_INFO: `/v3/domains` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:05.750782 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2460642-2342-48fe-be76-aba77f657f06 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:08:05.751235 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2460642-2342-48fe-be76-aba77f657f06 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:05.753296 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2460642-2342-48fe-be76-aba77f657f06 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:05.756562 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 394/793] 10.222.0.70 () {56 vars in 1133 bytes} [Tue May 10 19:08:05 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:08:05.758036 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29c8160-6c6c-4428-aee1-d2d8780e2c64 None None] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:05.758491 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29c8160-6c6c-4428-aee1-d2d8780e2c64 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:05.758912 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29c8160-6c6c-4428-aee1-d2d8780e2c64 None None] PATH_INFO: `/` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:05.765161 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 395/794] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:08:05 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:08:05.766120 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29c8160-6c6c-4428-aee1-d2d8780e2c64 None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:05.771901 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 400/795] 10.222.0.70 () {56 vars in 1109 bytes} [Tue May 10 19:08:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:08:05.777343 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147dc1f2-b389-400c-b62b-6df53c3c6fed None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:05.777796 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147dc1f2-b389-400c-b62b-6df53c3c6fed None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:05.778240 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147dc1f2-b389-400c-b62b-6df53c3c6fed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:05.795777 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-147dc1f2-b389-400c-b62b-6df53c3c6fed None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:08:05.797245 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-147dc1f2-b389-400c-b62b-6df53c3c6fed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:08:05.863556 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 401/796] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:08:05 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 19:08:05.864726 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147dc1f2-b389-400c-b62b-6df53c3c6fed None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:05.906359 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29c8160-6c6c-4428-aee1-d2d8780e2c64 None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:05.949885 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b68e6ca-2645-425e-8cce-56e931f411c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:05.950690 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b68e6ca-2645-425e-8cce-56e931f411c8 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:05.950981 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b68e6ca-2645-425e-8cce-56e931f411c8 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:05.951246 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b68e6ca-2645-425e-8cce-56e931f411c8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:05.988333 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147dc1f2-b389-400c-b62b-6df53c3c6fed None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:06.023157 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc4f528-db81-47f5-a9fd-5348b05ef842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:06.024346 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc4f528-db81-47f5-a9fd-5348b05ef842 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:06.024908 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc4f528-db81-47f5-a9fd-5348b05ef842 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:06.025429 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc4f528-db81-47f5-a9fd-5348b05ef842 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:06.033078 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc4f528-db81-47f5-a9fd-5348b05ef842 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:06.034179 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b68e6ca-2645-425e-8cce-56e931f411c8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:06.035559 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc4f528-db81-47f5-a9fd-5348b05ef842 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:06.035672 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b68e6ca-2645-425e-8cce-56e931f411c8 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:06.051212 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-3fc4f528-db81-47f5-a9fd-5348b05ef842 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 10 19:08:06.051212 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:08:06.051212 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:08:06.051212 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:08:06.051212 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:08:06.051212 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:08:06.051212 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:08:06.051212 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:08:06.051212 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:08:06.051212 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:08:06.051212 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:08:06.051212 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:08:06.051212 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 19:08:06.051212 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 19:08:06.051212 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 19:08:06.051212 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 19:08:06.052202 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:08:06.052202 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:08:06.052202 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 19:08:06.052202 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 19:08:06.052202 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 19:08:06.052202 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 19:08:06.052202 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:08:06.052202 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:08:06.052202 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:08:06.052202 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:08:06.052202 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:08:06.052202 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( May 10 19:08:06.052202 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:08:06.052202 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() May 10 19:08:06.052202 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:08:06.052202 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:08:06.052202 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:08:06.052202 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() May 10 19:08:06.053288 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:08:06.053288 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( May 10 19:08:06.053288 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 19:08:06.053288 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 19:08:06.053288 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 19:08:06.053288 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 19:08:06.053288 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 19:08:06.053288 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 19:08:06.053288 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 10 19:08:06.053288 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:08:06.055568 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 402/797] 10.222.0.70 () {56 vars in 1117 bytes} [Tue May 10 19:08:05 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:08:06.056565 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc4f528-db81-47f5-a9fd-5348b05ef842 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:06.152594 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 396/798] 10.222.0.70 () {58 vars in 1282 bytes} [Tue May 10 19:08:05 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 19:08:06.153737 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b68e6ca-2645-425e-8cce-56e931f411c8 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:06.177816 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc4f528-db81-47f5-a9fd-5348b05ef842 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:06.220299 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335800a1-8f14-4278-af2f-972b7435107c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:06.221116 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335800a1-8f14-4278-af2f-972b7435107c None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:06.221400 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335800a1-8f14-4278-af2f-972b7435107c None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:06.221673 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335800a1-8f14-4278-af2f-972b7435107c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:06.234280 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335800a1-8f14-4278-af2f-972b7435107c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:08:06.242721 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-335800a1-8f14-4278-af2f-972b7435107c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 19:08:06.242721 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:08:06.242721 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:08:06.242721 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:08:06.242721 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:08:06.242721 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:08:06.242721 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:08:06.242721 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:08:06.242721 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:08:06.242721 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:08:06.242721 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:08:06.242721 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:08:06.242721 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:08:06.242721 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:08:06.242721 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:08:06.242721 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:08:06.243680 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:08:06.243680 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:08:06.243680 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:08:06.243680 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:08:06.243680 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:08:06.243680 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:08:06.243680 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:08:06.243680 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:08:06.243680 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:08:06.243680 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:08:06.243680 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:08:06.243680 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( May 10 19:08:06.243680 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:08:06.243680 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() May 10 19:08:06.243680 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:08:06.243680 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:08:06.244585 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:08:06.244585 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() May 10 19:08:06.244585 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:08:06.244585 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( May 10 19:08:06.244585 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:08:06.244585 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:08:06.244585 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:08:06.244585 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:08:06.244585 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:08:06.244585 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:08:06.244585 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 19:08:06.244585 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:08:06.247402 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 403/799] 10.222.0.70 () {56 vars in 1096 bytes} [Tue May 10 19:08:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:08:06.248410 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335800a1-8f14-4278-af2f-972b7435107c None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:06.264382 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b68e6ca-2645-425e-8cce-56e931f411c8 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:06.307750 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8cfa6f-d189-4e43-b10d-3b7063defd29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:06.308721 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8cfa6f-d189-4e43-b10d-3b7063defd29 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:06.309017 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8cfa6f-d189-4e43-b10d-3b7063defd29 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:06.309293 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8cfa6f-d189-4e43-b10d-3b7063defd29 None admin] PATH_INFO: `/v3/users` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:06.310324 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8cfa6f-d189-4e43-b10d-3b7063defd29 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:08:06.310652 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8cfa6f-d189-4e43-b10d-3b7063defd29 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:06.312686 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8cfa6f-d189-4e43-b10d-3b7063defd29 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:06.336522 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 397/800] 10.222.0.70 () {56 vars in 1149 bytes} [Tue May 10 19:08:06 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:08:06.337655 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8cfa6f-d189-4e43-b10d-3b7063defd29 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:06.354001 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335800a1-8f14-4278-af2f-972b7435107c None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:06.390765 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da13b503-e648-4a1f-916a-d32b293cc734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:06.391902 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da13b503-e648-4a1f-916a-d32b293cc734 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:06.392365 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da13b503-e648-4a1f-916a-d32b293cc734 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:06.393385 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da13b503-e648-4a1f-916a-d32b293cc734 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:06.404470 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da13b503-e648-4a1f-916a-d32b293cc734 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:06.406195 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da13b503-e648-4a1f-916a-d32b293cc734 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:06.423637 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-da13b503-e648-4a1f-916a-d32b293cc734 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:08:06.423637 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:08:06.423637 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:08:06.423637 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:08:06.423637 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:08:06.423637 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:08:06.423637 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:08:06.423637 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:08:06.423637 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:08:06.423637 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:08:06.423637 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:08:06.423637 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:08:06.423637 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 19:08:06.423637 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 19:08:06.423637 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 19:08:06.424653 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 19:08:06.424653 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:08:06.424653 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:08:06.424653 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:08:06.424653 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:08:06.424653 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:08:06.424653 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:08:06.424653 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:08:06.424653 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( May 10 19:08:06.424653 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:08:06.424653 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() May 10 19:08:06.424653 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:08:06.424653 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:08:06.424653 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:08:06.424653 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() May 10 19:08:06.424653 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:08:06.424653 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( May 10 19:08:06.425616 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 19:08:06.425616 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 19:08:06.425616 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:08:06.425616 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:08:06.427607 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 404/801] 10.222.0.70 () {56 vars in 1108 bytes} [Tue May 10 19:08:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:08:06.428626 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da13b503-e648-4a1f-916a-d32b293cc734 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:06.456383 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8cfa6f-d189-4e43-b10d-3b7063defd29 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:06.493168 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefbb5c2-c244-44e0-9045-dec2cc1aaeb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:06.494288 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefbb5c2-c244-44e0-9045-dec2cc1aaeb7 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:06.495486 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefbb5c2-c244-44e0-9045-dec2cc1aaeb7 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:06.496198 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefbb5c2-c244-44e0-9045-dec2cc1aaeb7 None admin] PATH_INFO: `/v3/roles` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:06.497329 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefbb5c2-c244-44e0-9045-dec2cc1aaeb7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:08:06.498127 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefbb5c2-c244-44e0-9045-dec2cc1aaeb7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:06.499945 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefbb5c2-c244-44e0-9045-dec2cc1aaeb7 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:06.511825 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 398/802] 10.222.0.70 () {56 vars in 1099 bytes} [Tue May 10 19:08:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:08:06.513307 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefbb5c2-c244-44e0-9045-dec2cc1aaeb7 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:06.539411 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da13b503-e648-4a1f-916a-d32b293cc734 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:06.573236 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34326e7d-8ed5-4dd8-afbe-c561e0111b16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:06.574037 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34326e7d-8ed5-4dd8-afbe-c561e0111b16 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:06.574318 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34326e7d-8ed5-4dd8-afbe-c561e0111b16 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:06.574591 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34326e7d-8ed5-4dd8-afbe-c561e0111b16 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:06.585845 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34326e7d-8ed5-4dd8-afbe-c561e0111b16 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:06.587295 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34326e7d-8ed5-4dd8-afbe-c561e0111b16 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:06.605100 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-34326e7d-8ed5-4dd8-afbe-c561e0111b16 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:08:06.605100 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:08:06.605100 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:08:06.605100 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:08:06.605100 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:08:06.605100 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:08:06.605100 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:08:06.605100 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:08:06.605100 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:08:06.605100 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:08:06.605100 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:08:06.605100 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:08:06.605100 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 19:08:06.605100 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 19:08:06.605100 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 19:08:06.606076 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 19:08:06.606076 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:08:06.606076 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:08:06.606076 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:08:06.606076 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:08:06.606076 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:08:06.606076 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:08:06.606076 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:08:06.606076 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( May 10 19:08:06.606076 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:08:06.606076 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() May 10 19:08:06.606076 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:08:06.606076 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:08:06.606076 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:08:06.606076 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() May 10 19:08:06.606076 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:08:06.606076 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( May 10 19:08:06.607024 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 19:08:06.607024 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 19:08:06.607024 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:08:06.607024 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:08:06.610656 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 405/803] 10.222.0.70 () {56 vars in 1108 bytes} [Tue May 10 19:08:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:08:06.611569 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34326e7d-8ed5-4dd8-afbe-c561e0111b16 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:06.640942 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefbb5c2-c244-44e0-9045-dec2cc1aaeb7 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:06.677483 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e09e3b-273d-4aa4-b8dc-d6af8eb08488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:06.678177 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e09e3b-273d-4aa4-b8dc-d6af8eb08488 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:06.678459 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e09e3b-273d-4aa4-b8dc-d6af8eb08488 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:06.678734 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e09e3b-273d-4aa4-b8dc-d6af8eb08488 None admin] PATH_INFO: `/v3/domains` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:06.679466 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e09e3b-273d-4aa4-b8dc-d6af8eb08488 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:08:06.679772 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e09e3b-273d-4aa4-b8dc-d6af8eb08488 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:06.681232 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e09e3b-273d-4aa4-b8dc-d6af8eb08488 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:06.699023 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 399/804] 10.222.0.70 () {56 vars in 1109 bytes} [Tue May 10 19:08:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:08:06.699959 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e09e3b-273d-4aa4-b8dc-d6af8eb08488 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:06.733774 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34326e7d-8ed5-4dd8-afbe-c561e0111b16 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:06.768098 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4188a8b3-0c1b-43f5-a0a3-6dfa8ab2fe32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:06.768852 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4188a8b3-0c1b-43f5-a0a3-6dfa8ab2fe32 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:06.769134 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4188a8b3-0c1b-43f5-a0a3-6dfa8ab2fe32 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:06.769406 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4188a8b3-0c1b-43f5-a0a3-6dfa8ab2fe32 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:06.780959 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4188a8b3-0c1b-43f5-a0a3-6dfa8ab2fe32 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:06.782396 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4188a8b3-0c1b-43f5-a0a3-6dfa8ab2fe32 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:06.799870 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-4188a8b3-0c1b-43f5-a0a3-6dfa8ab2fe32 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:08:06.799870 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:08:06.799870 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:08:06.799870 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:08:06.799870 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:08:06.799870 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:08:06.799870 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:08:06.799870 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:08:06.799870 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:08:06.799870 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:08:06.799870 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:08:06.799870 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:08:06.799870 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 19:08:06.799870 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 19:08:06.799870 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 19:08:06.801058 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 19:08:06.801058 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:08:06.801058 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:08:06.801058 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:08:06.801058 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:08:06.801058 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:08:06.801058 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:08:06.801058 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:08:06.801058 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( May 10 19:08:06.801058 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:08:06.801058 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() May 10 19:08:06.801058 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:08:06.801058 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:08:06.801058 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:08:06.801058 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() May 10 19:08:06.801058 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:08:06.801058 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( May 10 19:08:06.802198 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 19:08:06.802198 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 19:08:06.802198 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:08:06.802198 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:08:06.805757 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 406/805] 10.222.0.70 () {56 vars in 1108 bytes} [Tue May 10 19:08:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:08:06.806614 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4188a8b3-0c1b-43f5-a0a3-6dfa8ab2fe32 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:06.819067 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e09e3b-273d-4aa4-b8dc-d6af8eb08488 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:06.853738 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aff83e3-dfee-4c1c-8acd-e96020bf8080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:06.854408 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aff83e3-dfee-4c1c-8acd-e96020bf8080 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:06.854691 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aff83e3-dfee-4c1c-8acd-e96020bf8080 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:06.854964 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aff83e3-dfee-4c1c-8acd-e96020bf8080 None admin] PATH_INFO: `/v3/domains` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:06.855680 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aff83e3-dfee-4c1c-8acd-e96020bf8080 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:08:06.855982 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aff83e3-dfee-4c1c-8acd-e96020bf8080 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:06.857414 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aff83e3-dfee-4c1c-8acd-e96020bf8080 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:06.869961 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 400/806] 10.222.0.70 () {56 vars in 1109 bytes} [Tue May 10 19:08:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:08:06.870721 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aff83e3-dfee-4c1c-8acd-e96020bf8080 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:06.921612 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4188a8b3-0c1b-43f5-a0a3-6dfa8ab2fe32 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:06.954632 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993b33d5-1482-43f1-ad00-561cc2d9cb2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:06.956059 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993b33d5-1482-43f1-ad00-561cc2d9cb2e None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:06.956404 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993b33d5-1482-43f1-ad00-561cc2d9cb2e None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:06.957023 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993b33d5-1482-43f1-ad00-561cc2d9cb2e None admin] PATH_INFO: `/v3/projects/service` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:06.966531 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993b33d5-1482-43f1-ad00-561cc2d9cb2e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:06.967978 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993b33d5-1482-43f1-ad00-561cc2d9cb2e None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:06.982710 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-993b33d5-1482-43f1-ad00-561cc2d9cb2e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 19:08:06.982710 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:08:06.982710 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:08:06.982710 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:08:06.982710 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:08:06.982710 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:08:06.982710 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:08:06.982710 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:08:06.982710 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:08:06.982710 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:08:06.982710 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:08:06.982710 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:08:06.982710 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 19:08:06.982710 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 19:08:06.982710 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 19:08:06.983801 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 19:08:06.983801 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:08:06.983801 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:08:06.983801 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:08:06.983801 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:08:06.983801 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:08:06.983801 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:08:06.983801 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:08:06.983801 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( May 10 19:08:06.983801 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:08:06.983801 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() May 10 19:08:06.983801 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:08:06.983801 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:08:06.983801 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:08:06.983801 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() May 10 19:08:06.983801 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:08:06.983801 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( May 10 19:08:06.984726 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 19:08:06.984726 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 19:08:06.984726 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 19:08:06.984726 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 19:08:06.984726 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 19:08:06.984726 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 19:08:06.984726 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 19:08:06.984726 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:08:06.984726 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 407/807] 10.222.0.70 () {56 vars in 1111 bytes} [Tue May 10 19:08:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:08:06.985224 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2775458b-054e-4b15-bf83-e7349497f5de None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:06.985717 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2775458b-054e-4b15-bf83-e7349497f5de None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:06.985822 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2775458b-054e-4b15-bf83-e7349497f5de None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:06.987194 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 408/808] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:08:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:08:06.989427 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2775458b-054e-4b15-bf83-e7349497f5de None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:06.993496 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aff83e3-dfee-4c1c-8acd-e96020bf8080 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:07.026145 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759d3f19-8dd8-411e-a6f1-4ec97554e30d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:07.026762 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759d3f19-8dd8-411e-a6f1-4ec97554e30d None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:07.027049 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759d3f19-8dd8-411e-a6f1-4ec97554e30d None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:07.027322 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759d3f19-8dd8-411e-a6f1-4ec97554e30d None admin] PATH_INFO: `/v3/domains` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:07.028033 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759d3f19-8dd8-411e-a6f1-4ec97554e30d None admin] RBAC: Adding query filter params (name=Default) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:08:07.028333 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759d3f19-8dd8-411e-a6f1-4ec97554e30d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:07.030084 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759d3f19-8dd8-411e-a6f1-4ec97554e30d None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:07.044491 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 401/809] 10.222.0.70 () {56 vars in 1109 bytes} [Tue May 10 19:08:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:08:07.044491 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759d3f19-8dd8-411e-a6f1-4ec97554e30d None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:07.095504 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2775458b-054e-4b15-bf83-e7349497f5de None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:07.126607 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e19545-1089-4d66-a7d6-f257781cce5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:07.127439 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e19545-1089-4d66-a7d6-f257781cce5d None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:07.127752 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e19545-1089-4d66-a7d6-f257781cce5d None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:07.128022 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e19545-1089-4d66-a7d6-f257781cce5d None admin] PATH_INFO: `/v3/projects/service` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:07.134516 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e19545-1089-4d66-a7d6-f257781cce5d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:07.135932 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e19545-1089-4d66-a7d6-f257781cce5d None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:07.139298 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759d3f19-8dd8-411e-a6f1-4ec97554e30d None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:07.149524 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-17e19545-1089-4d66-a7d6-f257781cce5d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 19:08:07.149524 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:08:07.149524 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:08:07.149524 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:08:07.149524 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:08:07.149524 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:08:07.149524 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:08:07.149524 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:08:07.149524 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:08:07.149524 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:08:07.149524 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:08:07.149524 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:08:07.149524 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 19:08:07.149524 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 19:08:07.149524 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 19:08:07.150588 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 19:08:07.150588 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:08:07.150588 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:08:07.150588 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:08:07.150588 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:08:07.150588 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:08:07.150588 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:08:07.150588 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:08:07.150588 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( May 10 19:08:07.150588 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:08:07.150588 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() May 10 19:08:07.150588 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:08:07.150588 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:08:07.150588 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:08:07.150588 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() May 10 19:08:07.150588 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:08:07.150588 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( May 10 19:08:07.151608 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 19:08:07.151608 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 19:08:07.151608 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 19:08:07.151608 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 19:08:07.151608 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 19:08:07.151608 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 19:08:07.151608 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 19:08:07.151608 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:08:07.151608 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 409/810] 10.222.0.70 () {56 vars in 1111 bytes} [Tue May 10 19:08:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:08:07.152178 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a77f079-3234-43b0-bd7c-514155837163 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:07.152387 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a77f079-3234-43b0-bd7c-514155837163 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:07.152707 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a77f079-3234-43b0-bd7c-514155837163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:07.168560 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-5a77f079-3234-43b0-bd7c-514155837163 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:08:07.169710 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-5a77f079-3234-43b0-bd7c-514155837163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:08:07.176802 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971f8792-50f9-433a-89ea-7c42e104f1ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:07.177459 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971f8792-50f9-433a-89ea-7c42e104f1ed None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:07.177740 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971f8792-50f9-433a-89ea-7c42e104f1ed None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:07.178017 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971f8792-50f9-433a-89ea-7c42e104f1ed None admin] PATH_INFO: `/v3/projects` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:07.178789 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971f8792-50f9-433a-89ea-7c42e104f1ed None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:08:07.179094 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971f8792-50f9-433a-89ea-7c42e104f1ed None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:07.180536 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971f8792-50f9-433a-89ea-7c42e104f1ed None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:07.191888 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 402/811] 10.222.0.70 () {56 vars in 1148 bytes} [Tue May 10 19:08:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:08:07.192747 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971f8792-50f9-433a-89ea-7c42e104f1ed None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:07.239023 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 410/812] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:08:07 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 19:08:07.240401 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faaac2f-0c82-4016-9f34-4f707447a510 None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:07.240725 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faaac2f-0c82-4016-9f34-4f707447a510 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:07.240990 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faaac2f-0c82-4016-9f34-4f707447a510 None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:07.243700 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 411/813] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:08:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:08:07.244694 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faaac2f-0c82-4016-9f34-4f707447a510 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:07.287508 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971f8792-50f9-433a-89ea-7c42e104f1ed None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:07.318708 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c24fecb-d7ab-434c-ac7b-14b0706d2fd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:07.319494 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c24fecb-d7ab-434c-ac7b-14b0706d2fd3 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:07.319783 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c24fecb-d7ab-434c-ac7b-14b0706d2fd3 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:07.320059 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c24fecb-d7ab-434c-ac7b-14b0706d2fd3 None admin] PATH_INFO: `/v3/users/swift` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:07.327217 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c24fecb-d7ab-434c-ac7b-14b0706d2fd3 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:07.328679 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c24fecb-d7ab-434c-ac7b-14b0706d2fd3 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:07.341731 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faaac2f-0c82-4016-9f34-4f707447a510 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:07.342859 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application [None req-0c24fecb-d7ab-434c-ac7b-14b0706d2fd3 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 10 19:08:07.342859 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:08:07.342859 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:08:07.342859 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:08:07.342859 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:08:07.342859 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:08:07.342859 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:08:07.342859 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:08:07.342859 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:08:07.342859 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:08:07.342859 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:08:07.342859 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:08:07.342859 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 19:08:07.342859 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 19:08:07.342859 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 19:08:07.342859 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 19:08:07.343974 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:08:07.343974 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:08:07.343974 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 19:08:07.343974 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 19:08:07.343974 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 19:08:07.343974 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 19:08:07.343974 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:08:07.343974 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:08:07.343974 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:08:07.343974 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:08:07.343974 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:08:07.343974 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application with Lock( May 10 19:08:07.343974 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:08:07.343974 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._enter() May 10 19:08:07.343974 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:08:07.343974 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:08:07.343974 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:08:07.343974 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.creator() May 10 19:08:07.349791 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:08:07.349791 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application created_value = creator( May 10 19:08:07.349791 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 19:08:07.349791 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 19:08:07.349791 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 19:08:07.349791 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 19:08:07.349791 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 19:08:07.349791 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 19:08:07.349791 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 10 19:08:07.349791 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application May 10 19:08:07.349791 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 403/814] 10.222.0.70 () {56 vars in 1096 bytes} [Tue May 10 19:08:07 2022] GET /identity/v3/users/swift => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:08:07.349791 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c24fecb-d7ab-434c-ac7b-14b0706d2fd3 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:07.373697 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e0e64b-5f7d-4ff0-84e3-c58848242a2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:07.374350 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e0e64b-5f7d-4ff0-84e3-c58848242a2a None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:07.374631 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e0e64b-5f7d-4ff0-84e3-c58848242a2a None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:07.374903 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e0e64b-5f7d-4ff0-84e3-c58848242a2a None admin] PATH_INFO: `/v3/projects` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:07.375678 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e0e64b-5f7d-4ff0-84e3-c58848242a2a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:08:07.375986 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e0e64b-5f7d-4ff0-84e3-c58848242a2a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:07.377940 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e0e64b-5f7d-4ff0-84e3-c58848242a2a None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:07.394318 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 412/815] 10.222.0.70 () {56 vars in 1148 bytes} [Tue May 10 19:08:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:08:07.394318 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308571bc-b15e-40df-b25f-8c5b57fb34f2 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:07.394318 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308571bc-b15e-40df-b25f-8c5b57fb34f2 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:07.394318 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308571bc-b15e-40df-b25f-8c5b57fb34f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:07.407821 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-308571bc-b15e-40df-b25f-8c5b57fb34f2 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:08:07.409020 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-308571bc-b15e-40df-b25f-8c5b57fb34f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:08:07.441066 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c24fecb-d7ab-434c-ac7b-14b0706d2fd3 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:07.469979 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 413/816] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:08:07 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 19:08:07.471286 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308571bc-b15e-40df-b25f-8c5b57fb34f2 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:07.472309 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe37f7f-9227-4d62-9eee-53f95d7f9e7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:07.472979 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe37f7f-9227-4d62-9eee-53f95d7f9e7d None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:07.473265 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe37f7f-9227-4d62-9eee-53f95d7f9e7d None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:07.473537 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe37f7f-9227-4d62-9eee-53f95d7f9e7d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:07.474352 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe37f7f-9227-4d62-9eee-53f95d7f9e7d None admin] RBAC: Adding query filter params (role.id=634ba284303b4626b5a0402772c68f5c, scope.project.id=2ee9ec5b515440fe9b39aedf3e339c79, user.id=b9f310a468ec4058b3c95356ea60ab4c) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:08:07.474658 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe37f7f-9227-4d62-9eee-53f95d7f9e7d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:07.476076 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe37f7f-9227-4d62-9eee-53f95d7f9e7d None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:07.481835 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 404/817] 10.222.0.70 () {56 vars in 1374 bytes} [Tue May 10 19:08:07 2022] GET /identity/v3/role_assignments?user.id=b9f310a468ec4058b3c95356ea60ab4c&scope.project.id=2ee9ec5b515440fe9b39aedf3e339c79&role.id=634ba284303b4626b5a0402772c68f5c => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:08:07.482608 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe37f7f-9227-4d62-9eee-53f95d7f9e7d None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:07.586304 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308571bc-b15e-40df-b25f-8c5b57fb34f2 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:07.597649 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe37f7f-9227-4d62-9eee-53f95d7f9e7d None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:07.621919 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecc8a4a-5e91-49cf-8b65-8a2430349204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:07.622878 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecc8a4a-5e91-49cf-8b65-8a2430349204 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:07.623164 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecc8a4a-5e91-49cf-8b65-8a2430349204 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:07.623436 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecc8a4a-5e91-49cf-8b65-8a2430349204 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:07.624104 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecc8a4a-5e91-49cf-8b65-8a2430349204 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:07.625535 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecc8a4a-5e91-49cf-8b65-8a2430349204 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:07.633081 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f11f2d-71cd-446e-b7a0-ecfdc9e323a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:07.633768 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f11f2d-71cd-446e-b7a0-ecfdc9e323a3 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:07.634055 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f11f2d-71cd-446e-b7a0-ecfdc9e323a3 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:07.634334 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f11f2d-71cd-446e-b7a0-ecfdc9e323a3 None admin] PATH_INFO: `/v3/users` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:07.635182 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f11f2d-71cd-446e-b7a0-ecfdc9e323a3 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:08:07.635490 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f11f2d-71cd-446e-b7a0-ecfdc9e323a3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:07.636981 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f11f2d-71cd-446e-b7a0-ecfdc9e323a3 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:07.637955 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-1ecc8a4a-5e91-49cf-8b65-8a2430349204 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 10 19:08:07.637955 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:08:07.637955 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 19:08:07.637955 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 19:08:07.637955 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 19:08:07.637955 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 19:08:07.637955 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 19:08:07.637955 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 19:08:07.637955 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 10 19:08:07.637955 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:08:07.637955 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 19:08:07.637955 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:08:07.637955 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:08:07.637955 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:08:07.637955 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:08:07.637955 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:08:07.638929 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:08:07.638929 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:08:07.638929 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:08:07.638929 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:08:07.638929 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:08:07.638929 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:08:07.638929 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:08:07.638929 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 19:08:07.638929 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 19:08:07.638929 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 19:08:07.638929 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 19:08:07.638929 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:08:07.638929 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:08:07.638929 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:08:07.638929 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:08:07.638929 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:08:07.639820 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:08:07.639820 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:08:07.639820 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( May 10 19:08:07.639820 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:08:07.639820 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() May 10 19:08:07.639820 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:08:07.639820 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:08:07.639820 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:08:07.639820 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() May 10 19:08:07.639820 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:08:07.639820 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( May 10 19:08:07.639820 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 19:08:07.639820 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 19:08:07.639820 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 10 19:08:07.639820 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:08:07.639820 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 414/818] 10.222.0.70 () {56 vars in 1129 bytes} [Tue May 10 19:08:07 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:08:07.641265 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecc8a4a-5e91-49cf-8b65-8a2430349204 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:07.660073 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 405/819] 10.222.0.70 () {56 vars in 1135 bytes} [Tue May 10 19:08:07 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:08:07.661027 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f11f2d-71cd-446e-b7a0-ecfdc9e323a3 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:07.753285 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecc8a4a-5e91-49cf-8b65-8a2430349204 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:07.762359 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f11f2d-71cd-446e-b7a0-ecfdc9e323a3 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:07.787196 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28b4a17-a1ff-429f-b6a8-1e80f10896fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:07.788080 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28b4a17-a1ff-429f-b6a8-1e80f10896fe None admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:07.788356 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28b4a17-a1ff-429f-b6a8-1e80f10896fe None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:07.788652 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28b4a17-a1ff-429f-b6a8-1e80f10896fe None admin] PATH_INFO: `/v3/projects/2ee9ec5b515440fe9b39aedf3e339c79/users/058e52f1bf0b4aba965d945815d4acb3/roles/445805bec1e741c9b823495ae6e364f0` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:07.796205 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312053a8-5748-4296-a851-6e4609c96da4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:07.797052 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312053a8-5748-4296-a851-6e4609c96da4 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:07.797334 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312053a8-5748-4296-a851-6e4609c96da4 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:07.797605 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312053a8-5748-4296-a851-6e4609c96da4 None admin] PATH_INFO: `/v3/services/network` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:07.798245 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312053a8-5748-4296-a851-6e4609c96da4 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:07.799637 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312053a8-5748-4296-a851-6e4609c96da4 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:07.802656 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28b4a17-a1ff-429f-b6a8-1e80f10896fe None admin] RBAC: Authorizing `identity:create_grant(project_id=2ee9ec5b515440fe9b39aedf3e339c79, user_id=058e52f1bf0b4aba965d945815d4acb3, role_id=445805bec1e741c9b823495ae6e364f0)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:07.804067 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28b4a17-a1ff-429f-b6a8-1e80f10896fe None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:07.811068 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application [None req-312053a8-5748-4296-a851-6e4609c96da4 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 10 19:08:07.811068 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:08:07.811068 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 19:08:07.811068 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 19:08:07.811068 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 19:08:07.811068 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 19:08:07.811068 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 19:08:07.811068 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 19:08:07.811068 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 10 19:08:07.811068 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application May 10 19:08:07.811068 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 19:08:07.811068 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application May 10 19:08:07.811068 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:08:07.811068 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:08:07.811068 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:08:07.811068 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:08:07.811068 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:08:07.812189 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:08:07.812189 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:08:07.812189 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:08:07.812189 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:08:07.812189 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:08:07.812189 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:08:07.812189 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 19:08:07.812189 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 19:08:07.812189 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 19:08:07.812189 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 19:08:07.812189 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:08:07.812189 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:08:07.812189 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:08:07.812189 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:08:07.812189 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:08:07.812189 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:08:07.813205 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:08:07.813205 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application with Lock( May 10 19:08:07.813205 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:08:07.813205 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._enter() May 10 19:08:07.813205 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:08:07.813205 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:08:07.813205 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:08:07.813205 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.creator() May 10 19:08:07.813205 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:08:07.813205 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application created_value = creator( May 10 19:08:07.813205 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 19:08:07.813205 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 19:08:07.813205 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 10 19:08:07.813205 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application May 10 19:08:07.813205 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 406/820] 10.222.0.70 () {56 vars in 1111 bytes} [Tue May 10 19:08:07 2022] GET /identity/v3/services/network => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:08:07.814237 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312053a8-5748-4296-a851-6e4609c96da4 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:07.820614 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 415/821] 10.222.0.70 () {58 vars in 1439 bytes} [Tue May 10 19:08:07 2022] PUT /identity/v3/projects/2ee9ec5b515440fe9b39aedf3e339c79/users/058e52f1bf0b4aba965d945815d4acb3/roles/445805bec1e741c9b823495ae6e364f0 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:08:07.821225 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28b4a17-a1ff-429f-b6a8-1e80f10896fe None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:07.934895 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312053a8-5748-4296-a851-6e4609c96da4 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:07.970235 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28b4a17-a1ff-429f-b6a8-1e80f10896fe None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:07.975192 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41a4a3f-9d04-4ab5-a7ff-77e90e89ebc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:07.975878 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41a4a3f-9d04-4ab5-a7ff-77e90e89ebc9 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:07.976160 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41a4a3f-9d04-4ab5-a7ff-77e90e89ebc9 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:07.976550 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41a4a3f-9d04-4ab5-a7ff-77e90e89ebc9 None admin] PATH_INFO: `/v3/services` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:07.977265 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41a4a3f-9d04-4ab5-a7ff-77e90e89ebc9 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:08:07.977619 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41a4a3f-9d04-4ab5-a7ff-77e90e89ebc9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:07.979014 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41a4a3f-9d04-4ab5-a7ff-77e90e89ebc9 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:07.984466 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 407/822] 10.222.0.70 () {56 vars in 1124 bytes} [Tue May 10 19:08:07 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:08:07.985340 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41a4a3f-9d04-4ab5-a7ff-77e90e89ebc9 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:08.020598 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e113f73c-efa1-438e-8c5d-1c9816eefa42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:08.021407 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e113f73c-efa1-438e-8c5d-1c9816eefa42 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:08.021681 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e113f73c-efa1-438e-8c5d-1c9816eefa42 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:08.021949 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e113f73c-efa1-438e-8c5d-1c9816eefa42 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:08.040020 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e113f73c-efa1-438e-8c5d-1c9816eefa42 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:08.042366 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e113f73c-efa1-438e-8c5d-1c9816eefa42 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:08.065680 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-e113f73c-efa1-438e-8c5d-1c9816eefa42 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:08:08.065680 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:08:08.065680 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:08:08.065680 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:08:08.065680 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:08:08.065680 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:08:08.065680 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:08:08.065680 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:08:08.065680 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:08:08.065680 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:08:08.065680 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:08:08.065680 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:08:08.065680 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 19:08:08.065680 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 19:08:08.065680 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 19:08:08.066664 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 19:08:08.066664 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:08:08.066664 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:08:08.066664 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:08:08.066664 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:08:08.066664 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:08:08.066664 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:08:08.066664 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:08:08.066664 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( May 10 19:08:08.066664 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:08:08.066664 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() May 10 19:08:08.066664 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:08:08.066664 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:08:08.066664 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:08:08.066664 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() May 10 19:08:08.066664 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:08:08.066664 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( May 10 19:08:08.068237 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 19:08:08.068237 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 19:08:08.068237 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:08:08.068237 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:08:08.068237 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 416/823] 10.222.0.70 () {56 vars in 1108 bytes} [Tue May 10 19:08:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:08:08.068237 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e113f73c-efa1-438e-8c5d-1c9816eefa42 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:08.104495 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41a4a3f-9d04-4ab5-a7ff-77e90e89ebc9 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:08.138955 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f477f7-c912-445a-aeab-4b6b1acdf2be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:08.139727 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f477f7-c912-445a-aeab-4b6b1acdf2be None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:08.140009 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f477f7-c912-445a-aeab-4b6b1acdf2be None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:08.140280 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f477f7-c912-445a-aeab-4b6b1acdf2be None admin] PATH_INFO: `/v3/services` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:08.141168 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f477f7-c912-445a-aeab-4b6b1acdf2be None admin] RBAC: Adding query filter params (name=network) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:08:08.141475 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f477f7-c912-445a-aeab-4b6b1acdf2be None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:08.143515 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f477f7-c912-445a-aeab-4b6b1acdf2be None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:08.149902 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 408/824] 10.222.0.70 () {56 vars in 1112 bytes} [Tue May 10 19:08:07 2022] GET /identity/v3/services?name=network => generated 124 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:08:08.150714 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f477f7-c912-445a-aeab-4b6b1acdf2be None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:08.193923 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e113f73c-efa1-438e-8c5d-1c9816eefa42 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:08.227752 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73102d63-7869-4e8b-b438-bf7be3165cbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:08.228795 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73102d63-7869-4e8b-b438-bf7be3165cbb None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:08.229283 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73102d63-7869-4e8b-b438-bf7be3165cbb None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:08.229759 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73102d63-7869-4e8b-b438-bf7be3165cbb None admin] PATH_INFO: `/v3/services` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:08.230661 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73102d63-7869-4e8b-b438-bf7be3165cbb None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:08:08.231189 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73102d63-7869-4e8b-b438-bf7be3165cbb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:08.232791 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73102d63-7869-4e8b-b438-bf7be3165cbb None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:08.244918 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 417/825] 10.222.0.70 () {56 vars in 1124 bytes} [Tue May 10 19:08:08 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:08:08.245813 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73102d63-7869-4e8b-b438-bf7be3165cbb None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:08.268981 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f477f7-c912-445a-aeab-4b6b1acdf2be None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:08.302771 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e184690-9e62-435c-b40e-69976c3a2fd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:08.303785 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e184690-9e62-435c-b40e-69976c3a2fd8 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:08.304269 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e184690-9e62-435c-b40e-69976c3a2fd8 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:08.304767 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e184690-9e62-435c-b40e-69976c3a2fd8 None admin] PATH_INFO: `/v3/domains` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:08.305677 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e184690-9e62-435c-b40e-69976c3a2fd8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:08:08.306218 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e184690-9e62-435c-b40e-69976c3a2fd8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:08.307781 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e184690-9e62-435c-b40e-69976c3a2fd8 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:08.320247 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 409/826] 10.222.0.70 () {56 vars in 1109 bytes} [Tue May 10 19:08:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:08:08.321422 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e184690-9e62-435c-b40e-69976c3a2fd8 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:08.356347 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73102d63-7869-4e8b-b438-bf7be3165cbb None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:08.393729 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a656bf37-70b4-46ea-9aa1-10c089be8988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:08.394402 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a656bf37-70b4-46ea-9aa1-10c089be8988 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:08.394680 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a656bf37-70b4-46ea-9aa1-10c089be8988 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:08.394952 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a656bf37-70b4-46ea-9aa1-10c089be8988 None admin] PATH_INFO: `/v3/services` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:08.395719 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a656bf37-70b4-46ea-9aa1-10c089be8988 None admin] RBAC: Adding query filter params (type=network) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:08:08.396018 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a656bf37-70b4-46ea-9aa1-10c089be8988 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:08.397918 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a656bf37-70b4-46ea-9aa1-10c089be8988 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:08.404889 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 418/827] 10.222.0.70 () {56 vars in 1112 bytes} [Tue May 10 19:08:08 2022] GET /identity/v3/services?type=network => generated 350 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:08:08.406035 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a656bf37-70b4-46ea-9aa1-10c089be8988 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:08.422322 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e184690-9e62-435c-b40e-69976c3a2fd8 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:08.454793 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e160b440-f556-4375-870a-941d8cc0cc26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:08.456298 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e160b440-f556-4375-870a-941d8cc0cc26 None admin] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:08.457052 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e160b440-f556-4375-870a-941d8cc0cc26 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:08.457504 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e160b440-f556-4375-870a-941d8cc0cc26 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:08.458415 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e160b440-f556-4375-870a-941d8cc0cc26 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:08.459970 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e160b440-f556-4375-870a-941d8cc0cc26 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:08.483454 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 410/828] 10.222.0.70 () {60 vars in 1144 bytes} [Tue May 10 19:08:08 2022] POST /identity/v3/endpoints => generated 346 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:08:08.484674 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e160b440-f556-4375-870a-941d8cc0cc26 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:08.574463 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a656bf37-70b4-46ea-9aa1-10c089be8988 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:08.644577 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30662be2-765f-4c78-b7ff-a5214e699318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:08.647980 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30662be2-765f-4c78-b7ff-a5214e699318 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:08.648655 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30662be2-765f-4c78-b7ff-a5214e699318 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:08.649644 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30662be2-765f-4c78-b7ff-a5214e699318 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:08.650666 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e160b440-f556-4375-870a-941d8cc0cc26 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:08.661735 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30662be2-765f-4c78-b7ff-a5214e699318 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:08.663696 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30662be2-765f-4c78-b7ff-a5214e699318 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:08.679096 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-30662be2-765f-4c78-b7ff-a5214e699318 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 19:08:08.679096 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:08:08.679096 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:08:08.679096 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:08:08.679096 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:08:08.679096 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:08:08.679096 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:08:08.679096 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:08:08.679096 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:08:08.679096 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:08:08.679096 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:08:08.679096 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:08:08.679096 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 19:08:08.679096 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 19:08:08.679096 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 19:08:08.680080 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 19:08:08.680080 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:08:08.680080 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:08:08.680080 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:08:08.680080 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:08:08.680080 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:08:08.680080 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:08:08.680080 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:08:08.680080 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( May 10 19:08:08.680080 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:08:08.680080 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() May 10 19:08:08.680080 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:08:08.680080 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:08:08.680080 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:08:08.680080 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() May 10 19:08:08.680080 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:08:08.680080 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( May 10 19:08:08.681052 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 19:08:08.681052 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 19:08:08.681052 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 19:08:08.681052 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 19:08:08.681052 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 19:08:08.681052 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 19:08:08.681052 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 19:08:08.681052 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:08:08.688481 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 419/829] 10.222.0.70 () {56 vars in 1111 bytes} [Tue May 10 19:08:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:08:08.690302 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30662be2-765f-4c78-b7ff-a5214e699318 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:08.730818 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16720bb-ef0a-4d4b-ba5b-d877256191e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:08.731650 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16720bb-ef0a-4d4b-ba5b-d877256191e0 None admin] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:08.731934 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16720bb-ef0a-4d4b-ba5b-d877256191e0 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:08.732212 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16720bb-ef0a-4d4b-ba5b-d877256191e0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:08.732990 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16720bb-ef0a-4d4b-ba5b-d877256191e0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:08.734524 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16720bb-ef0a-4d4b-ba5b-d877256191e0 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:08.762494 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 411/830] 10.222.0.70 () {60 vars in 1144 bytes} [Tue May 10 19:08:08 2022] POST /identity/v3/endpoints => generated 327 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:08:08.845459 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30662be2-765f-4c78-b7ff-a5214e699318 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:08.897883 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f61e27c-bb4b-4767-91b6-d2792b04078c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:08.898582 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f61e27c-bb4b-4767-91b6-d2792b04078c None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:08.898870 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f61e27c-bb4b-4767-91b6-d2792b04078c None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:08.899150 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f61e27c-bb4b-4767-91b6-d2792b04078c None admin] PATH_INFO: `/v3/projects` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:08.900009 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f61e27c-bb4b-4767-91b6-d2792b04078c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:08:08.900323 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f61e27c-bb4b-4767-91b6-d2792b04078c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:08.901807 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f61e27c-bb4b-4767-91b6-d2792b04078c None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:08.927631 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 420/831] 10.222.0.70 () {56 vars in 1148 bytes} [Tue May 10 19:08:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:08:08.934024 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16720bb-ef0a-4d4b-ba5b-d877256191e0 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:09.055193 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16720bb-ef0a-4d4b-ba5b-d877256191e0 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:09.094860 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e332ceb3-1c51-42f8-9a43-0677bdd591ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:09.095796 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e332ceb3-1c51-42f8-9a43-0677bdd591ce None admin] REQUEST_METHOD: `PUT` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:09.096073 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e332ceb3-1c51-42f8-9a43-0677bdd591ce None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:09.096393 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e332ceb3-1c51-42f8-9a43-0677bdd591ce None admin] PATH_INFO: `/v3/projects/2ee9ec5b515440fe9b39aedf3e339c79/users/0454aa03fa31487ea1464b9d0008212c/roles/634ba284303b4626b5a0402772c68f5c` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:09.098647 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e332ceb3-1c51-42f8-9a43-0677bdd591ce None admin] RBAC: Authorizing `identity:create_grant(project_id=2ee9ec5b515440fe9b39aedf3e339c79, user_id=0454aa03fa31487ea1464b9d0008212c, role_id=634ba284303b4626b5a0402772c68f5c)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:09.100182 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e332ceb3-1c51-42f8-9a43-0677bdd591ce None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:09.119522 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 412/832] 10.222.0.70 () {58 vars in 1439 bytes} [Tue May 10 19:08:08 2022] PUT /identity/v3/projects/2ee9ec5b515440fe9b39aedf3e339c79/users/0454aa03fa31487ea1464b9d0008212c/roles/634ba284303b4626b5a0402772c68f5c => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:08:09.868668 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723d6923-5695-475a-8038-a328ea659b67 None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:09.869210 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723d6923-5695-475a-8038-a328ea659b67 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:09.869210 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723d6923-5695-475a-8038-a328ea659b67 None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:09.870804 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 421/833] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:08:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:08:09.876498 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631cc96f-657e-44df-8e95-f45d21a93f51 None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:09.877083 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631cc96f-657e-44df-8e95-f45d21a93f51 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:09.877178 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631cc96f-657e-44df-8e95-f45d21a93f51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:09.895172 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-631cc96f-657e-44df-8e95-f45d21a93f51 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:08:09.896346 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-631cc96f-657e-44df-8e95-f45d21a93f51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:08:09.963795 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 413/834] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:08:09 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 19:08:09.985368 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723d6923-5695-475a-8038-a328ea659b67 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:10.091219 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723d6923-5695-475a-8038-a328ea659b67 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:10.124569 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e63c75-7617-4733-b497-7ebcb704ed51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:10.125306 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e63c75-7617-4733-b497-7ebcb704ed51 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:10.125585 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e63c75-7617-4733-b497-7ebcb704ed51 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:10.125855 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e63c75-7617-4733-b497-7ebcb704ed51 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:10.126494 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e63c75-7617-4733-b497-7ebcb704ed51 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:10.127904 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e63c75-7617-4733-b497-7ebcb704ed51 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:10.139696 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-52e63c75-7617-4733-b497-7ebcb704ed51 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 10 19:08:10.139696 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:08:10.139696 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 19:08:10.139696 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 19:08:10.139696 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 19:08:10.139696 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 19:08:10.139696 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 19:08:10.139696 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 19:08:10.139696 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 10 19:08:10.139696 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:08:10.139696 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 19:08:10.139696 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:08:10.139696 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:08:10.139696 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:08:10.139696 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:08:10.139696 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:08:10.140668 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:08:10.140668 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:08:10.140668 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:08:10.140668 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:08:10.140668 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:08:10.140668 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:08:10.140668 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:08:10.140668 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 19:08:10.140668 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 19:08:10.140668 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 19:08:10.140668 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 19:08:10.140668 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:08:10.140668 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:08:10.140668 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:08:10.140668 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:08:10.140668 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:08:10.141953 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:08:10.141953 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:08:10.141953 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( May 10 19:08:10.141953 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:08:10.141953 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() May 10 19:08:10.141953 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:08:10.141953 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:08:10.141953 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:08:10.141953 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() May 10 19:08:10.141953 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:08:10.141953 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( May 10 19:08:10.141953 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 19:08:10.141953 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 19:08:10.141953 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 10 19:08:10.141953 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:08:10.141953 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 422/835] 10.222.0.70 () {56 vars in 1132 bytes} [Tue May 10 19:08:09 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:08:10.147528 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631cc96f-657e-44df-8e95-f45d21a93f51 None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:10.219064 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883bc456-a8dd-4f46-8f13-f1c3a632ea71 None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:10.219424 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883bc456-a8dd-4f46-8f13-f1c3a632ea71 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:10.219617 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883bc456-a8dd-4f46-8f13-f1c3a632ea71 None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:10.221782 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 423/836] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:08:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 19:08:10.226618 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d3caf0-1ff9-4eb8-a60e-0fe39d29a7a7 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:10.226903 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d3caf0-1ff9-4eb8-a60e-0fe39d29a7a7 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:10.227184 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d3caf0-1ff9-4eb8-a60e-0fe39d29a7a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:10.243499 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-16d3caf0-1ff9-4eb8-a60e-0fe39d29a7a7 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:08:10.244711 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-16d3caf0-1ff9-4eb8-a60e-0fe39d29a7a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:08:10.246280 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631cc96f-657e-44df-8e95-f45d21a93f51 None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:10.282873 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce3ef64-8589-4196-96b3-b89879fa5d01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:10.284073 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce3ef64-8589-4196-96b3-b89879fa5d01 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:10.284355 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce3ef64-8589-4196-96b3-b89879fa5d01 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:10.284657 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce3ef64-8589-4196-96b3-b89879fa5d01 None admin] PATH_INFO: `/v3/services` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:10.285463 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce3ef64-8589-4196-96b3-b89879fa5d01 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:08:10.285857 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce3ef64-8589-4196-96b3-b89879fa5d01 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:10.287333 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce3ef64-8589-4196-96b3-b89879fa5d01 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:10.292255 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 414/837] 10.222.0.70 () {56 vars in 1126 bytes} [Tue May 10 19:08:10 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:08:10.298082 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce3ef64-8589-4196-96b3-b89879fa5d01 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:10.332535 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 424/838] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:08:10 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 19:08:10.351905 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d3caf0-1ff9-4eb8-a60e-0fe39d29a7a7 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:10.418282 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce3ef64-8589-4196-96b3-b89879fa5d01 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:10.453527 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0825f0bd-9403-4601-ba6d-6b86081090a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:10.454205 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0825f0bd-9403-4601-ba6d-6b86081090a1 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:10.454479 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0825f0bd-9403-4601-ba6d-6b86081090a1 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:10.454755 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0825f0bd-9403-4601-ba6d-6b86081090a1 None admin] PATH_INFO: `/v3/services` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:10.455524 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0825f0bd-9403-4601-ba6d-6b86081090a1 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:08:10.455828 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0825f0bd-9403-4601-ba6d-6b86081090a1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:10.457495 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0825f0bd-9403-4601-ba6d-6b86081090a1 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:10.468569 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 415/839] 10.222.0.70 () {56 vars in 1126 bytes} [Tue May 10 19:08:10 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:08:10.479371 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d3caf0-1ff9-4eb8-a60e-0fe39d29a7a7 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:10.517987 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3184f35-a650-4b67-b420-2291ed90a789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:10.519225 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3184f35-a650-4b67-b420-2291ed90a789 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:10.519708 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3184f35-a650-4b67-b420-2291ed90a789 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:10.520180 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3184f35-a650-4b67-b420-2291ed90a789 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:10.532734 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3184f35-a650-4b67-b420-2291ed90a789 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:08:10.541584 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-a3184f35-a650-4b67-b420-2291ed90a789 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 19:08:10.541584 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:08:10.541584 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:08:10.541584 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:08:10.541584 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:08:10.541584 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:08:10.541584 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:08:10.541584 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:08:10.541584 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:08:10.541584 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:08:10.541584 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:08:10.541584 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:08:10.541584 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:08:10.541584 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:08:10.541584 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:08:10.541584 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:08:10.542614 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:08:10.542614 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:08:10.542614 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:08:10.542614 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:08:10.542614 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:08:10.542614 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:08:10.542614 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:08:10.542614 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:08:10.542614 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:08:10.542614 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:08:10.542614 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:08:10.542614 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( May 10 19:08:10.542614 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:08:10.542614 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() May 10 19:08:10.542614 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:08:10.542614 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:08:10.543487 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:08:10.543487 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() May 10 19:08:10.543487 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:08:10.543487 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( May 10 19:08:10.543487 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:08:10.543487 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:08:10.543487 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:08:10.543487 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:08:10.543487 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:08:10.543487 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:08:10.543487 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 19:08:10.543487 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:08:10.546308 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 425/840] 10.222.0.70 () {56 vars in 1102 bytes} [Tue May 10 19:08:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 19:08:10.553720 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0825f0bd-9403-4601-ba6d-6b86081090a1 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:10.660060 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0825f0bd-9403-4601-ba6d-6b86081090a1 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:10.694240 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f88ff4-7ddd-42a2-a04e-8f36ef7ed847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:10.695185 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f88ff4-7ddd-42a2-a04e-8f36ef7ed847 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:10.695608 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f88ff4-7ddd-42a2-a04e-8f36ef7ed847 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:10.696021 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f88ff4-7ddd-42a2-a04e-8f36ef7ed847 None admin] PATH_INFO: `/v3/roles` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:10.696924 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f88ff4-7ddd-42a2-a04e-8f36ef7ed847 None admin] RBAC: Adding query filter params (name=service) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:08:10.697467 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f88ff4-7ddd-42a2-a04e-8f36ef7ed847 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:10.698959 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f88ff4-7ddd-42a2-a04e-8f36ef7ed847 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:10.708334 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 416/841] 10.222.0.70 () {56 vars in 1103 bytes} [Tue May 10 19:08:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:08:10.716546 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3184f35-a650-4b67-b420-2291ed90a789 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:10.815743 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3184f35-a650-4b67-b420-2291ed90a789 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:10.853875 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3019515e-b799-45a9-8509-4cbf72e3935f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:10.854682 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3019515e-b799-45a9-8509-4cbf72e3935f None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:10.854961 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3019515e-b799-45a9-8509-4cbf72e3935f None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:10.855231 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3019515e-b799-45a9-8509-4cbf72e3935f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:10.866800 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3019515e-b799-45a9-8509-4cbf72e3935f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:10.868237 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3019515e-b799-45a9-8509-4cbf72e3935f None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:10.885494 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-3019515e-b799-45a9-8509-4cbf72e3935f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:08:10.885494 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:08:10.885494 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:08:10.885494 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:08:10.885494 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:08:10.885494 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:08:10.885494 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:08:10.885494 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:08:10.885494 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:08:10.885494 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:08:10.885494 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:08:10.885494 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:08:10.885494 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 19:08:10.885494 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 19:08:10.885494 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 19:08:10.886837 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 19:08:10.886837 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:08:10.886837 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:08:10.886837 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:08:10.886837 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:08:10.886837 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:08:10.886837 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:08:10.886837 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:08:10.886837 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( May 10 19:08:10.886837 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:08:10.886837 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() May 10 19:08:10.886837 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:08:10.886837 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:08:10.886837 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:08:10.886837 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() May 10 19:08:10.886837 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:08:10.886837 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( May 10 19:08:10.887767 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 19:08:10.887767 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 19:08:10.887767 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:08:10.887767 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:08:10.887767 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 426/842] 10.222.0.70 () {56 vars in 1108 bytes} [Tue May 10 19:08:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 19:08:10.894082 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f88ff4-7ddd-42a2-a04e-8f36ef7ed847 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:10.999928 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f88ff4-7ddd-42a2-a04e-8f36ef7ed847 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:11.029900 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3aa37d-1c78-4a53-8087-93fbde17d87e None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:11.030209 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3aa37d-1c78-4a53-8087-93fbde17d87e None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:11.030460 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3aa37d-1c78-4a53-8087-93fbde17d87e None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:11.032452 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 427/843] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:08:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:08:11.037783 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce69a69c-ff70-442b-8807-2ed8fd5fe86a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:11.037926 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0e7f39-e33a-4278-98c3-739a61b85114 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:11.038193 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0e7f39-e33a-4278-98c3-739a61b85114 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:11.038469 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0e7f39-e33a-4278-98c3-739a61b85114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:11.039226 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce69a69c-ff70-442b-8807-2ed8fd5fe86a None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:11.039707 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce69a69c-ff70-442b-8807-2ed8fd5fe86a None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:11.040293 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce69a69c-ff70-442b-8807-2ed8fd5fe86a None admin] PATH_INFO: `/v3/domains` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:11.041229 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce69a69c-ff70-442b-8807-2ed8fd5fe86a None admin] RBAC: Adding query filter params (name=Default) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:08:11.041744 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce69a69c-ff70-442b-8807-2ed8fd5fe86a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:11.043312 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce69a69c-ff70-442b-8807-2ed8fd5fe86a None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:11.056305 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 417/844] 10.222.0.70 () {56 vars in 1109 bytes} [Tue May 10 19:08:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:08:11.061792 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce69a69c-ff70-442b-8807-2ed8fd5fe86a None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:11.062134 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-6a0e7f39-e33a-4278-98c3-739a61b85114 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:08:11.063655 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-6a0e7f39-e33a-4278-98c3-739a61b85114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:08:11.156786 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 428/845] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:08:11 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 19:08:11.163262 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce69a69c-ff70-442b-8807-2ed8fd5fe86a None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:11.173270 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0e7f39-e33a-4278-98c3-739a61b85114 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:11.198946 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e54126-e6f0-4569-ab89-649d7872c419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:11.200623 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e54126-e6f0-4569-ab89-649d7872c419 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:11.201258 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e54126-e6f0-4569-ab89-649d7872c419 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:11.201820 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e54126-e6f0-4569-ab89-649d7872c419 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:11.211142 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e54126-e6f0-4569-ab89-649d7872c419 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:11.213221 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e54126-e6f0-4569-ab89-649d7872c419 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:11.233138 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application [None req-84e54126-e6f0-4569-ab89-649d7872c419 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 10 19:08:11.233138 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:08:11.233138 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:08:11.233138 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:08:11.233138 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:08:11.233138 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:08:11.233138 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:08:11.233138 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:08:11.233138 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:08:11.233138 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:08:11.233138 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:08:11.233138 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:08:11.233138 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 19:08:11.233138 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 19:08:11.233138 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 19:08:11.233138 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 19:08:11.234351 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:08:11.234351 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:08:11.234351 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 19:08:11.234351 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 19:08:11.234351 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 19:08:11.234351 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 19:08:11.234351 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:08:11.234351 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:08:11.234351 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:08:11.234351 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:08:11.234351 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:08:11.234351 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application with Lock( May 10 19:08:11.234351 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:08:11.234351 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._enter() May 10 19:08:11.234351 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:08:11.234351 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:08:11.234351 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:08:11.234351 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.creator() May 10 19:08:11.235515 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:08:11.235515 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application created_value = creator( May 10 19:08:11.235515 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 19:08:11.235515 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 19:08:11.235515 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 19:08:11.235515 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 19:08:11.235515 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 19:08:11.235515 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 19:08:11.235515 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 10 19:08:11.235515 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application May 10 19:08:11.238744 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 418/846] 10.222.0.70 () {56 vars in 1117 bytes} [Tue May 10 19:08:11 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 19:08:11.247552 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e54126-e6f0-4569-ab89-649d7872c419 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:11.323688 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0e7f39-e33a-4278-98c3-739a61b85114 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:11.393631 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ff184b-9f69-40ba-a421-4ca491df412e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:11.394743 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ff184b-9f69-40ba-a421-4ca491df412e None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:11.395202 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ff184b-9f69-40ba-a421-4ca491df412e None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:11.395649 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ff184b-9f69-40ba-a421-4ca491df412e None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:11.396588 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ff184b-9f69-40ba-a421-4ca491df412e None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:11.398152 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ff184b-9f69-40ba-a421-4ca491df412e None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:11.418886 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-11ff184b-9f69-40ba-a421-4ca491df412e None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 10 19:08:11.418886 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:08:11.418886 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 19:08:11.418886 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 19:08:11.418886 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 19:08:11.418886 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 19:08:11.418886 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 19:08:11.418886 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 19:08:11.418886 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 10 19:08:11.418886 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:08:11.418886 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 19:08:11.418886 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:08:11.418886 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:08:11.418886 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:08:11.418886 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:08:11.418886 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:08:11.418886 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:08:11.419935 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:08:11.419935 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:08:11.419935 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:08:11.419935 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:08:11.419935 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:08:11.419935 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:08:11.419935 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 19:08:11.419935 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 19:08:11.419935 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 19:08:11.419935 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 19:08:11.419935 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:08:11.419935 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:08:11.419935 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:08:11.419935 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:08:11.419935 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:08:11.419935 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:08:11.421046 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:08:11.421046 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( May 10 19:08:11.421046 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:08:11.421046 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() May 10 19:08:11.421046 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:08:11.421046 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:08:11.421046 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:08:11.421046 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() May 10 19:08:11.421046 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:08:11.421046 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( May 10 19:08:11.421046 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 19:08:11.421046 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 19:08:11.421046 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 10 19:08:11.421046 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:08:11.432109 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 429/847] 10.222.0.70 () {56 vars in 1114 bytes} [Tue May 10 19:08:11 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 19:08:11.438257 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ff184b-9f69-40ba-a421-4ca491df412e None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:11.447172 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e54126-e6f0-4569-ab89-649d7872c419 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:11.482306 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b72a80c-cbc9-4c0d-aead-3055ab0f657a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:11.483293 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b72a80c-cbc9-4c0d-aead-3055ab0f657a None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:11.483797 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b72a80c-cbc9-4c0d-aead-3055ab0f657a None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:11.484289 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b72a80c-cbc9-4c0d-aead-3055ab0f657a None admin] PATH_INFO: `/v3/users` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:11.485349 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b72a80c-cbc9-4c0d-aead-3055ab0f657a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:08:11.485857 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b72a80c-cbc9-4c0d-aead-3055ab0f657a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:11.487522 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b72a80c-cbc9-4c0d-aead-3055ab0f657a None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:11.512361 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 419/848] 10.222.0.70 () {56 vars in 1149 bytes} [Tue May 10 19:08:11 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:08:11.514257 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cc72a0-3ab1-4732-a619-ba9c5c34c07e None None] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:11.514749 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cc72a0-3ab1-4732-a619-ba9c5c34c07e None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:11.515226 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cc72a0-3ab1-4732-a619-ba9c5c34c07e None None] PATH_INFO: `/` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:11.518047 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 420/849] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:08:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:08:11.519692 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cc72a0-3ab1-4732-a619-ba9c5c34c07e None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:11.572131 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ff184b-9f69-40ba-a421-4ca491df412e None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:11.610511 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749d53dc-3bf3-4574-9112-f94d8a1a1acb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:11.611223 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749d53dc-3bf3-4574-9112-f94d8a1a1acb None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:11.611507 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749d53dc-3bf3-4574-9112-f94d8a1a1acb None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:11.611781 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749d53dc-3bf3-4574-9112-f94d8a1a1acb None admin] PATH_INFO: `/v3/services` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:11.612531 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749d53dc-3bf3-4574-9112-f94d8a1a1acb None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:08:11.612845 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749d53dc-3bf3-4574-9112-f94d8a1a1acb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:11.614319 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749d53dc-3bf3-4574-9112-f94d8a1a1acb None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:11.624791 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 430/850] 10.222.0.70 () {56 vars in 1114 bytes} [Tue May 10 19:08:11 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:08:11.626375 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a9e587-d877-4776-9807-f7386db7a989 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:11.626668 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a9e587-d877-4776-9807-f7386db7a989 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:11.626999 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a9e587-d877-4776-9807-f7386db7a989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:11.644410 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-b2a9e587-d877-4776-9807-f7386db7a989 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:08:11.645615 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-b2a9e587-d877-4776-9807-f7386db7a989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:08:11.650729 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cc72a0-3ab1-4732-a619-ba9c5c34c07e None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:11.695232 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4ea6ed-0ce1-41f0-9673-55ab99a2e4f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:11.695881 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4ea6ed-0ce1-41f0-9673-55ab99a2e4f5 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:11.696161 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4ea6ed-0ce1-41f0-9673-55ab99a2e4f5 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:11.696449 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4ea6ed-0ce1-41f0-9673-55ab99a2e4f5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:11.722953 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 431/851] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:08:11 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 19:08:11.723796 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a9e587-d877-4776-9807-f7386db7a989 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:11.777577 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4ea6ed-0ce1-41f0-9673-55ab99a2e4f5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:11.778937 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4ea6ed-0ce1-41f0-9673-55ab99a2e4f5 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:11.821295 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a9e587-d877-4776-9807-f7386db7a989 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:11.854894 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd8c4a7-3dc0-4bc3-8cb4-94e209b382d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:11.855560 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd8c4a7-3dc0-4bc3-8cb4-94e209b382d8 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:11.855842 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd8c4a7-3dc0-4bc3-8cb4-94e209b382d8 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:11.856120 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd8c4a7-3dc0-4bc3-8cb4-94e209b382d8 None admin] PATH_INFO: `/v3/services` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:11.856843 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd8c4a7-3dc0-4bc3-8cb4-94e209b382d8 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:08:11.857152 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd8c4a7-3dc0-4bc3-8cb4-94e209b382d8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:11.858507 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd8c4a7-3dc0-4bc3-8cb4-94e209b382d8 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:11.865205 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 432/852] 10.222.0.70 () {56 vars in 1114 bytes} [Tue May 10 19:08:11 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:08:11.865971 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd8c4a7-3dc0-4bc3-8cb4-94e209b382d8 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:11.887311 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 421/853] 10.222.0.70 () {58 vars in 1282 bytes} [Tue May 10 19:08:11 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 19:08:11.893879 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4ea6ed-0ce1-41f0-9673-55ab99a2e4f5 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:11.974950 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd8c4a7-3dc0-4bc3-8cb4-94e209b382d8 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:12.000643 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4ea6ed-0ce1-41f0-9673-55ab99a2e4f5 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:12.010950 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591d35d5-dcab-4429-82d6-f7bdf1251b4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:12.011831 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591d35d5-dcab-4429-82d6-f7bdf1251b4e None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:12.012034 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591d35d5-dcab-4429-82d6-f7bdf1251b4e None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:12.012304 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591d35d5-dcab-4429-82d6-f7bdf1251b4e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:12.023868 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591d35d5-dcab-4429-82d6-f7bdf1251b4e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:08:12.031734 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-591d35d5-dcab-4429-82d6-f7bdf1251b4e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 19:08:12.031734 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:08:12.031734 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:08:12.031734 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:08:12.031734 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:08:12.031734 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:08:12.031734 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:08:12.031734 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:08:12.031734 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:08:12.031734 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:08:12.031734 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:08:12.031734 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:08:12.031734 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:08:12.031734 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:08:12.031734 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:08:12.031734 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:08:12.032776 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:08:12.032776 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:08:12.032776 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:08:12.032776 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:08:12.032776 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:08:12.032776 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:08:12.032776 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:08:12.032776 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:08:12.032776 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:08:12.032776 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:08:12.032776 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:08:12.032776 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( May 10 19:08:12.032776 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:08:12.032776 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() May 10 19:08:12.032776 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:08:12.032776 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:08:12.034174 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:08:12.034174 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() May 10 19:08:12.034174 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:08:12.034174 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( May 10 19:08:12.034174 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:08:12.034174 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:08:12.034174 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:08:12.034174 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:08:12.034174 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:08:12.034174 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:08:12.034174 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 19:08:12.034174 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:08:12.036820 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 433/854] 10.222.0.70 () {56 vars in 1096 bytes} [Tue May 10 19:08:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:08:12.039729 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591d35d5-dcab-4429-82d6-f7bdf1251b4e None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:12.043197 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7545eced-022f-4242-81dc-efb1d29e2bd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:12.044641 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7545eced-022f-4242-81dc-efb1d29e2bd8 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:12.045099 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7545eced-022f-4242-81dc-efb1d29e2bd8 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:12.045572 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7545eced-022f-4242-81dc-efb1d29e2bd8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:12.056856 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7545eced-022f-4242-81dc-efb1d29e2bd8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:12.058660 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7545eced-022f-4242-81dc-efb1d29e2bd8 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:12.076781 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application [None req-7545eced-022f-4242-81dc-efb1d29e2bd8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:08:12.076781 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:08:12.076781 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:08:12.076781 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:08:12.076781 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:08:12.076781 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:08:12.076781 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:08:12.076781 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:08:12.076781 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:08:12.076781 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:08:12.076781 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:08:12.076781 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:08:12.076781 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 19:08:12.076781 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 19:08:12.076781 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 19:08:12.077751 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 19:08:12.077751 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:08:12.077751 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:08:12.077751 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:08:12.077751 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:08:12.077751 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:08:12.077751 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:08:12.077751 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:08:12.077751 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application with Lock( May 10 19:08:12.077751 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:08:12.077751 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._enter() May 10 19:08:12.077751 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:08:12.077751 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:08:12.077751 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:08:12.077751 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.creator() May 10 19:08:12.077751 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:08:12.077751 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application created_value = creator( May 10 19:08:12.078670 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 19:08:12.078670 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 19:08:12.078670 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:08:12.078670 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application May 10 19:08:12.081158 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 422/855] 10.222.0.70 () {56 vars in 1108 bytes} [Tue May 10 19:08:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 19:08:12.086698 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7545eced-022f-4242-81dc-efb1d29e2bd8 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:12.141595 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591d35d5-dcab-4429-82d6-f7bdf1251b4e None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:12.175975 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1597c35-e75c-4437-b623-14b54f6fa4da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:12.176735 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1597c35-e75c-4437-b623-14b54f6fa4da None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:12.177016 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1597c35-e75c-4437-b623-14b54f6fa4da None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:12.177335 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1597c35-e75c-4437-b623-14b54f6fa4da None admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:12.178091 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1597c35-e75c-4437-b623-14b54f6fa4da None admin] RBAC: Adding query filter params (name=admin) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:08:12.178392 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1597c35-e75c-4437-b623-14b54f6fa4da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:12.179750 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1597c35-e75c-4437-b623-14b54f6fa4da None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:12.185087 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7545eced-022f-4242-81dc-efb1d29e2bd8 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:12.188348 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 434/856] 10.222.0.70 () {56 vars in 1099 bytes} [Tue May 10 19:08:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:08:12.193945 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1597c35-e75c-4437-b623-14b54f6fa4da None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:12.221408 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620c59a4-3353-455d-aeeb-1872e32631fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:12.222239 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620c59a4-3353-455d-aeeb-1872e32631fb None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:12.222527 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620c59a4-3353-455d-aeeb-1872e32631fb None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:12.223131 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620c59a4-3353-455d-aeeb-1872e32631fb None admin] PATH_INFO: `/v3/domains` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:12.224133 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620c59a4-3353-455d-aeeb-1872e32631fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:08:12.224455 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620c59a4-3353-455d-aeeb-1872e32631fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:12.226826 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620c59a4-3353-455d-aeeb-1872e32631fb None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:12.247692 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 423/857] 10.222.0.70 () {56 vars in 1109 bytes} [Tue May 10 19:08:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:08:12.248663 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620c59a4-3353-455d-aeeb-1872e32631fb None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:12.298151 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1597c35-e75c-4437-b623-14b54f6fa4da None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:12.333849 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df278979-c4da-4b46-b04c-5b391cacadf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:12.334646 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df278979-c4da-4b46-b04c-5b391cacadf0 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:12.334925 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df278979-c4da-4b46-b04c-5b391cacadf0 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:12.335197 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df278979-c4da-4b46-b04c-5b391cacadf0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:12.346425 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df278979-c4da-4b46-b04c-5b391cacadf0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:12.347862 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df278979-c4da-4b46-b04c-5b391cacadf0 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:12.351756 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620c59a4-3353-455d-aeeb-1872e32631fb None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:12.365059 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-df278979-c4da-4b46-b04c-5b391cacadf0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:08:12.365059 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:08:12.365059 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:08:12.365059 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:08:12.365059 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:08:12.365059 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:08:12.365059 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:08:12.365059 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:08:12.365059 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:08:12.365059 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:08:12.365059 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:08:12.365059 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:08:12.365059 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 19:08:12.365059 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 19:08:12.365059 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 19:08:12.366013 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 19:08:12.366013 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:08:12.366013 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:08:12.366013 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:08:12.366013 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:08:12.366013 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:08:12.366013 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:08:12.366013 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:08:12.366013 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( May 10 19:08:12.366013 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:08:12.366013 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() May 10 19:08:12.366013 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:08:12.366013 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:08:12.366013 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:08:12.366013 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() May 10 19:08:12.366013 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:08:12.366013 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( May 10 19:08:12.366936 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 19:08:12.366936 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 19:08:12.366936 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:08:12.366936 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:08:12.370973 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 435/858] 10.222.0.70 () {56 vars in 1108 bytes} [Tue May 10 19:08:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 19:08:12.371841 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df278979-c4da-4b46-b04c-5b391cacadf0 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:12.385290 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e96d29-ecb3-4734-9564-b4107d687a06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:12.386092 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e96d29-ecb3-4734-9564-b4107d687a06 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:12.386372 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e96d29-ecb3-4734-9564-b4107d687a06 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:12.386642 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e96d29-ecb3-4734-9564-b4107d687a06 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:12.394047 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e96d29-ecb3-4734-9564-b4107d687a06 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:12.395498 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e96d29-ecb3-4734-9564-b4107d687a06 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:12.410043 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application [None req-96e96d29-ecb3-4734-9564-b4107d687a06 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 19:08:12.410043 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:08:12.410043 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:08:12.410043 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:08:12.410043 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:08:12.410043 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:08:12.410043 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:08:12.410043 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:08:12.410043 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:08:12.410043 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:08:12.410043 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:08:12.410043 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:08:12.410043 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 19:08:12.410043 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 19:08:12.410043 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 19:08:12.412134 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 19:08:12.412134 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:08:12.412134 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:08:12.412134 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:08:12.412134 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:08:12.412134 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:08:12.412134 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:08:12.412134 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:08:12.412134 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application with Lock( May 10 19:08:12.412134 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:08:12.412134 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._enter() May 10 19:08:12.412134 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:08:12.412134 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:08:12.412134 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:08:12.412134 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.creator() May 10 19:08:12.412134 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:08:12.412134 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application created_value = creator( May 10 19:08:12.414247 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 19:08:12.414247 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 19:08:12.414247 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 19:08:12.414247 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 19:08:12.414247 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 19:08:12.414247 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 19:08:12.414247 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 19:08:12.414247 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application May 10 19:08:12.420479 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 424/859] 10.222.0.70 () {56 vars in 1111 bytes} [Tue May 10 19:08:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:08:12.420479 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e96d29-ecb3-4734-9564-b4107d687a06 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:12.472507 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df278979-c4da-4b46-b04c-5b391cacadf0 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:12.506354 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b0b841-7d84-404e-aa47-b455af94801e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:12.507027 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b0b841-7d84-404e-aa47-b455af94801e None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:12.507311 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b0b841-7d84-404e-aa47-b455af94801e None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:12.507587 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b0b841-7d84-404e-aa47-b455af94801e None admin] PATH_INFO: `/v3/domains` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:12.508305 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b0b841-7d84-404e-aa47-b455af94801e None admin] RBAC: Adding query filter params (name=Default) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:08:12.508633 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b0b841-7d84-404e-aa47-b455af94801e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:12.510001 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b0b841-7d84-404e-aa47-b455af94801e None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:12.515567 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e96d29-ecb3-4734-9564-b4107d687a06 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:12.526664 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 436/860] 10.222.0.70 () {56 vars in 1109 bytes} [Tue May 10 19:08:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:08:12.527529 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b0b841-7d84-404e-aa47-b455af94801e None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:12.549975 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fed589-0d5e-47ed-8e53-cf21c05ef365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:12.550563 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fed589-0d5e-47ed-8e53-cf21c05ef365 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:12.550843 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fed589-0d5e-47ed-8e53-cf21c05ef365 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:12.551115 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fed589-0d5e-47ed-8e53-cf21c05ef365 None admin] PATH_INFO: `/v3/projects` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:12.551893 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fed589-0d5e-47ed-8e53-cf21c05ef365 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:08:12.552199 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fed589-0d5e-47ed-8e53-cf21c05ef365 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:12.553671 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fed589-0d5e-47ed-8e53-cf21c05ef365 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:12.571598 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 425/861] 10.222.0.70 () {56 vars in 1148 bytes} [Tue May 10 19:08:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:08:12.572596 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fed589-0d5e-47ed-8e53-cf21c05ef365 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:12.640438 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b0b841-7d84-404e-aa47-b455af94801e None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:12.675366 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153a48cd-62e2-4fcb-aa73-f65f1a0a0491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:12.676174 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153a48cd-62e2-4fcb-aa73-f65f1a0a0491 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:12.676481 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153a48cd-62e2-4fcb-aa73-f65f1a0a0491 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:12.676759 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153a48cd-62e2-4fcb-aa73-f65f1a0a0491 None admin] PATH_INFO: `/v3/users/swift` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:12.680965 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fed589-0d5e-47ed-8e53-cf21c05ef365 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:12.684400 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153a48cd-62e2-4fcb-aa73-f65f1a0a0491 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:12.685865 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153a48cd-62e2-4fcb-aa73-f65f1a0a0491 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:12.701421 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-153a48cd-62e2-4fcb-aa73-f65f1a0a0491 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 10 19:08:12.701421 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:08:12.701421 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:08:12.701421 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:08:12.701421 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:08:12.701421 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:08:12.701421 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:08:12.701421 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:08:12.701421 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:08:12.701421 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:08:12.701421 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:08:12.701421 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:08:12.701421 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 19:08:12.701421 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 19:08:12.701421 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 19:08:12.701421 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 19:08:12.703615 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:08:12.703615 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:08:12.703615 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 19:08:12.703615 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 19:08:12.703615 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 19:08:12.703615 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 19:08:12.703615 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:08:12.703615 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:08:12.703615 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:08:12.703615 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:08:12.703615 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:08:12.703615 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( May 10 19:08:12.703615 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:08:12.703615 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() May 10 19:08:12.703615 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:08:12.703615 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:08:12.703615 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:08:12.703615 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() May 10 19:08:12.705913 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:08:12.705913 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( May 10 19:08:12.705913 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 19:08:12.705913 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 19:08:12.705913 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 19:08:12.705913 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 19:08:12.705913 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 19:08:12.705913 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 19:08:12.705913 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 10 19:08:12.705913 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:08:12.712553 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 437/862] 10.222.0.70 () {56 vars in 1096 bytes} [Tue May 10 19:08:12 2022] GET /identity/v3/users/swift => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 19:08:12.712553 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153a48cd-62e2-4fcb-aa73-f65f1a0a0491 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:12.716464 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cfc214-519d-45c1-ab1e-38298503ab28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:12.716464 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cfc214-519d-45c1-ab1e-38298503ab28 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:12.716763 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cfc214-519d-45c1-ab1e-38298503ab28 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:12.717037 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cfc214-519d-45c1-ab1e-38298503ab28 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:12.717854 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cfc214-519d-45c1-ab1e-38298503ab28 None admin] RBAC: Adding query filter params (role.id=445805bec1e741c9b823495ae6e364f0, scope.project.id=2ee9ec5b515440fe9b39aedf3e339c79, user.id=058e52f1bf0b4aba965d945815d4acb3) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:08:12.718160 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cfc214-519d-45c1-ab1e-38298503ab28 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:12.719578 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cfc214-519d-45c1-ab1e-38298503ab28 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:12.732570 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 426/863] 10.222.0.70 () {56 vars in 1374 bytes} [Tue May 10 19:08:12 2022] GET /identity/v3/role_assignments?user.id=058e52f1bf0b4aba965d945815d4acb3&scope.project.id=2ee9ec5b515440fe9b39aedf3e339c79&role.id=445805bec1e741c9b823495ae6e364f0 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:08:12.782657 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a919fee2-9cd7-43e7-a963-1eed10826eb4 None None] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:12.783052 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a919fee2-9cd7-43e7-a963-1eed10826eb4 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:12.783317 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a919fee2-9cd7-43e7-a963-1eed10826eb4 None None] PATH_INFO: `/` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:12.789134 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 427/864] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:08:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 19:08:12.791166 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493c6eed-4ea2-4a41-9e9f-f914b5aef44e None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:12.791531 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493c6eed-4ea2-4a41-9e9f-f914b5aef44e None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:12.791891 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493c6eed-4ea2-4a41-9e9f-f914b5aef44e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:12.811926 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-493c6eed-4ea2-4a41-9e9f-f914b5aef44e None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:08:12.813456 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-493c6eed-4ea2-4a41-9e9f-f914b5aef44e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:08:12.830471 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153a48cd-62e2-4fcb-aa73-f65f1a0a0491 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:12.878806 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb5f158-18cf-42cc-8242-296fc9384cfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:12.879689 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb5f158-18cf-42cc-8242-296fc9384cfa None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:12.880050 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb5f158-18cf-42cc-8242-296fc9384cfa None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:12.880398 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb5f158-18cf-42cc-8242-296fc9384cfa None admin] PATH_INFO: `/v3/users` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:12.881380 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb5f158-18cf-42cc-8242-296fc9384cfa None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:08:12.881637 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb5f158-18cf-42cc-8242-296fc9384cfa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:12.883121 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb5f158-18cf-42cc-8242-296fc9384cfa None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:12.888137 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 428/865] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:08:12 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 19:08:12.905989 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 438/866] 10.222.0.70 () {56 vars in 1135 bytes} [Tue May 10 19:08:12 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:08:12.912456 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493c6eed-4ea2-4a41-9e9f-f914b5aef44e None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:12.915524 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb5f158-18cf-42cc-8242-296fc9384cfa None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:13.051344 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb5f158-18cf-42cc-8242-296fc9384cfa None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:13.051940 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493c6eed-4ea2-4a41-9e9f-f914b5aef44e None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:13.098527 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdef563-7c02-4d28-b8ce-fcf4065c97be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:13.099132 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdef563-7c02-4d28-b8ce-fcf4065c97be None admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:13.099415 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdef563-7c02-4d28-b8ce-fcf4065c97be None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:13.099687 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdef563-7c02-4d28-b8ce-fcf4065c97be None admin] PATH_INFO: `/v3/services` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:13.100429 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdef563-7c02-4d28-b8ce-fcf4065c97be None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:13.101798 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdef563-7c02-4d28-b8ce-fcf4065c97be None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:13.104969 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7668232c-5b5d-4b72-89d5-f992a3b4a115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:13.105627 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7668232c-5b5d-4b72-89d5-f992a3b4a115 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:13.105911 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7668232c-5b5d-4b72-89d5-f992a3b4a115 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:13.106185 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7668232c-5b5d-4b72-89d5-f992a3b4a115 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:13.126282 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 439/867] 10.222.0.70 () {60 vars in 1141 bytes} [Tue May 10 19:08:12 2022] POST /identity/v3/services => generated 269 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 19:08:13.192775 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7668232c-5b5d-4b72-89d5-f992a3b4a115 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:13.194324 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7668232c-5b5d-4b72-89d5-f992a3b4a115 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:13.303081 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 429/868] 10.222.0.70 () {58 vars in 1282 bytes} [Tue May 10 19:08:12 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 19:08:13.308402 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdef563-7c02-4d28-b8ce-fcf4065c97be None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:13.417122 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdef563-7c02-4d28-b8ce-fcf4065c97be None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:13.451050 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f50de67-2216-430f-b67a-b8c68706cded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:13.451853 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f50de67-2216-430f-b67a-b8c68706cded None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:13.452136 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f50de67-2216-430f-b67a-b8c68706cded None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:13.452408 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f50de67-2216-430f-b67a-b8c68706cded None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:13.463235 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f50de67-2216-430f-b67a-b8c68706cded None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:13.464778 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f50de67-2216-430f-b67a-b8c68706cded None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:13.481938 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-2f50de67-2216-430f-b67a-b8c68706cded None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:08:13.481938 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:08:13.481938 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:08:13.481938 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:08:13.481938 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:08:13.481938 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:08:13.481938 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:08:13.481938 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:08:13.481938 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:08:13.481938 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:08:13.481938 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:08:13.481938 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:08:13.481938 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 19:08:13.481938 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 19:08:13.481938 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 19:08:13.482862 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 19:08:13.482862 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:08:13.482862 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:08:13.482862 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:08:13.482862 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:08:13.482862 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:08:13.482862 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:08:13.482862 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:08:13.482862 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( May 10 19:08:13.482862 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:08:13.482862 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() May 10 19:08:13.482862 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:08:13.482862 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:08:13.482862 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:08:13.482862 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() May 10 19:08:13.482862 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:08:13.482862 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( May 10 19:08:13.484179 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 19:08:13.484179 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 19:08:13.484179 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:08:13.484179 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:08:13.484179 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 440/869] 10.222.0.70 () {56 vars in 1108 bytes} [Tue May 10 19:08:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:08:13.489028 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7668232c-5b5d-4b72-89d5-f992a3b4a115 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:13.586329 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7668232c-5b5d-4b72-89d5-f992a3b4a115 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:13.620327 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677ddb60-19e7-4026-8ccf-6e536fdfe96e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:13.621016 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677ddb60-19e7-4026-8ccf-6e536fdfe96e None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:13.621297 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677ddb60-19e7-4026-8ccf-6e536fdfe96e None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:13.621567 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677ddb60-19e7-4026-8ccf-6e536fdfe96e None admin] PATH_INFO: `/v3/domains` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:13.622271 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677ddb60-19e7-4026-8ccf-6e536fdfe96e None admin] RBAC: Adding query filter params (name=Default) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:08:13.622572 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677ddb60-19e7-4026-8ccf-6e536fdfe96e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:13.623929 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677ddb60-19e7-4026-8ccf-6e536fdfe96e None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:13.635443 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 430/870] 10.222.0.70 () {56 vars in 1109 bytes} [Tue May 10 19:08:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:08:13.640713 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f50de67-2216-430f-b67a-b8c68706cded None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:13.743965 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f50de67-2216-430f-b67a-b8c68706cded None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:13.777864 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612da5ac-0d2a-4f69-a5bc-f71c532a30c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:13.778668 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612da5ac-0d2a-4f69-a5bc-f71c532a30c4 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:13.778952 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612da5ac-0d2a-4f69-a5bc-f71c532a30c4 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:13.779224 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612da5ac-0d2a-4f69-a5bc-f71c532a30c4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:13.786038 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612da5ac-0d2a-4f69-a5bc-f71c532a30c4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:13.787471 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612da5ac-0d2a-4f69-a5bc-f71c532a30c4 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:13.801974 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-612da5ac-0d2a-4f69-a5bc-f71c532a30c4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 19:08:13.801974 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:08:13.801974 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:08:13.801974 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:08:13.801974 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:08:13.801974 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:08:13.801974 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:08:13.801974 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:08:13.801974 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:08:13.801974 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:08:13.801974 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:08:13.801974 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:08:13.801974 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 19:08:13.801974 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 19:08:13.801974 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 19:08:13.802897 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 19:08:13.802897 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:08:13.802897 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:08:13.802897 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:08:13.802897 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:08:13.802897 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:08:13.802897 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:08:13.802897 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:08:13.802897 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( May 10 19:08:13.802897 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:08:13.802897 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() May 10 19:08:13.802897 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:08:13.802897 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:08:13.802897 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:08:13.802897 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() May 10 19:08:13.802897 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:08:13.802897 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( May 10 19:08:13.804398 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 19:08:13.804398 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 19:08:13.804398 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 19:08:13.804398 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 19:08:13.804398 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 19:08:13.804398 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 19:08:13.804398 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 19:08:13.804398 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:08:13.804398 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 441/871] 10.222.0.70 () {56 vars in 1111 bytes} [Tue May 10 19:08:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:08:13.809502 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677ddb60-19e7-4026-8ccf-6e536fdfe96e None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:13.907569 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677ddb60-19e7-4026-8ccf-6e536fdfe96e None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:13.945130 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c655c1c5-d9fc-482c-b8d7-f39f26ae5489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:13.945814 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c655c1c5-d9fc-482c-b8d7-f39f26ae5489 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:13.946103 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c655c1c5-d9fc-482c-b8d7-f39f26ae5489 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:13.946385 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c655c1c5-d9fc-482c-b8d7-f39f26ae5489 None admin] PATH_INFO: `/v3/projects` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:13.947171 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c655c1c5-d9fc-482c-b8d7-f39f26ae5489 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:08:13.947480 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c655c1c5-d9fc-482c-b8d7-f39f26ae5489 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:13.951099 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c655c1c5-d9fc-482c-b8d7-f39f26ae5489 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:13.964313 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 431/872] 10.222.0.70 () {56 vars in 1148 bytes} [Tue May 10 19:08:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:08:13.976468 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612da5ac-0d2a-4f69-a5bc-f71c532a30c4 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:14.083675 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612da5ac-0d2a-4f69-a5bc-f71c532a30c4 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:14.117409 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604a7914-9324-472f-8170-919d9581666c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:14.118066 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604a7914-9324-472f-8170-919d9581666c None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:14.118345 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604a7914-9324-472f-8170-919d9581666c None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:14.118616 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604a7914-9324-472f-8170-919d9581666c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:14.119441 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604a7914-9324-472f-8170-919d9581666c None admin] RBAC: Adding query filter params (role.id=634ba284303b4626b5a0402772c68f5c, scope.project.id=2ee9ec5b515440fe9b39aedf3e339c79, user.id=0454aa03fa31487ea1464b9d0008212c) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:08:14.119748 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604a7914-9324-472f-8170-919d9581666c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:14.121191 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604a7914-9324-472f-8170-919d9581666c None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:14.127848 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 442/873] 10.222.0.70 () {56 vars in 1374 bytes} [Tue May 10 19:08:13 2022] GET /identity/v3/role_assignments?user.id=0454aa03fa31487ea1464b9d0008212c&scope.project.id=2ee9ec5b515440fe9b39aedf3e339c79&role.id=634ba284303b4626b5a0402772c68f5c => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:08:14.211442 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc9440b-ff7f-4fe1-bc61-a57c0785ddbe None None] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:14.211959 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc9440b-ff7f-4fe1-bc61-a57c0785ddbe None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:14.211959 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc9440b-ff7f-4fe1-bc61-a57c0785ddbe None None] PATH_INFO: `/` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:14.213711 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 432/874] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:08:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:08:14.219348 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceac624f-83b3-4e42-ae49-f128c10bbb19 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:14.219634 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceac624f-83b3-4e42-ae49-f128c10bbb19 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:14.219892 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceac624f-83b3-4e42-ae49-f128c10bbb19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:14.237791 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-ceac624f-83b3-4e42-ae49-f128c10bbb19 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:08:14.238999 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-ceac624f-83b3-4e42-ae49-f128c10bbb19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:08:14.308141 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 443/875] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:08:14 2022] POST /identity/v3/auth/tokens => generated 1261 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 19:08:14.331267 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc9440b-ff7f-4fe1-bc61-a57c0785ddbe None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:14.434829 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc9440b-ff7f-4fe1-bc61-a57c0785ddbe None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:14.468218 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e49bbe6-bdfb-4505-b818-eb922ff39481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:14.468911 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e49bbe6-bdfb-4505-b818-eb922ff39481 None admin] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:14.469192 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e49bbe6-bdfb-4505-b818-eb922ff39481 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:14.469465 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e49bbe6-bdfb-4505-b818-eb922ff39481 None admin] PATH_INFO: `/v3/services` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:14.470240 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e49bbe6-bdfb-4505-b818-eb922ff39481 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:14.471711 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e49bbe6-bdfb-4505-b818-eb922ff39481 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:14.488949 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 433/876] 10.222.0.70 () {60 vars in 1141 bytes} [Tue May 10 19:08:14 2022] POST /identity/v3/services => generated 251 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 19:08:15.214397 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f35995-5e5a-41f1-aa21-26925febe07a None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:15.215060 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f35995-5e5a-41f1-aa21-26925febe07a None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:15.215060 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f35995-5e5a-41f1-aa21-26925febe07a None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:15.216510 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 444/877] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:08:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:08:15.221960 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada7e517-ad2f-4fc0-a6c0-46bf600c52d1 None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:15.222460 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada7e517-ad2f-4fc0-a6c0-46bf600c52d1 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:15.222618 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada7e517-ad2f-4fc0-a6c0-46bf600c52d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:15.239388 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-ada7e517-ad2f-4fc0-a6c0-46bf600c52d1 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:08:15.240577 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-ada7e517-ad2f-4fc0-a6c0-46bf600c52d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:08:15.312648 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 434/878] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:08:15 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 19:08:15.338231 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f35995-5e5a-41f1-aa21-26925febe07a None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:15.437750 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f35995-5e5a-41f1-aa21-26925febe07a None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:15.472147 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90725e4a-79b3-4dc4-9fd2-803e61baf7c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:15.472914 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90725e4a-79b3-4dc4-9fd2-803e61baf7c3 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:15.473191 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90725e4a-79b3-4dc4-9fd2-803e61baf7c3 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:15.473462 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90725e4a-79b3-4dc4-9fd2-803e61baf7c3 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:15.483733 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90725e4a-79b3-4dc4-9fd2-803e61baf7c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:08:15.491778 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-90725e4a-79b3-4dc4-9fd2-803e61baf7c3 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 10 19:08:15.491778 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:08:15.491778 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:08:15.491778 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:08:15.491778 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:08:15.491778 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:08:15.491778 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:08:15.491778 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:08:15.491778 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:08:15.491778 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:08:15.491778 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:08:15.491778 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:08:15.491778 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:08:15.491778 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:08:15.491778 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:08:15.491778 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:08:15.494010 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:08:15.494010 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:08:15.494010 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:08:15.494010 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:08:15.494010 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:08:15.494010 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:08:15.494010 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:08:15.494010 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:08:15.494010 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:08:15.494010 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:08:15.494010 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:08:15.494010 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( May 10 19:08:15.494010 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:08:15.494010 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() May 10 19:08:15.494010 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:08:15.494010 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:08:15.495540 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:08:15.495540 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() May 10 19:08:15.495540 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:08:15.495540 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( May 10 19:08:15.495540 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:08:15.495540 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:08:15.495540 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:08:15.495540 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:08:15.495540 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:08:15.495540 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:08:15.495540 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 10 19:08:15.495540 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:08:15.495540 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 445/879] 10.222.0.70 () {56 vars in 1120 bytes} [Tue May 10 19:08:15 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:08:15.498855 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada7e517-ad2f-4fc0-a6c0-46bf600c52d1 None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:15.511155 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad1fb28-36bf-413f-83e3-2965bc3dcd01 None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:15.511426 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad1fb28-36bf-413f-83e3-2965bc3dcd01 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:15.511711 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad1fb28-36bf-413f-83e3-2965bc3dcd01 None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:15.515471 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 446/880] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:08:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 19:08:15.524308 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024406ea-534b-4aba-b4d3-95d20e45dd21 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:15.524638 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024406ea-534b-4aba-b4d3-95d20e45dd21 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:15.524926 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024406ea-534b-4aba-b4d3-95d20e45dd21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:15.542101 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-024406ea-534b-4aba-b4d3-95d20e45dd21 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:08:15.543285 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-024406ea-534b-4aba-b4d3-95d20e45dd21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:08:15.598630 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada7e517-ad2f-4fc0-a6c0-46bf600c52d1 None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:15.616549 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 447/881] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:08:15 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 19:08:15.632907 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e14efb6-306b-43a7-92ae-5fc61b067083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:15.633582 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e14efb6-306b-43a7-92ae-5fc61b067083 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:15.634023 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e14efb6-306b-43a7-92ae-5fc61b067083 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:15.634212 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e14efb6-306b-43a7-92ae-5fc61b067083 None admin] PATH_INFO: `/v3/roles` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:15.636528 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024406ea-534b-4aba-b4d3-95d20e45dd21 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:15.636736 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e14efb6-306b-43a7-92ae-5fc61b067083 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:08:15.636736 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e14efb6-306b-43a7-92ae-5fc61b067083 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:15.637048 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e14efb6-306b-43a7-92ae-5fc61b067083 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:15.646646 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 435/882] 10.222.0.70 () {56 vars in 1115 bytes} [Tue May 10 19:08:15 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:08:15.651951 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e14efb6-306b-43a7-92ae-5fc61b067083 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:15.739126 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024406ea-534b-4aba-b4d3-95d20e45dd21 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:15.750411 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e14efb6-306b-43a7-92ae-5fc61b067083 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:15.773330 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d359b4a1-a546-4328-aa4a-2846e548e359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:15.774147 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d359b4a1-a546-4328-aa4a-2846e548e359 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:15.774430 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d359b4a1-a546-4328-aa4a-2846e548e359 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:15.774705 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d359b4a1-a546-4328-aa4a-2846e548e359 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:15.775353 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d359b4a1-a546-4328-aa4a-2846e548e359 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:15.776746 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d359b4a1-a546-4328-aa4a-2846e548e359 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:15.784565 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4767e786-ce36-47ac-8b2a-65df5c0e84be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:15.785361 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4767e786-ce36-47ac-8b2a-65df5c0e84be None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:15.785638 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4767e786-ce36-47ac-8b2a-65df5c0e84be None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:15.785907 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4767e786-ce36-47ac-8b2a-65df5c0e84be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:15.788822 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-d359b4a1-a546-4328-aa4a-2846e548e359 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 10 19:08:15.788822 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:08:15.788822 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 19:08:15.788822 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 19:08:15.788822 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 19:08:15.788822 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 19:08:15.788822 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 19:08:15.788822 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 19:08:15.788822 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 10 19:08:15.788822 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:08:15.788822 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 19:08:15.788822 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:08:15.788822 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:08:15.788822 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:08:15.788822 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:08:15.788822 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:08:15.790958 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:08:15.790958 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:08:15.790958 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:08:15.790958 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:08:15.790958 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:08:15.790958 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:08:15.790958 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:08:15.790958 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 19:08:15.790958 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 19:08:15.790958 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 19:08:15.790958 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 19:08:15.790958 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:08:15.790958 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:08:15.790958 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:08:15.790958 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:08:15.790958 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:08:15.792880 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:08:15.792880 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:08:15.792880 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( May 10 19:08:15.792880 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:08:15.792880 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() May 10 19:08:15.792880 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:08:15.792880 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:08:15.792880 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:08:15.792880 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() May 10 19:08:15.792880 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:08:15.792880 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( May 10 19:08:15.792880 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 19:08:15.792880 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 19:08:15.792880 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 10 19:08:15.792880 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:08:15.792880 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 448/883] 10.222.0.70 () {56 vars in 1132 bytes} [Tue May 10 19:08:15 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:08:15.795975 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d359b4a1-a546-4328-aa4a-2846e548e359 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:15.802037 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4767e786-ce36-47ac-8b2a-65df5c0e84be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:15.803753 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4767e786-ce36-47ac-8b2a-65df5c0e84be None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:15.826313 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application [None req-4767e786-ce36-47ac-8b2a-65df5c0e84be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:08:15.826313 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:08:15.826313 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:08:15.826313 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:08:15.826313 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:08:15.826313 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:08:15.826313 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:08:15.826313 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:08:15.826313 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:08:15.826313 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:08:15.826313 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:08:15.826313 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:08:15.826313 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 19:08:15.826313 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 19:08:15.826313 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 19:08:15.827461 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 19:08:15.827461 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:08:15.827461 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:08:15.827461 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:08:15.827461 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:08:15.827461 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:08:15.827461 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:08:15.827461 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:08:15.827461 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application with Lock( May 10 19:08:15.827461 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:08:15.827461 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._enter() May 10 19:08:15.827461 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:08:15.827461 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:08:15.827461 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:08:15.827461 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.creator() May 10 19:08:15.827461 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:08:15.827461 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application created_value = creator( May 10 19:08:15.828620 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 19:08:15.828620 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 19:08:15.828620 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:08:15.828620 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application May 10 19:08:15.831773 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 436/884] 10.222.0.70 () {56 vars in 1108 bytes} [Tue May 10 19:08:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 19:08:15.844464 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4767e786-ce36-47ac-8b2a-65df5c0e84be None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:15.902857 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d359b4a1-a546-4328-aa4a-2846e548e359 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:15.937115 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae84fef-3cc5-48d6-9232-cc1591a65908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:15.938138 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae84fef-3cc5-48d6-9232-cc1591a65908 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:15.938651 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae84fef-3cc5-48d6-9232-cc1591a65908 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:15.939199 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae84fef-3cc5-48d6-9232-cc1591a65908 None admin] PATH_INFO: `/v3/services` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:15.940105 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae84fef-3cc5-48d6-9232-cc1591a65908 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:08:15.940715 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae84fef-3cc5-48d6-9232-cc1591a65908 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:15.945650 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae84fef-3cc5-48d6-9232-cc1591a65908 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:15.961511 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4767e786-ce36-47ac-8b2a-65df5c0e84be None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:15.962180 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 449/885] 10.222.0.70 () {56 vars in 1126 bytes} [Tue May 10 19:08:15 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:08:15.963579 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae84fef-3cc5-48d6-9232-cc1591a65908 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:16.002212 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e157dc93-447d-450c-b703-8b14174c1713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:16.002798 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e157dc93-447d-450c-b703-8b14174c1713 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:16.003080 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e157dc93-447d-450c-b703-8b14174c1713 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:16.003354 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e157dc93-447d-450c-b703-8b14174c1713 None admin] PATH_INFO: `/v3/domains` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:16.004066 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e157dc93-447d-450c-b703-8b14174c1713 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:08:16.004370 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e157dc93-447d-450c-b703-8b14174c1713 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:16.006232 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e157dc93-447d-450c-b703-8b14174c1713 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:16.024503 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 437/886] 10.222.0.70 () {56 vars in 1109 bytes} [Tue May 10 19:08:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:08:16.027005 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e157dc93-447d-450c-b703-8b14174c1713 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:16.070757 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae84fef-3cc5-48d6-9232-cc1591a65908 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:16.104089 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3089fe-a0c7-4321-8ef6-51e4e801d2c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:16.105116 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3089fe-a0c7-4321-8ef6-51e4e801d2c4 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:16.105581 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3089fe-a0c7-4321-8ef6-51e4e801d2c4 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:16.106032 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3089fe-a0c7-4321-8ef6-51e4e801d2c4 None admin] PATH_INFO: `/v3/services` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:16.106930 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3089fe-a0c7-4321-8ef6-51e4e801d2c4 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:08:16.107413 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3089fe-a0c7-4321-8ef6-51e4e801d2c4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:16.109010 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3089fe-a0c7-4321-8ef6-51e4e801d2c4 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:16.119928 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 450/887] 10.222.0.70 () {56 vars in 1126 bytes} [Tue May 10 19:08:15 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:08:16.121480 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3089fe-a0c7-4321-8ef6-51e4e801d2c4 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:16.146465 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e157dc93-447d-450c-b703-8b14174c1713 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:16.188469 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b4207f-bc34-4bca-96de-3783a6222f1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:16.190028 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b4207f-bc34-4bca-96de-3783a6222f1c None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:16.190374 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b4207f-bc34-4bca-96de-3783a6222f1c None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:16.190712 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b4207f-bc34-4bca-96de-3783a6222f1c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:16.200030 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b4207f-bc34-4bca-96de-3783a6222f1c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:16.202085 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b4207f-bc34-4bca-96de-3783a6222f1c None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:16.222060 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application [None req-04b4207f-bc34-4bca-96de-3783a6222f1c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 10 19:08:16.222060 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:08:16.222060 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:08:16.222060 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:08:16.222060 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:08:16.222060 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:08:16.222060 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:08:16.222060 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:08:16.222060 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:08:16.222060 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:08:16.222060 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:08:16.222060 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:08:16.222060 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 19:08:16.222060 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 19:08:16.222060 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 19:08:16.222060 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 19:08:16.223506 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:08:16.223506 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:08:16.223506 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 19:08:16.223506 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 19:08:16.223506 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 19:08:16.223506 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 19:08:16.223506 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:08:16.223506 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:08:16.223506 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:08:16.223506 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:08:16.223506 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:08:16.223506 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application with Lock( May 10 19:08:16.223506 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:08:16.223506 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._enter() May 10 19:08:16.223506 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:08:16.223506 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:08:16.223506 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:08:16.223506 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.creator() May 10 19:08:16.224852 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:08:16.224852 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application created_value = creator( May 10 19:08:16.224852 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 19:08:16.224852 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 19:08:16.224852 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 19:08:16.224852 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 19:08:16.224852 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 19:08:16.224852 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 19:08:16.224852 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 10 19:08:16.224852 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application May 10 19:08:16.227189 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3089fe-a0c7-4321-8ef6-51e4e801d2c4 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:16.228075 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 438/888] 10.222.0.70 () {56 vars in 1117 bytes} [Tue May 10 19:08:16 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:08:16.229002 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b4207f-bc34-4bca-96de-3783a6222f1c None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:16.262545 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c1d4d7-acad-4501-ba37-d8ff8dc6141e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:16.263621 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c1d4d7-acad-4501-ba37-d8ff8dc6141e None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:16.264107 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c1d4d7-acad-4501-ba37-d8ff8dc6141e None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:16.264627 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c1d4d7-acad-4501-ba37-d8ff8dc6141e None admin] PATH_INFO: `/v3/endpoints` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:16.265617 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c1d4d7-acad-4501-ba37-d8ff8dc6141e None admin] RBAC: Adding query filter params (interface=public, service_id=1b40afe2b3c54091812eca41cfc0a85d, region_id=RegionOne) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:08:16.266157 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c1d4d7-acad-4501-ba37-d8ff8dc6141e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:16.267791 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c1d4d7-acad-4501-ba37-d8ff8dc6141e None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:16.280626 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 451/889] 10.222.0.70 () {56 vars in 1251 bytes} [Tue May 10 19:08:16 2022] GET /identity/v3/endpoints?service_id=1b40afe2b3c54091812eca41cfc0a85d&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:08:16.282190 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c1d4d7-acad-4501-ba37-d8ff8dc6141e None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:16.343345 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b4207f-bc34-4bca-96de-3783a6222f1c None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:16.378360 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb40e191-3412-4b66-a66f-4a208e8e43ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:16.379384 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb40e191-3412-4b66-a66f-4a208e8e43ad None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:16.379872 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb40e191-3412-4b66-a66f-4a208e8e43ad None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:16.380354 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb40e191-3412-4b66-a66f-4a208e8e43ad None admin] PATH_INFO: `/v3/users` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:16.381409 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb40e191-3412-4b66-a66f-4a208e8e43ad None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:08:16.381942 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb40e191-3412-4b66-a66f-4a208e8e43ad None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:16.383578 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb40e191-3412-4b66-a66f-4a208e8e43ad None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:16.403549 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 439/890] 10.222.0.70 () {56 vars in 1149 bytes} [Tue May 10 19:08:16 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:08:16.404047 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c1d4d7-acad-4501-ba37-d8ff8dc6141e None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:16.410610 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb40e191-3412-4b66-a66f-4a208e8e43ad None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:16.447757 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01705885-9c59-4d30-85f4-e02779e9aa50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:16.448446 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01705885-9c59-4d30-85f4-e02779e9aa50 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:16.448751 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01705885-9c59-4d30-85f4-e02779e9aa50 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:16.449023 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01705885-9c59-4d30-85f4-e02779e9aa50 None admin] PATH_INFO: `/v3/services` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:16.449708 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01705885-9c59-4d30-85f4-e02779e9aa50 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:16.451065 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01705885-9c59-4d30-85f4-e02779e9aa50 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:16.464451 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 452/891] 10.222.0.70 () {56 vars in 1087 bytes} [Tue May 10 19:08:16 2022] GET /identity/v3/services => generated 1268 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:08:16.500577 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76eb479-8b30-4b62-b3e6-8588829b9962 None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:16.500910 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76eb479-8b30-4b62-b3e6-8588829b9962 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:16.501123 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76eb479-8b30-4b62-b3e6-8588829b9962 None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:16.503379 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 453/892] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:08:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:08:16.509242 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeae1df-accc-4783-adb8-2d2a55ba7709 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:16.509518 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeae1df-accc-4783-adb8-2d2a55ba7709 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:16.509794 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeae1df-accc-4783-adb8-2d2a55ba7709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:16.527442 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-0eeae1df-accc-4783-adb8-2d2a55ba7709 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:08:16.528714 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-0eeae1df-accc-4783-adb8-2d2a55ba7709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:08:16.530567 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb40e191-3412-4b66-a66f-4a208e8e43ad None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:16.578962 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cf1f50-b668-4a66-8081-d915386262da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:16.580411 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cf1f50-b668-4a66-8081-d915386262da None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:16.580778 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cf1f50-b668-4a66-8081-d915386262da None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:16.581052 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cf1f50-b668-4a66-8081-d915386262da None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:16.616449 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 454/893] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:08:16 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 19:08:16.634094 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeae1df-accc-4783-adb8-2d2a55ba7709 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:16.681932 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cf1f50-b668-4a66-8081-d915386262da None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:16.683411 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cf1f50-b668-4a66-8081-d915386262da None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:16.755556 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeae1df-accc-4783-adb8-2d2a55ba7709 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:16.798005 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd207f32-2833-4198-8e6c-b731f3e88c13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:16.798957 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 440/894] 10.222.0.70 () {58 vars in 1282 bytes} [Tue May 10 19:08:16 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 10 19:08:16.799448 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd207f32-2833-4198-8e6c-b731f3e88c13 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:16.799909 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd207f32-2833-4198-8e6c-b731f3e88c13 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:16.800378 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd207f32-2833-4198-8e6c-b731f3e88c13 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:16.800551 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cf1f50-b668-4a66-8081-d915386262da None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:16.801369 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd207f32-2833-4198-8e6c-b731f3e88c13 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:16.803138 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd207f32-2833-4198-8e6c-b731f3e88c13 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:16.818557 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-fd207f32-2833-4198-8e6c-b731f3e88c13 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 19:08:16.818557 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:08:16.818557 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 19:08:16.818557 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 19:08:16.818557 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 19:08:16.818557 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 19:08:16.818557 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 19:08:16.818557 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 19:08:16.818557 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 19:08:16.818557 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:08:16.818557 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 19:08:16.818557 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:08:16.818557 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:08:16.818557 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:08:16.818557 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:08:16.818557 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:08:16.818557 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:08:16.821041 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:08:16.821041 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:08:16.821041 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:08:16.821041 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:08:16.821041 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:08:16.821041 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:08:16.821041 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 19:08:16.821041 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 19:08:16.821041 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 19:08:16.821041 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 19:08:16.821041 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:08:16.821041 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:08:16.821041 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:08:16.821041 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:08:16.821041 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:08:16.821041 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:08:16.823088 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:08:16.823088 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( May 10 19:08:16.823088 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:08:16.823088 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() May 10 19:08:16.823088 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:08:16.823088 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:08:16.823088 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:08:16.823088 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() May 10 19:08:16.823088 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:08:16.823088 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( May 10 19:08:16.823088 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 19:08:16.823088 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 19:08:16.823088 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 19:08:16.823088 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:08:16.823088 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 455/895] 10.222.0.70 () {56 vars in 1126 bytes} [Tue May 10 19:08:16 2022] GET /identity/v3/services/object-store => generated 93 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:08:16.825646 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16749f3d-ef27-4144-8b8d-ceffd38df57b None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:16.825646 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16749f3d-ef27-4144-8b8d-ceffd38df57b None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:16.825646 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16749f3d-ef27-4144-8b8d-ceffd38df57b None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:16.825646 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 456/896] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:08:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:08:16.827345 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16749f3d-ef27-4144-8b8d-ceffd38df57b None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:16.904191 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cf1f50-b668-4a66-8081-d915386262da None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:16.937038 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d466d08d-2685-49b9-9c63-daab6be2e230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:16.937835 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d466d08d-2685-49b9-9c63-daab6be2e230 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:16.938118 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d466d08d-2685-49b9-9c63-daab6be2e230 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:16.938389 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d466d08d-2685-49b9-9c63-daab6be2e230 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:16.941242 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16749f3d-ef27-4144-8b8d-ceffd38df57b None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:16.949292 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d466d08d-2685-49b9-9c63-daab6be2e230 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:16.950854 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d466d08d-2685-49b9-9c63-daab6be2e230 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:16.969271 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application [None req-d466d08d-2685-49b9-9c63-daab6be2e230 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:08:16.969271 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:08:16.969271 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:08:16.969271 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:08:16.969271 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:08:16.969271 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:08:16.969271 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:08:16.969271 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:08:16.969271 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:08:16.969271 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:08:16.969271 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:08:16.969271 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:08:16.969271 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 19:08:16.969271 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 19:08:16.969271 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 19:08:16.970772 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 19:08:16.970772 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:08:16.970772 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:08:16.970772 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:08:16.970772 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:08:16.970772 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:08:16.970772 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:08:16.970772 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:08:16.970772 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application with Lock( May 10 19:08:16.970772 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:08:16.970772 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._enter() May 10 19:08:16.970772 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:08:16.970772 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:08:16.970772 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:08:16.970772 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.creator() May 10 19:08:16.970772 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:08:16.970772 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application created_value = creator( May 10 19:08:16.971687 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 19:08:16.971687 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 19:08:16.971687 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:08:16.971687 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application May 10 19:08:16.971687 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 441/897] 10.222.0.70 () {56 vars in 1108 bytes} [Tue May 10 19:08:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:08:16.972348 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e39a00-a59c-4cb3-a532-52d2e21a7220 None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:16.972816 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e39a00-a59c-4cb3-a532-52d2e21a7220 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:16.972920 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e39a00-a59c-4cb3-a532-52d2e21a7220 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:16.986547 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce98646-da60-4c7e-bb14-52ad00d887af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:16.987217 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce98646-da60-4c7e-bb14-52ad00d887af None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:16.987500 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce98646-da60-4c7e-bb14-52ad00d887af None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:16.987776 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce98646-da60-4c7e-bb14-52ad00d887af None admin] PATH_INFO: `/v3/services` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:16.988521 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce98646-da60-4c7e-bb14-52ad00d887af None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:08:16.988828 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce98646-da60-4c7e-bb14-52ad00d887af None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:16.989020 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-24e39a00-a59c-4cb3-a532-52d2e21a7220 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:08:16.990171 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-24e39a00-a59c-4cb3-a532-52d2e21a7220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:08:16.990326 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce98646-da60-4c7e-bb14-52ad00d887af None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:17.001241 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 457/898] 10.222.0.70 () {56 vars in 1122 bytes} [Tue May 10 19:08:16 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:08:17.001241 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce98646-da60-4c7e-bb14-52ad00d887af None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:17.063398 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 442/899] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:08:16 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 19:08:17.064573 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e39a00-a59c-4cb3-a532-52d2e21a7220 None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:17.117092 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce98646-da60-4c7e-bb14-52ad00d887af None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:17.148131 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a32dfd-c810-4aec-8cbb-58c8d4a6759f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:17.148812 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a32dfd-c810-4aec-8cbb-58c8d4a6759f None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:17.149091 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a32dfd-c810-4aec-8cbb-58c8d4a6759f None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:17.149364 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a32dfd-c810-4aec-8cbb-58c8d4a6759f None admin] PATH_INFO: `/v3/domains` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:17.150072 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a32dfd-c810-4aec-8cbb-58c8d4a6759f None admin] RBAC: Adding query filter params (name=Default) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:08:17.150374 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a32dfd-c810-4aec-8cbb-58c8d4a6759f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:17.151725 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a32dfd-c810-4aec-8cbb-58c8d4a6759f None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:17.168836 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 458/900] 10.222.0.70 () {56 vars in 1109 bytes} [Tue May 10 19:08:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:08:17.169015 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e39a00-a59c-4cb3-a532-52d2e21a7220 None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:17.169110 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a32dfd-c810-4aec-8cbb-58c8d4a6759f None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:17.201969 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6d6ea2-4e6d-49f2-9948-ae654116ed58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:17.202638 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6d6ea2-4e6d-49f2-9948-ae654116ed58 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:17.202924 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6d6ea2-4e6d-49f2-9948-ae654116ed58 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:17.203200 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6d6ea2-4e6d-49f2-9948-ae654116ed58 None admin] PATH_INFO: `/v3/services` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:17.203905 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6d6ea2-4e6d-49f2-9948-ae654116ed58 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:08:17.204213 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6d6ea2-4e6d-49f2-9948-ae654116ed58 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:17.205675 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6d6ea2-4e6d-49f2-9948-ae654116ed58 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:17.210908 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 443/901] 10.222.0.70 () {56 vars in 1122 bytes} [Tue May 10 19:08:17 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:08:17.211691 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6d6ea2-4e6d-49f2-9948-ae654116ed58 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:17.272478 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a32dfd-c810-4aec-8cbb-58c8d4a6759f None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:17.314810 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c6c778-b716-4fb6-aaf1-4a71e7a0e1ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:17.316012 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c6c778-b716-4fb6-aaf1-4a71e7a0e1ee None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:17.316553 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c6c778-b716-4fb6-aaf1-4a71e7a0e1ee None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:17.317034 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c6c778-b716-4fb6-aaf1-4a71e7a0e1ee None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:17.318065 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c6c778-b716-4fb6-aaf1-4a71e7a0e1ee None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:17.320377 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c6c778-b716-4fb6-aaf1-4a71e7a0e1ee None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:17.330872 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6d6ea2-4e6d-49f2-9948-ae654116ed58 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:17.337024 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-f0c6c778-b716-4fb6-aaf1-4a71e7a0e1ee None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 10 19:08:17.337024 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:08:17.337024 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 19:08:17.337024 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 19:08:17.337024 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 19:08:17.337024 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 19:08:17.337024 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 19:08:17.337024 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 19:08:17.337024 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 10 19:08:17.337024 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:08:17.337024 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 19:08:17.337024 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:08:17.337024 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:08:17.337024 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:08:17.337024 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:08:17.337024 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:08:17.337024 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:08:17.338064 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:08:17.338064 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:08:17.338064 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:08:17.338064 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:08:17.338064 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:08:17.338064 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:08:17.338064 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 19:08:17.338064 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 19:08:17.338064 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 19:08:17.338064 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 19:08:17.338064 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:08:17.338064 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:08:17.338064 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:08:17.338064 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:08:17.338064 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:08:17.338064 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:08:17.338910 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:08:17.338910 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( May 10 19:08:17.338910 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:08:17.338910 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() May 10 19:08:17.338910 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:08:17.338910 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:08:17.338910 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:08:17.338910 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() May 10 19:08:17.338910 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:08:17.338910 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( May 10 19:08:17.338910 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 19:08:17.338910 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 19:08:17.338910 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 10 19:08:17.338910 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:08:17.341950 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 459/902] 10.222.0.70 () {56 vars in 1114 bytes} [Tue May 10 19:08:17 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:08:17.348469 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c6c778-b716-4fb6-aaf1-4a71e7a0e1ee None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:17.370074 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dffe902-f356-438c-8afd-0396a395ace9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:17.371283 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dffe902-f356-438c-8afd-0396a395ace9 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:17.371800 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dffe902-f356-438c-8afd-0396a395ace9 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:17.372280 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dffe902-f356-438c-8afd-0396a395ace9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:17.380006 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dffe902-f356-438c-8afd-0396a395ace9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:17.381876 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dffe902-f356-438c-8afd-0396a395ace9 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:17.397005 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application [None req-2dffe902-f356-438c-8afd-0396a395ace9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 19:08:17.397005 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:08:17.397005 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:08:17.397005 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:08:17.397005 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:08:17.397005 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:08:17.397005 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:08:17.397005 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:08:17.397005 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:08:17.397005 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:08:17.397005 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:08:17.397005 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:08:17.397005 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 19:08:17.397005 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 19:08:17.397005 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 19:08:17.397997 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 19:08:17.397997 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:08:17.397997 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:08:17.397997 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:08:17.397997 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:08:17.397997 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:08:17.397997 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:08:17.397997 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:08:17.397997 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application with Lock( May 10 19:08:17.397997 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:08:17.397997 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._enter() May 10 19:08:17.397997 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:08:17.397997 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:08:17.397997 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:08:17.397997 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.creator() May 10 19:08:17.397997 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:08:17.397997 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application created_value = creator( May 10 19:08:17.398914 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 19:08:17.398914 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 19:08:17.398914 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 19:08:17.398914 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 19:08:17.398914 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 19:08:17.398914 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 19:08:17.398914 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 19:08:17.398914 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application May 10 19:08:17.398914 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 444/903] 10.222.0.70 () {56 vars in 1111 bytes} [Tue May 10 19:08:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:08:17.405291 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dffe902-f356-438c-8afd-0396a395ace9 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:17.468625 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c6c778-b716-4fb6-aaf1-4a71e7a0e1ee None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:17.511703 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55264ff6-6196-4038-a034-8475548f0e81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:17.512957 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55264ff6-6196-4038-a034-8475548f0e81 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:17.513248 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55264ff6-6196-4038-a034-8475548f0e81 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:17.513528 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55264ff6-6196-4038-a034-8475548f0e81 None admin] PATH_INFO: `/v3/services` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:17.514237 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55264ff6-6196-4038-a034-8475548f0e81 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:08:17.514541 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55264ff6-6196-4038-a034-8475548f0e81 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:17.515032 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dffe902-f356-438c-8afd-0396a395ace9 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:17.515899 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55264ff6-6196-4038-a034-8475548f0e81 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:17.522482 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 460/904] 10.222.0.70 () {56 vars in 1114 bytes} [Tue May 10 19:08:17 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:08:17.528932 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55264ff6-6196-4038-a034-8475548f0e81 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:17.569500 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf01bff1-0cb6-46e2-9690-9649f9e79a91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:17.570688 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf01bff1-0cb6-46e2-9690-9649f9e79a91 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:17.570985 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf01bff1-0cb6-46e2-9690-9649f9e79a91 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:17.571264 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf01bff1-0cb6-46e2-9690-9649f9e79a91 None admin] PATH_INFO: `/v3/projects` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:17.572210 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf01bff1-0cb6-46e2-9690-9649f9e79a91 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:08:17.572860 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf01bff1-0cb6-46e2-9690-9649f9e79a91 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:17.574604 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf01bff1-0cb6-46e2-9690-9649f9e79a91 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:17.600531 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 445/905] 10.222.0.70 () {56 vars in 1148 bytes} [Tue May 10 19:08:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:08:17.601956 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf01bff1-0cb6-46e2-9690-9649f9e79a91 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:17.660248 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55264ff6-6196-4038-a034-8475548f0e81 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:17.703418 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44379d2-7f20-48c4-bf5a-bfd5bd573704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:17.704256 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44379d2-7f20-48c4-bf5a-bfd5bd573704 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:17.704850 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44379d2-7f20-48c4-bf5a-bfd5bd573704 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:17.705135 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44379d2-7f20-48c4-bf5a-bfd5bd573704 None admin] PATH_INFO: `/v3/services` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:17.705864 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44379d2-7f20-48c4-bf5a-bfd5bd573704 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:08:17.707055 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44379d2-7f20-48c4-bf5a-bfd5bd573704 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:17.708464 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44379d2-7f20-48c4-bf5a-bfd5bd573704 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:17.711248 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf01bff1-0cb6-46e2-9690-9649f9e79a91 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:17.718320 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 461/906] 10.222.0.70 () {56 vars in 1114 bytes} [Tue May 10 19:08:17 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:08:17.719870 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44379d2-7f20-48c4-bf5a-bfd5bd573704 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:17.753789 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d4c51c-30ff-41b8-b9e0-b7d1e238c135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:17.755035 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d4c51c-30ff-41b8-b9e0-b7d1e238c135 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:17.756346 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d4c51c-30ff-41b8-b9e0-b7d1e238c135 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:17.756849 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d4c51c-30ff-41b8-b9e0-b7d1e238c135 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:17.758020 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d4c51c-30ff-41b8-b9e0-b7d1e238c135 None admin] RBAC: Adding query filter params (role.id=128f76acc6c8422797401b4d627ca236, scope.project.id=2ee9ec5b515440fe9b39aedf3e339c79, user.id=058e52f1bf0b4aba965d945815d4acb3) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:08:17.758525 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d4c51c-30ff-41b8-b9e0-b7d1e238c135 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:17.760299 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d4c51c-30ff-41b8-b9e0-b7d1e238c135 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:17.768705 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 446/907] 10.222.0.70 () {56 vars in 1374 bytes} [Tue May 10 19:08:17 2022] GET /identity/v3/role_assignments?user.id=058e52f1bf0b4aba965d945815d4acb3&scope.project.id=2ee9ec5b515440fe9b39aedf3e339c79&role.id=128f76acc6c8422797401b4d627ca236 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:08:17.838071 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44379d2-7f20-48c4-bf5a-bfd5bd573704 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:17.874750 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf99752-49dc-4f83-ab09-a3a7686084d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:17.875481 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf99752-49dc-4f83-ab09-a3a7686084d2 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:17.875771 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf99752-49dc-4f83-ab09-a3a7686084d2 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:17.876050 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf99752-49dc-4f83-ab09-a3a7686084d2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:17.877429 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf99752-49dc-4f83-ab09-a3a7686084d2 None admin] RBAC: Adding query filter params (interface=public, service_id=4f20a00ff8d24210933cb54459596df3, region_id=RegionOne) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:08:17.877741 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf99752-49dc-4f83-ab09-a3a7686084d2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:17.879121 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf99752-49dc-4f83-ab09-a3a7686084d2 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:17.888868 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 462/908] 10.222.0.70 () {56 vars in 1251 bytes} [Tue May 10 19:08:17 2022] GET /identity/v3/endpoints?service_id=4f20a00ff8d24210933cb54459596df3&interface=public®ion_id=RegionOne => generated 194 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:08:17.891139 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d4c51c-30ff-41b8-b9e0-b7d1e238c135 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:18.005310 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d4c51c-30ff-41b8-b9e0-b7d1e238c135 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:18.038773 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33cac16-5a24-425a-899b-9bcaacdb213f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:18.039450 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33cac16-5a24-425a-899b-9bcaacdb213f None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:18.039738 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33cac16-5a24-425a-899b-9bcaacdb213f None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:18.040017 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33cac16-5a24-425a-899b-9bcaacdb213f None admin] PATH_INFO: `/v3/services` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:18.040724 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33cac16-5a24-425a-899b-9bcaacdb213f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:18.042101 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33cac16-5a24-425a-899b-9bcaacdb213f None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:18.052554 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 447/909] 10.222.0.70 () {56 vars in 1087 bytes} [Tue May 10 19:08:17 2022] GET /identity/v3/services => generated 1268 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:08:18.755803 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca261b0-3a1f-414d-b6bc-4613298db2b3 None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:18.756842 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca261b0-3a1f-414d-b6bc-4613298db2b3 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:18.757346 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca261b0-3a1f-414d-b6bc-4613298db2b3 None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:18.759454 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 463/910] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:08:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:08:18.765583 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07d61c6-532a-4f41-8c8a-0878c2199297 None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:18.766409 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07d61c6-532a-4f41-8c8a-0878c2199297 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:18.766899 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07d61c6-532a-4f41-8c8a-0878c2199297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:18.784042 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-f07d61c6-532a-4f41-8c8a-0878c2199297 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:08:18.785506 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-f07d61c6-532a-4f41-8c8a-0878c2199297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:08:18.852329 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 448/911] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:08:18 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 19:08:18.875889 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca261b0-3a1f-414d-b6bc-4613298db2b3 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:18.993381 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca261b0-3a1f-414d-b6bc-4613298db2b3 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:19.027822 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516bf24e-3e13-471e-b632-af78db3801ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:19.028602 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516bf24e-3e13-471e-b632-af78db3801ff None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:19.028885 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516bf24e-3e13-471e-b632-af78db3801ff None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:19.029161 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516bf24e-3e13-471e-b632-af78db3801ff None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:19.029811 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516bf24e-3e13-471e-b632-af78db3801ff None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:19.031182 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516bf24e-3e13-471e-b632-af78db3801ff None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:19.043194 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-516bf24e-3e13-471e-b632-af78db3801ff None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 10 19:08:19.043194 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:08:19.043194 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 19:08:19.043194 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 19:08:19.043194 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 19:08:19.043194 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 19:08:19.043194 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 19:08:19.043194 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 19:08:19.043194 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 10 19:08:19.043194 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:08:19.043194 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 19:08:19.043194 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:08:19.043194 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:08:19.043194 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:08:19.043194 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:08:19.043194 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:08:19.044214 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:08:19.044214 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:08:19.044214 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:08:19.044214 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:08:19.044214 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:08:19.044214 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:08:19.044214 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:08:19.044214 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 19:08:19.044214 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 19:08:19.044214 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 19:08:19.044214 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 19:08:19.044214 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:08:19.044214 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:08:19.044214 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:08:19.044214 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:08:19.044214 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:08:19.045172 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:08:19.045172 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:08:19.045172 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( May 10 19:08:19.045172 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:08:19.045172 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() May 10 19:08:19.045172 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:08:19.045172 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:08:19.045172 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:08:19.045172 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() May 10 19:08:19.045172 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:08:19.045172 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( May 10 19:08:19.045172 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 19:08:19.045172 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 19:08:19.045172 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 10 19:08:19.045172 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:08:19.045172 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 464/912] 10.222.0.70 () {56 vars in 1132 bytes} [Tue May 10 19:08:18 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:08:19.054020 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07d61c6-532a-4f41-8c8a-0878c2199297 None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:19.159033 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07d61c6-532a-4f41-8c8a-0878c2199297 None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:19.194325 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef36270b-e4e8-40b2-8757-fdb61e306fe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:19.195376 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef36270b-e4e8-40b2-8757-fdb61e306fe1 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:19.195931 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef36270b-e4e8-40b2-8757-fdb61e306fe1 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:19.196411 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef36270b-e4e8-40b2-8757-fdb61e306fe1 None admin] PATH_INFO: `/v3/services` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:19.197350 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef36270b-e4e8-40b2-8757-fdb61e306fe1 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:08:19.197866 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef36270b-e4e8-40b2-8757-fdb61e306fe1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:19.199435 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef36270b-e4e8-40b2-8757-fdb61e306fe1 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:19.204651 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 449/913] 10.222.0.70 () {56 vars in 1126 bytes} [Tue May 10 19:08:19 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:08:19.210835 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516bf24e-3e13-471e-b632-af78db3801ff None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:19.314600 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516bf24e-3e13-471e-b632-af78db3801ff None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:19.352954 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f68346d-4cb7-4078-94c3-6000ead7a9ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:19.353631 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f68346d-4cb7-4078-94c3-6000ead7a9ad None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:19.353913 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f68346d-4cb7-4078-94c3-6000ead7a9ad None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:19.354187 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f68346d-4cb7-4078-94c3-6000ead7a9ad None admin] PATH_INFO: `/v3/services` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:19.354899 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f68346d-4cb7-4078-94c3-6000ead7a9ad None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:08:19.355203 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f68346d-4cb7-4078-94c3-6000ead7a9ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:19.356596 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f68346d-4cb7-4078-94c3-6000ead7a9ad None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:19.362518 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 465/914] 10.222.0.70 () {56 vars in 1126 bytes} [Tue May 10 19:08:19 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:08:19.368075 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef36270b-e4e8-40b2-8757-fdb61e306fe1 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:19.467359 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef36270b-e4e8-40b2-8757-fdb61e306fe1 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:19.502192 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57f01ec-2229-483d-8807-89542f5f3faf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:19.503227 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57f01ec-2229-483d-8807-89542f5f3faf None admin] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:19.503751 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57f01ec-2229-483d-8807-89542f5f3faf None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:19.504233 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57f01ec-2229-483d-8807-89542f5f3faf None admin] PATH_INFO: `/v3/endpoints` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:19.505199 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57f01ec-2229-483d-8807-89542f5f3faf None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:19.506777 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57f01ec-2229-483d-8807-89542f5f3faf None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:19.511713 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90485ad-c09e-4832-ba2b-bef8f1ac8a71 None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:19.512004 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90485ad-c09e-4832-ba2b-bef8f1ac8a71 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:19.512279 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90485ad-c09e-4832-ba2b-bef8f1ac8a71 None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:19.513783 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 466/915] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:08:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 19:08:19.522338 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920c1c33-ea19-4a95-ae39-920c2bc25469 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:19.522625 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920c1c33-ea19-4a95-ae39-920c2bc25469 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:19.522900 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920c1c33-ea19-4a95-ae39-920c2bc25469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:19.531601 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 450/916] 10.222.0.70 () {60 vars in 1144 bytes} [Tue May 10 19:08:19 2022] POST /identity/v3/endpoints => generated 347 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:08:19.547583 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-920c1c33-ea19-4a95-ae39-920c2bc25469 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:08:19.549772 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-920c1c33-ea19-4a95-ae39-920c2bc25469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:08:19.633139 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 467/917] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:08:19 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 19:08:19.656919 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57f01ec-2229-483d-8807-89542f5f3faf None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:19.763146 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57f01ec-2229-483d-8807-89542f5f3faf None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:19.797493 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785df410-b38f-4998-8276-37684693e14b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:19.798777 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785df410-b38f-4998-8276-37684693e14b None admin] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:19.798966 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785df410-b38f-4998-8276-37684693e14b None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:19.799241 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785df410-b38f-4998-8276-37684693e14b None admin] PATH_INFO: `/v3/services` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:19.799975 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785df410-b38f-4998-8276-37684693e14b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:19.801385 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785df410-b38f-4998-8276-37684693e14b None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:19.815332 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 451/918] 10.222.0.70 () {60 vars in 1141 bytes} [Tue May 10 19:08:19 2022] POST /identity/v3/services => generated 241 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:08:20.044084 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a9b2e2-4f23-4f0e-814b-f7991bd6e97b None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:20.044708 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a9b2e2-4f23-4f0e-814b-f7991bd6e97b None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:20.044708 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a9b2e2-4f23-4f0e-814b-f7991bd6e97b None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:20.046237 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 468/919] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:08:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:08:20.052368 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddcc438-eebf-414f-bff4-c21aaf0a966d None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:20.052701 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddcc438-eebf-414f-bff4-c21aaf0a966d None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:20.052983 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddcc438-eebf-414f-bff4-c21aaf0a966d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:20.069491 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-4ddcc438-eebf-414f-bff4-c21aaf0a966d None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:08:20.070650 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-4ddcc438-eebf-414f-bff4-c21aaf0a966d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:08:20.143224 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 452/920] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:08:20 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 19:08:20.165829 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a9b2e2-4f23-4f0e-814b-f7991bd6e97b None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:20.275683 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a9b2e2-4f23-4f0e-814b-f7991bd6e97b None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:20.309470 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee4bb85-719c-4f25-9de9-bcc44ed35e61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:20.310322 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee4bb85-719c-4f25-9de9-bcc44ed35e61 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:20.310601 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee4bb85-719c-4f25-9de9-bcc44ed35e61 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:20.310868 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee4bb85-719c-4f25-9de9-bcc44ed35e61 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:20.321272 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee4bb85-719c-4f25-9de9-bcc44ed35e61 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:08:20.329953 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-2ee4bb85-719c-4f25-9de9-bcc44ed35e61 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 10 19:08:20.329953 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:08:20.329953 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:08:20.329953 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:08:20.329953 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:08:20.329953 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:08:20.329953 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:08:20.329953 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:08:20.329953 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:08:20.329953 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:08:20.329953 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:08:20.329953 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:08:20.329953 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:08:20.329953 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:08:20.329953 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:08:20.329953 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:08:20.330955 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:08:20.330955 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:08:20.330955 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:08:20.330955 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:08:20.330955 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:08:20.330955 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:08:20.330955 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:08:20.330955 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:08:20.330955 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:08:20.330955 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:08:20.330955 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:08:20.330955 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( May 10 19:08:20.330955 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:08:20.330955 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() May 10 19:08:20.330955 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:08:20.330955 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:08:20.332108 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:08:20.332108 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() May 10 19:08:20.332108 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:08:20.332108 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( May 10 19:08:20.332108 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:08:20.332108 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:08:20.332108 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:08:20.332108 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:08:20.332108 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:08:20.332108 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:08:20.332108 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 10 19:08:20.332108 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:08:20.332108 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 469/921] 10.222.0.70 () {56 vars in 1120 bytes} [Tue May 10 19:08:20 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:08:20.337374 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddcc438-eebf-414f-bff4-c21aaf0a966d None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:20.382103 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5638d5-c2fc-4d7f-a0db-ed45ba21394d None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:20.382379 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5638d5-c2fc-4d7f-a0db-ed45ba21394d None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:20.382650 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5638d5-c2fc-4d7f-a0db-ed45ba21394d None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:20.384262 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 470/922] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:08:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 19:08:20.389178 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a60cb4-c6eb-4778-9e7e-dbd94d14e17e None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:20.389462 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a60cb4-c6eb-4778-9e7e-dbd94d14e17e None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:20.389738 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a60cb4-c6eb-4778-9e7e-dbd94d14e17e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:20.406890 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-e0a60cb4-c6eb-4778-9e7e-dbd94d14e17e None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:08:20.408123 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-e0a60cb4-c6eb-4778-9e7e-dbd94d14e17e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:08:20.440512 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddcc438-eebf-414f-bff4-c21aaf0a966d None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:20.475202 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 471/923] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:08:20 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 19:08:20.477119 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2424a3-7020-46b2-a06e-fc9ed9e88884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:20.477785 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2424a3-7020-46b2-a06e-fc9ed9e88884 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:20.478064 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2424a3-7020-46b2-a06e-fc9ed9e88884 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:20.478336 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2424a3-7020-46b2-a06e-fc9ed9e88884 None admin] PATH_INFO: `/v3/roles` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:20.479079 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2424a3-7020-46b2-a06e-fc9ed9e88884 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:08:20.479377 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2424a3-7020-46b2-a06e-fc9ed9e88884 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:20.480780 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2424a3-7020-46b2-a06e-fc9ed9e88884 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:20.489762 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 453/924] 10.222.0.70 () {56 vars in 1115 bytes} [Tue May 10 19:08:20 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:08:20.495070 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a60cb4-c6eb-4778-9e7e-dbd94d14e17e None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:20.502745 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2424a3-7020-46b2-a06e-fc9ed9e88884 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:20.602466 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2424a3-7020-46b2-a06e-fc9ed9e88884 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:20.620581 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a60cb4-c6eb-4778-9e7e-dbd94d14e17e None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:20.637842 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cca1609-f6e3-411f-820c-d5a039989b8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:20.638645 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cca1609-f6e3-411f-820c-d5a039989b8b None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:20.638925 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cca1609-f6e3-411f-820c-d5a039989b8b None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:20.639197 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cca1609-f6e3-411f-820c-d5a039989b8b None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:20.639848 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cca1609-f6e3-411f-820c-d5a039989b8b None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:20.641249 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cca1609-f6e3-411f-820c-d5a039989b8b None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:20.652994 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application [None req-5cca1609-f6e3-411f-820c-d5a039989b8b None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 10 19:08:20.652994 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:08:20.652994 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 19:08:20.652994 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 19:08:20.652994 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 19:08:20.652994 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 19:08:20.652994 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 19:08:20.652994 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 19:08:20.652994 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 10 19:08:20.652994 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application May 10 19:08:20.652994 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 19:08:20.652994 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application May 10 19:08:20.652994 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:08:20.652994 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:08:20.652994 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:08:20.652994 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:08:20.652994 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:08:20.655636 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:08:20.655636 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:08:20.655636 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:08:20.655636 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:08:20.655636 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:08:20.655636 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:08:20.655636 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 19:08:20.655636 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 19:08:20.655636 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 19:08:20.655636 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 19:08:20.655636 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:08:20.655636 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:08:20.655636 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:08:20.655636 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:08:20.655636 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:08:20.655636 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:08:20.657340 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:08:20.657340 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application with Lock( May 10 19:08:20.657340 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:08:20.657340 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._enter() May 10 19:08:20.657340 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:08:20.657340 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:08:20.657340 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:08:20.657340 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.creator() May 10 19:08:20.657340 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:08:20.657340 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application created_value = creator( May 10 19:08:20.657340 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 19:08:20.657340 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 19:08:20.657340 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 10 19:08:20.657340 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application May 10 19:08:20.659793 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 454/925] 10.222.0.70 () {56 vars in 1114 bytes} [Tue May 10 19:08:20 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:08:20.660734 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cca1609-f6e3-411f-820c-d5a039989b8b None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:20.662172 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec267894-01ba-4cc3-82b0-1f35bf0af3a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:20.663156 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec267894-01ba-4cc3-82b0-1f35bf0af3a4 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:20.663765 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec267894-01ba-4cc3-82b0-1f35bf0af3a4 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:20.664897 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec267894-01ba-4cc3-82b0-1f35bf0af3a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:20.680400 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec267894-01ba-4cc3-82b0-1f35bf0af3a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:20.682176 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec267894-01ba-4cc3-82b0-1f35bf0af3a4 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:20.704119 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-ec267894-01ba-4cc3-82b0-1f35bf0af3a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:08:20.704119 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:08:20.704119 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:08:20.704119 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:08:20.704119 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:08:20.704119 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:08:20.704119 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:08:20.704119 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:08:20.704119 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:08:20.704119 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:08:20.704119 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:08:20.704119 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:08:20.704119 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 19:08:20.704119 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 19:08:20.704119 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 19:08:20.705192 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 19:08:20.705192 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:08:20.705192 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:08:20.705192 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:08:20.705192 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:08:20.705192 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:08:20.705192 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:08:20.705192 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:08:20.705192 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( May 10 19:08:20.705192 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:08:20.705192 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() May 10 19:08:20.705192 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:08:20.705192 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:08:20.705192 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:08:20.705192 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() May 10 19:08:20.705192 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:08:20.705192 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( May 10 19:08:20.706104 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 19:08:20.706104 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 19:08:20.706104 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:08:20.706104 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:08:20.708821 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 472/926] 10.222.0.70 () {56 vars in 1108 bytes} [Tue May 10 19:08:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:08:20.711427 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec267894-01ba-4cc3-82b0-1f35bf0af3a4 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:20.778231 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cca1609-f6e3-411f-820c-d5a039989b8b None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:20.817973 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b52fb02-d832-4b10-9d38-c8535d5e7e13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:20.818626 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b52fb02-d832-4b10-9d38-c8535d5e7e13 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:20.818858 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b52fb02-d832-4b10-9d38-c8535d5e7e13 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:20.819105 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b52fb02-d832-4b10-9d38-c8535d5e7e13 None admin] PATH_INFO: `/v3/services` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:20.819803 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b52fb02-d832-4b10-9d38-c8535d5e7e13 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:08:20.820350 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b52fb02-d832-4b10-9d38-c8535d5e7e13 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:20.821498 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b52fb02-d832-4b10-9d38-c8535d5e7e13 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:20.823916 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec267894-01ba-4cc3-82b0-1f35bf0af3a4 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:20.830878 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 455/927] 10.222.0.70 () {56 vars in 1114 bytes} [Tue May 10 19:08:20 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:08:20.831992 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b52fb02-d832-4b10-9d38-c8535d5e7e13 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:20.867787 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87b08fa-a360-43ca-8824-7850f3653b57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:20.868824 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87b08fa-a360-43ca-8824-7850f3653b57 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:20.869441 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87b08fa-a360-43ca-8824-7850f3653b57 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:20.869933 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87b08fa-a360-43ca-8824-7850f3653b57 None admin] PATH_INFO: `/v3/domains` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:20.871287 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87b08fa-a360-43ca-8824-7850f3653b57 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:08:20.871805 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87b08fa-a360-43ca-8824-7850f3653b57 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:20.873814 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87b08fa-a360-43ca-8824-7850f3653b57 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:20.889711 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 473/928] 10.222.0.70 () {56 vars in 1109 bytes} [Tue May 10 19:08:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:08:20.895074 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87b08fa-a360-43ca-8824-7850f3653b57 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:20.942634 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b52fb02-d832-4b10-9d38-c8535d5e7e13 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:20.988008 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fc53f2-8617-46cd-9271-dc40c278f94d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:20.988703 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fc53f2-8617-46cd-9271-dc40c278f94d None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:20.988987 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fc53f2-8617-46cd-9271-dc40c278f94d None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:20.989261 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fc53f2-8617-46cd-9271-dc40c278f94d None admin] PATH_INFO: `/v3/services` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:20.989962 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fc53f2-8617-46cd-9271-dc40c278f94d None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:08:20.990267 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fc53f2-8617-46cd-9271-dc40c278f94d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:20.991636 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fc53f2-8617-46cd-9271-dc40c278f94d None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:21.001406 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 456/929] 10.222.0.70 () {56 vars in 1114 bytes} [Tue May 10 19:08:20 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:08:21.002508 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fc53f2-8617-46cd-9271-dc40c278f94d None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:21.025023 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87b08fa-a360-43ca-8824-7850f3653b57 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:21.069306 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc81fdf2-dde8-42a2-a22d-e00dc20bf4e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:21.071543 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc81fdf2-dde8-42a2-a22d-e00dc20bf4e0 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:21.072313 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc81fdf2-dde8-42a2-a22d-e00dc20bf4e0 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:21.072828 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc81fdf2-dde8-42a2-a22d-e00dc20bf4e0 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:21.083632 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc81fdf2-dde8-42a2-a22d-e00dc20bf4e0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:21.086050 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc81fdf2-dde8-42a2-a22d-e00dc20bf4e0 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:21.105674 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-cc81fdf2-dde8-42a2-a22d-e00dc20bf4e0 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 10 19:08:21.105674 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:08:21.105674 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:08:21.105674 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:08:21.105674 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:08:21.105674 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:08:21.105674 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:08:21.105674 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:08:21.105674 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:08:21.105674 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:08:21.105674 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:08:21.105674 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:08:21.105674 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 19:08:21.105674 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 19:08:21.105674 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 19:08:21.105674 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 19:08:21.106726 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:08:21.106726 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:08:21.106726 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 19:08:21.106726 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 19:08:21.106726 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 19:08:21.106726 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 19:08:21.106726 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:08:21.106726 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:08:21.106726 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:08:21.106726 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:08:21.106726 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:08:21.106726 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( May 10 19:08:21.106726 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:08:21.106726 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() May 10 19:08:21.106726 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:08:21.106726 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:08:21.106726 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:08:21.106726 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() May 10 19:08:21.107720 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:08:21.107720 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( May 10 19:08:21.107720 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 19:08:21.107720 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 19:08:21.107720 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 19:08:21.107720 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 19:08:21.107720 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 19:08:21.107720 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 19:08:21.107720 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 10 19:08:21.107720 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:08:21.108300 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fc53f2-8617-46cd-9271-dc40c278f94d None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:21.116227 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 474/930] 10.222.0.70 () {56 vars in 1117 bytes} [Tue May 10 19:08:20 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:08:21.117394 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc81fdf2-dde8-42a2-a22d-e00dc20bf4e0 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:21.143411 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac327db-14da-47c3-8006-2a0614589f58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:21.144171 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac327db-14da-47c3-8006-2a0614589f58 None admin] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:21.144285 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac327db-14da-47c3-8006-2a0614589f58 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:21.144576 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac327db-14da-47c3-8006-2a0614589f58 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:21.145313 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac327db-14da-47c3-8006-2a0614589f58 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:21.146678 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac327db-14da-47c3-8006-2a0614589f58 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:21.172499 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 457/931] 10.222.0.70 () {60 vars in 1144 bytes} [Tue May 10 19:08:21 2022] POST /identity/v3/endpoints => generated 346 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:08:21.242128 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc81fdf2-dde8-42a2-a22d-e00dc20bf4e0 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:21.284506 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b3650a-8f31-4349-9a69-edd63f2db878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:21.285567 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b3650a-8f31-4349-9a69-edd63f2db878 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:21.286057 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b3650a-8f31-4349-9a69-edd63f2db878 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:21.286566 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b3650a-8f31-4349-9a69-edd63f2db878 None admin] PATH_INFO: `/v3/users` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:21.287629 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b3650a-8f31-4349-9a69-edd63f2db878 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:08:21.288168 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b3650a-8f31-4349-9a69-edd63f2db878 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:21.289862 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b3650a-8f31-4349-9a69-edd63f2db878 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:21.309879 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 475/932] 10.222.0.70 () {56 vars in 1149 bytes} [Tue May 10 19:08:21 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:08:21.315841 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac327db-14da-47c3-8006-2a0614589f58 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:21.428110 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac327db-14da-47c3-8006-2a0614589f58 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:21.462544 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2883a55a-b140-442e-84a6-3d92ec2fff59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:21.463346 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2883a55a-b140-442e-84a6-3d92ec2fff59 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:21.463640 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2883a55a-b140-442e-84a6-3d92ec2fff59 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:21.463917 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2883a55a-b140-442e-84a6-3d92ec2fff59 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:21.475372 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2883a55a-b140-442e-84a6-3d92ec2fff59 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:21.476868 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2883a55a-b140-442e-84a6-3d92ec2fff59 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:21.494056 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application [None req-2883a55a-b140-442e-84a6-3d92ec2fff59 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:08:21.494056 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:08:21.494056 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:08:21.494056 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:08:21.494056 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:08:21.494056 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:08:21.494056 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:08:21.494056 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:08:21.494056 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:08:21.494056 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:08:21.494056 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:08:21.494056 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:08:21.494056 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 19:08:21.494056 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 19:08:21.494056 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 19:08:21.495017 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 19:08:21.495017 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:08:21.495017 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:08:21.495017 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:08:21.495017 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:08:21.495017 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:08:21.495017 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:08:21.495017 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:08:21.495017 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application with Lock( May 10 19:08:21.495017 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:08:21.495017 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._enter() May 10 19:08:21.495017 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:08:21.495017 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:08:21.495017 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:08:21.495017 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.creator() May 10 19:08:21.495017 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:08:21.495017 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application created_value = creator( May 10 19:08:21.495925 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 19:08:21.495925 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 19:08:21.495925 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:08:21.495925 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application May 10 19:08:21.495925 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 458/933] 10.222.0.70 () {56 vars in 1108 bytes} [Tue May 10 19:08:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:08:21.503193 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b3650a-8f31-4349-9a69-edd63f2db878 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:21.604725 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b3650a-8f31-4349-9a69-edd63f2db878 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:21.639385 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556fdeea-0db4-42dd-bc59-4cc8c8370dca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:21.640061 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556fdeea-0db4-42dd-bc59-4cc8c8370dca None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:21.640346 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556fdeea-0db4-42dd-bc59-4cc8c8370dca None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:21.640659 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556fdeea-0db4-42dd-bc59-4cc8c8370dca None admin] PATH_INFO: `/v3/domains` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:21.641442 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556fdeea-0db4-42dd-bc59-4cc8c8370dca None admin] RBAC: Adding query filter params (name=Default) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:08:21.641752 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556fdeea-0db4-42dd-bc59-4cc8c8370dca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:21.643252 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556fdeea-0db4-42dd-bc59-4cc8c8370dca None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:21.655357 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 476/934] 10.222.0.70 () {56 vars in 1109 bytes} [Tue May 10 19:08:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:08:21.665562 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2883a55a-b140-442e-84a6-3d92ec2fff59 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:21.772659 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2883a55a-b140-442e-84a6-3d92ec2fff59 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:21.813369 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30258e73-f885-463c-a319-60e4b25b6baa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:21.814569 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30258e73-f885-463c-a319-60e4b25b6baa None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:21.815068 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30258e73-f885-463c-a319-60e4b25b6baa None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:21.815548 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30258e73-f885-463c-a319-60e4b25b6baa None admin] PATH_INFO: `/v3/projects/service` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:21.822588 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30258e73-f885-463c-a319-60e4b25b6baa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:21.824729 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30258e73-f885-463c-a319-60e4b25b6baa None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:21.839799 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application [None req-30258e73-f885-463c-a319-60e4b25b6baa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 19:08:21.839799 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:08:21.839799 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:08:21.839799 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:08:21.839799 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:08:21.839799 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:08:21.839799 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:08:21.839799 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:08:21.839799 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:08:21.839799 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:08:21.839799 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:08:21.839799 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:08:21.839799 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 19:08:21.839799 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 19:08:21.839799 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 19:08:21.840784 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 19:08:21.840784 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:08:21.840784 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:08:21.840784 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:08:21.840784 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:08:21.840784 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:08:21.840784 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:08:21.840784 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:08:21.840784 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application with Lock( May 10 19:08:21.840784 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:08:21.840784 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._enter() May 10 19:08:21.840784 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:08:21.840784 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:08:21.840784 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:08:21.840784 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.creator() May 10 19:08:21.840784 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:08:21.840784 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application created_value = creator( May 10 19:08:21.841731 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 19:08:21.841731 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 19:08:21.841731 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 19:08:21.841731 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 19:08:21.841731 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 19:08:21.841731 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 19:08:21.841731 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 19:08:21.841731 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application May 10 19:08:21.844313 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 459/935] 10.222.0.70 () {56 vars in 1111 bytes} [Tue May 10 19:08:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:08:21.850322 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556fdeea-0db4-42dd-bc59-4cc8c8370dca None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:21.909105 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7952841-a83b-45ff-9cbe-a4c735d2dc4e None None] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:21.909756 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7952841-a83b-45ff-9cbe-a4c735d2dc4e None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:21.910247 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7952841-a83b-45ff-9cbe-a4c735d2dc4e None None] PATH_INFO: `/` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:21.912077 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 460/936] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:08:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 19:08:21.918881 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132e245c-9b7b-4761-a89a-9bf66a0aa31c None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:21.918881 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132e245c-9b7b-4761-a89a-9bf66a0aa31c None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:21.918881 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132e245c-9b7b-4761-a89a-9bf66a0aa31c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:21.935005 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-132e245c-9b7b-4761-a89a-9bf66a0aa31c None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:08:21.936571 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-132e245c-9b7b-4761-a89a-9bf66a0aa31c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:08:21.961321 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556fdeea-0db4-42dd-bc59-4cc8c8370dca None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:21.997941 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20f52ce-1362-4dc6-b967-d03fad2dcba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:21.998978 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20f52ce-1362-4dc6-b967-d03fad2dcba3 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:21.999481 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20f52ce-1362-4dc6-b967-d03fad2dcba3 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:21.999951 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20f52ce-1362-4dc6-b967-d03fad2dcba3 None admin] PATH_INFO: `/v3/projects` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:22.000972 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20f52ce-1362-4dc6-b967-d03fad2dcba3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:08:22.001535 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20f52ce-1362-4dc6-b967-d03fad2dcba3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:22.003165 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20f52ce-1362-4dc6-b967-d03fad2dcba3 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:22.016373 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 477/937] 10.222.0.70 () {56 vars in 1148 bytes} [Tue May 10 19:08:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:08:22.028709 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 461/938] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:08:21 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 19:08:22.028889 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20f52ce-1362-4dc6-b967-d03fad2dcba3 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:22.046551 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132e245c-9b7b-4761-a89a-9bf66a0aa31c None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:22.126386 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20f52ce-1362-4dc6-b967-d03fad2dcba3 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:22.146505 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132e245c-9b7b-4761-a89a-9bf66a0aa31c None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:22.161456 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99605de-1a87-4c08-a9f2-7f76cd5593a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:22.162675 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99605de-1a87-4c08-a9f2-7f76cd5593a3 None admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:22.163116 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99605de-1a87-4c08-a9f2-7f76cd5593a3 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:22.163390 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99605de-1a87-4c08-a9f2-7f76cd5593a3 None admin] PATH_INFO: `/v3/projects/2ee9ec5b515440fe9b39aedf3e339c79/users/058e52f1bf0b4aba965d945815d4acb3/roles/128f76acc6c8422797401b4d627ca236` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:22.165629 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99605de-1a87-4c08-a9f2-7f76cd5593a3 None admin] RBAC: Authorizing `identity:create_grant(project_id=2ee9ec5b515440fe9b39aedf3e339c79, user_id=058e52f1bf0b4aba965d945815d4acb3, role_id=128f76acc6c8422797401b4d627ca236)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:22.167060 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99605de-1a87-4c08-a9f2-7f76cd5593a3 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:22.179412 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7129d9-45c5-479e-a7ea-be9dec51ed73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:22.180213 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7129d9-45c5-479e-a7ea-be9dec51ed73 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:22.188507 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7129d9-45c5-479e-a7ea-be9dec51ed73 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:22.189374 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 478/939] 10.222.0.70 () {58 vars in 1439 bytes} [Tue May 10 19:08:22 2022] PUT /identity/v3/projects/2ee9ec5b515440fe9b39aedf3e339c79/users/058e52f1bf0b4aba965d945815d4acb3/roles/128f76acc6c8422797401b4d627ca236 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:08:22.189483 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7129d9-45c5-479e-a7ea-be9dec51ed73 None admin] PATH_INFO: `/v3/services/compute` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:22.189483 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7129d9-45c5-479e-a7ea-be9dec51ed73 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:22.189638 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43723bb3-377b-425c-b273-4dbcdca62822 None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:22.189638 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43723bb3-377b-425c-b273-4dbcdca62822 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:22.189638 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43723bb3-377b-425c-b273-4dbcdca62822 None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:22.189883 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7129d9-45c5-479e-a7ea-be9dec51ed73 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:22.189967 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 479/940] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:08:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:08:22.192237 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2c6f6d-61fb-4bf0-b837-e73e3c2588f7 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:22.192237 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2c6f6d-61fb-4bf0-b837-e73e3c2588f7 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:22.192237 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2c6f6d-61fb-4bf0-b837-e73e3c2588f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:22.208453 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application [None req-eb7129d9-45c5-479e-a7ea-be9dec51ed73 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 10 19:08:22.208453 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:08:22.208453 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 19:08:22.208453 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 19:08:22.208453 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 19:08:22.208453 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 19:08:22.208453 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 19:08:22.208453 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 19:08:22.208453 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 10 19:08:22.208453 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application May 10 19:08:22.208453 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 19:08:22.208453 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application May 10 19:08:22.208453 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:08:22.208453 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:08:22.208453 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:08:22.208453 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:08:22.208453 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:08:22.209563 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:08:22.209563 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:08:22.209563 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:08:22.209563 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:08:22.209563 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:08:22.209563 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:08:22.209563 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 19:08:22.209563 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 19:08:22.209563 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 19:08:22.209563 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 19:08:22.209563 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:08:22.209563 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:08:22.209563 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:08:22.209563 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:08:22.209563 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:08:22.209563 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:08:22.210430 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:08:22.210430 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application with Lock( May 10 19:08:22.210430 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:08:22.210430 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._enter() May 10 19:08:22.210430 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:08:22.210430 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:08:22.210430 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:08:22.210430 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.creator() May 10 19:08:22.210430 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:08:22.210430 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application created_value = creator( May 10 19:08:22.210430 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 19:08:22.210430 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 19:08:22.210430 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 10 19:08:22.210430 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application May 10 19:08:22.214816 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 462/941] 10.222.0.70 () {56 vars in 1111 bytes} [Tue May 10 19:08:22 2022] GET /identity/v3/services/compute => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:08:22.215994 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7129d9-45c5-479e-a7ea-be9dec51ed73 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:22.217902 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-cc2c6f6d-61fb-4bf0-b837-e73e3c2588f7 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:08:22.219507 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-cc2c6f6d-61fb-4bf0-b837-e73e3c2588f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:08:22.300321 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 480/942] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:08:22 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 19:08:22.327405 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2c6f6d-61fb-4bf0-b837-e73e3c2588f7 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:22.334317 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7129d9-45c5-479e-a7ea-be9dec51ed73 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:22.372590 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa372b02-36be-4c2e-b4ac-47f631bf5ca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:22.373671 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa372b02-36be-4c2e-b4ac-47f631bf5ca7 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:22.374177 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa372b02-36be-4c2e-b4ac-47f631bf5ca7 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:22.374651 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa372b02-36be-4c2e-b4ac-47f631bf5ca7 None admin] PATH_INFO: `/v3/services` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:22.375576 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa372b02-36be-4c2e-b4ac-47f631bf5ca7 None admin] RBAC: Adding query filter params (name=compute) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:08:22.376104 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa372b02-36be-4c2e-b4ac-47f631bf5ca7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:22.378284 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa372b02-36be-4c2e-b4ac-47f631bf5ca7 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:22.384801 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 463/943] 10.222.0.70 () {56 vars in 1112 bytes} [Tue May 10 19:08:22 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:08:22.389701 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa372b02-36be-4c2e-b4ac-47f631bf5ca7 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:22.438413 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2c6f6d-61fb-4bf0-b837-e73e3c2588f7 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:22.473805 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bde6257-b0c4-489d-afbf-21b0b46d5e72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:22.474651 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bde6257-b0c4-489d-afbf-21b0b46d5e72 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:22.474931 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bde6257-b0c4-489d-afbf-21b0b46d5e72 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:22.475204 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bde6257-b0c4-489d-afbf-21b0b46d5e72 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:22.475884 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bde6257-b0c4-489d-afbf-21b0b46d5e72 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:22.477322 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bde6257-b0c4-489d-afbf-21b0b46d5e72 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:22.489978 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-4bde6257-b0c4-489d-afbf-21b0b46d5e72 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 19:08:22.489978 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:08:22.489978 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 19:08:22.489978 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 19:08:22.489978 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 19:08:22.489978 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 19:08:22.489978 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 19:08:22.489978 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 19:08:22.489978 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 19:08:22.489978 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:08:22.489978 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 19:08:22.489978 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:08:22.489978 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:08:22.489978 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:08:22.489978 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:08:22.489978 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:08:22.489978 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:08:22.491080 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:08:22.491080 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:08:22.491080 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:08:22.491080 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:08:22.491080 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:08:22.491080 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:08:22.491080 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 19:08:22.491080 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 19:08:22.491080 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 19:08:22.491080 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 19:08:22.491080 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:08:22.491080 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:08:22.491080 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:08:22.491080 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:08:22.491080 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:08:22.491080 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:08:22.497346 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:08:22.497346 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( May 10 19:08:22.497346 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:08:22.497346 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() May 10 19:08:22.497346 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:08:22.497346 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:08:22.497346 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:08:22.497346 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() May 10 19:08:22.497346 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:08:22.497346 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( May 10 19:08:22.497346 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 19:08:22.497346 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 19:08:22.497346 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 19:08:22.497346 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:08:22.497346 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 481/944] 10.222.0.70 () {56 vars in 1126 bytes} [Tue May 10 19:08:22 2022] GET /identity/v3/services/object-store => generated 93 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:08:22.500150 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bde6257-b0c4-489d-afbf-21b0b46d5e72 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:22.518024 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa372b02-36be-4c2e-b4ac-47f631bf5ca7 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:22.556218 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b960a051-81b4-4f10-824b-b0ee6ca53c00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:22.557397 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b960a051-81b4-4f10-824b-b0ee6ca53c00 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:22.558155 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b960a051-81b4-4f10-824b-b0ee6ca53c00 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:22.558955 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b960a051-81b4-4f10-824b-b0ee6ca53c00 None admin] PATH_INFO: `/v3/services` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:22.559999 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b960a051-81b4-4f10-824b-b0ee6ca53c00 None admin] RBAC: Adding query filter params (type=compute) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:08:22.560530 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b960a051-81b4-4f10-824b-b0ee6ca53c00 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:22.562673 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b960a051-81b4-4f10-824b-b0ee6ca53c00 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:22.576671 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 464/945] 10.222.0.70 () {56 vars in 1112 bytes} [Tue May 10 19:08:22 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:08:22.613464 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bde6257-b0c4-489d-afbf-21b0b46d5e72 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:22.650246 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3e7315-2fba-44ab-b52d-256339f4a505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:22.650935 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3e7315-2fba-44ab-b52d-256339f4a505 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:22.651219 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3e7315-2fba-44ab-b52d-256339f4a505 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:22.651498 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3e7315-2fba-44ab-b52d-256339f4a505 None admin] PATH_INFO: `/v3/services` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:22.652223 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3e7315-2fba-44ab-b52d-256339f4a505 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:08:22.652561 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3e7315-2fba-44ab-b52d-256339f4a505 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:22.653987 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3e7315-2fba-44ab-b52d-256339f4a505 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:22.660689 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 482/946] 10.222.0.70 () {56 vars in 1122 bytes} [Tue May 10 19:08:22 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:08:22.666324 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b960a051-81b4-4f10-824b-b0ee6ca53c00 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:22.782974 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b960a051-81b4-4f10-824b-b0ee6ca53c00 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:22.816957 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68009752-58e5-4d41-8931-7c63e0e43113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:22.817586 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68009752-58e5-4d41-8931-7c63e0e43113 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:22.817875 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68009752-58e5-4d41-8931-7c63e0e43113 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:22.818151 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68009752-58e5-4d41-8931-7c63e0e43113 None admin] PATH_INFO: `/v3/services` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:22.818847 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68009752-58e5-4d41-8931-7c63e0e43113 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:08:22.819152 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68009752-58e5-4d41-8931-7c63e0e43113 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:22.820536 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68009752-58e5-4d41-8931-7c63e0e43113 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:22.830755 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 465/947] 10.222.0.70 () {56 vars in 1122 bytes} [Tue May 10 19:08:22 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:08:22.832488 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3e7315-2fba-44ab-b52d-256339f4a505 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:22.931555 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3e7315-2fba-44ab-b52d-256339f4a505 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:22.965948 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24c75d2-c351-43e3-9b66-d53f38bb91b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:22.966657 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24c75d2-c351-43e3-9b66-d53f38bb91b6 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:22.966944 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24c75d2-c351-43e3-9b66-d53f38bb91b6 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:22.967222 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24c75d2-c351-43e3-9b66-d53f38bb91b6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:22.968003 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24c75d2-c351-43e3-9b66-d53f38bb91b6 None admin] RBAC: Adding query filter params (interface=public, service_id=755e726ec21c475a92f53f7efe4f6b3d, region_id=RegionOne) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:08:22.968309 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24c75d2-c351-43e3-9b66-d53f38bb91b6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:22.969744 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24c75d2-c351-43e3-9b66-d53f38bb91b6 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:22.978955 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 483/948] 10.222.0.70 () {56 vars in 1251 bytes} [Tue May 10 19:08:22 2022] GET /identity/v3/endpoints?service_id=755e726ec21c475a92f53f7efe4f6b3d&interface=public®ion_id=RegionOne => generated 194 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:08:22.981387 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68009752-58e5-4d41-8931-7c63e0e43113 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:23.081850 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68009752-58e5-4d41-8931-7c63e0e43113 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:23.115524 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a716455b-4fd9-4f38-b43e-51cad8301857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:23.116200 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a716455b-4fd9-4f38-b43e-51cad8301857 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:23.116514 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a716455b-4fd9-4f38-b43e-51cad8301857 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:23.116793 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a716455b-4fd9-4f38-b43e-51cad8301857 None admin] PATH_INFO: `/v3/services` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:23.117537 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a716455b-4fd9-4f38-b43e-51cad8301857 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:23.118843 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a716455b-4fd9-4f38-b43e-51cad8301857 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:23.132635 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 466/949] 10.222.0.70 () {56 vars in 1087 bytes} [Tue May 10 19:08:22 2022] GET /identity/v3/services => generated 1497 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:08:23.610341 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56282e2c-5ee8-4f8e-bf42-c1284f74be9a None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:23.610929 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56282e2c-5ee8-4f8e-bf42-c1284f74be9a None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:23.611012 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56282e2c-5ee8-4f8e-bf42-c1284f74be9a None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:23.612634 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 484/950] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:08:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:08:23.618061 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75942b16-0620-48dd-b5b1-96f2749d953a None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:23.618357 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75942b16-0620-48dd-b5b1-96f2749d953a None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:23.618639 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75942b16-0620-48dd-b5b1-96f2749d953a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:23.634983 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-75942b16-0620-48dd-b5b1-96f2749d953a None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:08:23.636147 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-75942b16-0620-48dd-b5b1-96f2749d953a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:08:23.704367 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 467/951] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:08:23 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 19:08:23.727926 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56282e2c-5ee8-4f8e-bf42-c1284f74be9a None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:23.834346 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56282e2c-5ee8-4f8e-bf42-c1284f74be9a None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:23.872302 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ef4369-a448-4def-a6b8-d394d706e130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:23.872915 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ef4369-a448-4def-a6b8-d394d706e130 None admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:23.873194 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ef4369-a448-4def-a6b8-d394d706e130 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:23.873466 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ef4369-a448-4def-a6b8-d394d706e130 None admin] PATH_INFO: `/v3/projects` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:23.874180 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ef4369-a448-4def-a6b8-d394d706e130 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:23.875608 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ef4369-a448-4def-a6b8-d394d706e130 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:23.877557 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: WARNING keystone.server.flask.common [None req-51ef4369-a448-4def-a6b8-d394d706e130 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 10 19:08:23.897804 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.sql.core [None req-51ef4369-a448-4def-a6b8-d394d706e130 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 10 19:08:23.897804 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 10 19:08:23.897804 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [parameters: {'id': '3659f28de4d34074988dae459d224659', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 10 19:08:23.897804 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79994) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 10 19:08:23.905667 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-51ef4369-a448-4def-a6b8-d394d706e130 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 3659f28de4d34074988dae459d224659.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 3659f28de4d34074988dae459d224659. May 10 19:08:23.905667 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:08:23.905667 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 10 19:08:23.905667 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application self.dialect.do_execute( May 10 19:08:23.905667 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 10 19:08:23.905667 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 10 19:08:23.905667 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 10 19:08:23.905667 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application result = self._query(query) May 10 19:08:23.905667 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 10 19:08:23.905667 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application conn.query(q) May 10 19:08:23.905667 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 10 19:08:23.905667 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 10 19:08:23.905667 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 10 19:08:23.906489 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application result.read() May 10 19:08:23.906489 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 10 19:08:23.906489 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 10 19:08:23.906489 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 10 19:08:23.906489 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application packet.raise_for_error() May 10 19:08:23.906489 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 10 19:08:23.906489 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 10 19:08:23.906489 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 10 19:08:23.906489 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 10 19:08:23.906489 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 10 19:08:23.906489 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:08:23.906489 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 10 19:08:23.906489 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:08:23.906489 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:08:23.906489 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 10 19:08:23.906489 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 10 19:08:23.906489 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 10 19:08:23.906489 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return project_ref.to_dict() May 10 19:08:23.907991 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 10 19:08:23.907991 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application next(self.gen) May 10 19:08:23.907991 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 10 19:08:23.907991 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application yield resource May 10 19:08:23.907991 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 10 19:08:23.907991 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application next(self.gen) May 10 19:08:23.907991 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 10 19:08:23.907991 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application self.session.rollback() May 10 19:08:23.907991 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 10 19:08:23.907991 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application self.force_reraise() May 10 19:08:23.907991 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 10 19:08:23.907991 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise self.value May 10 19:08:23.907991 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 10 19:08:23.907991 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 10 19:08:23.907991 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 10 19:08:23.907991 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application session.commit() May 10 19:08:23.907991 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 10 19:08:23.908946 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 10 19:08:23.908946 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 10 19:08:23.908946 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application self._prepare_impl() May 10 19:08:23.908946 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 10 19:08:23.908946 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application self.session.flush() May 10 19:08:23.908946 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 10 19:08:23.908946 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application self._flush(objects) May 10 19:08:23.908946 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 10 19:08:23.908946 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 10 19:08:23.908946 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 10 19:08:23.908946 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application compat.raise_( May 10 19:08:23.908946 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 10 19:08:23.908946 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception May 10 19:08:23.908946 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 10 19:08:23.908946 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application flush_context.execute() May 10 19:08:23.908946 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 10 19:08:23.908946 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rec.execute(self) May 10 19:08:23.909877 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 10 19:08:23.909877 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 10 19:08:23.909877 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 10 19:08:23.909877 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application _emit_insert_statements( May 10 19:08:23.909877 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 10 19:08:23.909877 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application c = connection._execute_20( May 10 19:08:23.909877 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 10 19:08:23.909877 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 10 19:08:23.909877 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 10 19:08:23.909877 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 10 19:08:23.909877 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 10 19:08:23.909877 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ret = self._execute_context( May 10 19:08:23.909877 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 10 19:08:23.909877 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 10 19:08:23.909877 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 10 19:08:23.910688 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 10 19:08:23.910688 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 10 19:08:23.910688 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception May 10 19:08:23.910688 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 10 19:08:23.910688 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application self.dialect.do_execute( May 10 19:08:23.910688 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 10 19:08:23.910688 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 10 19:08:23.910688 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 10 19:08:23.910688 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application result = self._query(query) May 10 19:08:23.910688 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 10 19:08:23.910688 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application conn.query(q) May 10 19:08:23.910688 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 10 19:08:23.910688 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 10 19:08:23.910688 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 10 19:08:23.910688 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application result.read() May 10 19:08:23.910688 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 10 19:08:23.910688 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 10 19:08:23.911558 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 10 19:08:23.911558 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application packet.raise_for_error() May 10 19:08:23.911558 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 10 19:08:23.911558 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 10 19:08:23.911558 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 10 19:08:23.911558 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 10 19:08:23.911558 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 10 19:08:23.911558 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 10 19:08:23.911558 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [parameters: {'id': '3659f28de4d34074988dae459d224659', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 10 19:08:23.911558 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 10 19:08:23.911558 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:08:23.911558 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 19:08:23.911558 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:08:23.911558 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:08:23.911558 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 10 19:08:23.912401 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 10 19:08:23.912401 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 10 19:08:23.912401 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 10 19:08:23.912401 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 10 19:08:23.912401 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:08:23.912401 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 19:08:23.912401 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:08:23.912401 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:08:23.912401 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:08:23.912401 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:08:23.912401 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:08:23.912401 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:08:23.912401 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:08:23.912401 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:08:23.912401 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:08:23.912401 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:08:23.912401 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:08:23.919618 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:08:23.919618 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 10 19:08:23.919618 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 10 19:08:23.919618 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:08:23.919618 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:08:23.919618 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 10 19:08:23.919618 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.Conflict( May 10 19:08:23.919618 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 3659f28de4d34074988dae459d224659. May 10 19:08:23.919618 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:08:23.919618 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 485/952] 10.222.0.70 () {60 vars in 1140 bytes} [Tue May 10 19:08:23 2022] POST /identity/v3/projects => generated 262 bytes in 180 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 10 19:08:23.920317 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75942b16-0620-48dd-b5b1-96f2749d953a None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:24.022499 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75942b16-0620-48dd-b5b1-96f2749d953a None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:24.059830 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115a6bd6-4082-40b5-aec8-d27966621d06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:24.060673 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115a6bd6-4082-40b5-aec8-d27966621d06 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:24.060941 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115a6bd6-4082-40b5-aec8-d27966621d06 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:24.061214 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115a6bd6-4082-40b5-aec8-d27966621d06 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:24.067831 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115a6bd6-4082-40b5-aec8-d27966621d06 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:24.069350 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115a6bd6-4082-40b5-aec8-d27966621d06 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:24.083574 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application [None req-115a6bd6-4082-40b5-aec8-d27966621d06 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 19:08:24.083574 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:08:24.083574 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:08:24.083574 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:08:24.083574 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:08:24.083574 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:08:24.083574 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:08:24.083574 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:08:24.083574 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:08:24.083574 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:08:24.083574 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:08:24.083574 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:08:24.083574 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 19:08:24.083574 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 19:08:24.083574 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 19:08:24.085652 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 19:08:24.085652 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:08:24.085652 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:08:24.085652 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:08:24.085652 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:08:24.085652 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:08:24.085652 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:08:24.085652 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:08:24.085652 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application with Lock( May 10 19:08:24.085652 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:08:24.085652 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._enter() May 10 19:08:24.085652 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:08:24.085652 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:08:24.085652 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:08:24.085652 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.creator() May 10 19:08:24.085652 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:08:24.085652 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application created_value = creator( May 10 19:08:24.087722 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 19:08:24.087722 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 19:08:24.087722 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 19:08:24.087722 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 19:08:24.087722 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 19:08:24.087722 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 19:08:24.087722 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 19:08:24.087722 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application May 10 19:08:24.087722 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 468/953] 10.222.0.70 () {56 vars in 1111 bytes} [Tue May 10 19:08:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:08:24.093696 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ef4369-a448-4def-a6b8-d394d706e130 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:24.192554 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ef4369-a448-4def-a6b8-d394d706e130 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:24.227224 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efbed46-28f4-4948-a7e4-defa097e55d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:24.227883 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efbed46-28f4-4948-a7e4-defa097e55d6 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:24.228164 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efbed46-28f4-4948-a7e4-defa097e55d6 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:24.228452 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efbed46-28f4-4948-a7e4-defa097e55d6 None admin] PATH_INFO: `/v3/projects` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:24.229257 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efbed46-28f4-4948-a7e4-defa097e55d6 None admin] RBAC: Adding query filter params (name=service) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:08:24.229563 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efbed46-28f4-4948-a7e4-defa097e55d6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:24.231188 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efbed46-28f4-4948-a7e4-defa097e55d6 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:24.251837 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 486/954] 10.222.0.70 () {56 vars in 1112 bytes} [Tue May 10 19:08:24 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:08:24.489744 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4052692-4f6d-48c9-815c-07ca5353bc62 None None] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:24.490130 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4052692-4f6d-48c9-815c-07ca5353bc62 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:24.490509 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4052692-4f6d-48c9-815c-07ca5353bc62 None None] PATH_INFO: `/` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:24.491961 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 469/955] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:08:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:08:24.497797 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5560282-b58a-4b40-9507-cdc50e88e7bc None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:24.498087 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5560282-b58a-4b40-9507-cdc50e88e7bc None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:24.498363 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5560282-b58a-4b40-9507-cdc50e88e7bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:24.516153 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-f5560282-b58a-4b40-9507-cdc50e88e7bc None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:08:24.518240 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-f5560282-b58a-4b40-9507-cdc50e88e7bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:08:24.585861 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 487/956] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:08:24 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 19:08:24.608402 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4052692-4f6d-48c9-815c-07ca5353bc62 None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:24.719364 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4052692-4f6d-48c9-815c-07ca5353bc62 None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:24.755292 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696fd2f4-ee53-4d60-82ed-cfcfc9283b7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:24.756074 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696fd2f4-ee53-4d60-82ed-cfcfc9283b7e None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:24.756361 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696fd2f4-ee53-4d60-82ed-cfcfc9283b7e None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:24.756657 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696fd2f4-ee53-4d60-82ed-cfcfc9283b7e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:24.767751 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696fd2f4-ee53-4d60-82ed-cfcfc9283b7e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:08:24.778401 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application [None req-696fd2f4-ee53-4d60-82ed-cfcfc9283b7e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 10 19:08:24.778401 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:08:24.778401 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:08:24.778401 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:08:24.778401 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:08:24.778401 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:08:24.778401 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:08:24.778401 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:08:24.778401 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:08:24.778401 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:08:24.778401 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:08:24.778401 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:08:24.778401 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:08:24.778401 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:08:24.778401 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:08:24.778401 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:08:24.779354 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:08:24.779354 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:08:24.779354 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:08:24.779354 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:08:24.779354 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:08:24.779354 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:08:24.779354 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:08:24.779354 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:08:24.779354 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:08:24.779354 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:08:24.779354 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:08:24.779354 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application with Lock( May 10 19:08:24.779354 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:08:24.779354 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._enter() May 10 19:08:24.779354 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:08:24.779354 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:08:24.780204 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:08:24.780204 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.creator() May 10 19:08:24.780204 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:08:24.780204 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application created_value = creator( May 10 19:08:24.780204 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:08:24.780204 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:08:24.780204 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:08:24.780204 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:08:24.780204 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:08:24.780204 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:08:24.780204 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 10 19:08:24.780204 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application May 10 19:08:24.780878 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 470/957] 10.222.0.70 () {56 vars in 1120 bytes} [Tue May 10 19:08:24 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:08:24.788056 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5560282-b58a-4b40-9507-cdc50e88e7bc None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:24.892492 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5560282-b58a-4b40-9507-cdc50e88e7bc None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:24.897887 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e5b15c-b77b-417a-a0f9-a62a5296dd8b None None] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:24.898182 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e5b15c-b77b-417a-a0f9-a62a5296dd8b None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:24.898459 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e5b15c-b77b-417a-a0f9-a62a5296dd8b None None] PATH_INFO: `/` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:24.900061 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 471/958] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:08:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:08:24.905327 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9092b3-a88e-49b1-b203-3b0c3550eefb None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:24.905614 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9092b3-a88e-49b1-b203-3b0c3550eefb None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:24.905894 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9092b3-a88e-49b1-b203-3b0c3550eefb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:24.922734 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-3a9092b3-a88e-49b1-b203-3b0c3550eefb None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:08:24.924457 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-3a9092b3-a88e-49b1-b203-3b0c3550eefb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:08:24.930677 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58af1261-b327-4c17-b39a-79f83bc7e5c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:24.931628 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58af1261-b327-4c17-b39a-79f83bc7e5c1 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:24.932105 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58af1261-b327-4c17-b39a-79f83bc7e5c1 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:24.932612 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58af1261-b327-4c17-b39a-79f83bc7e5c1 None admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:24.933544 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58af1261-b327-4c17-b39a-79f83bc7e5c1 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:08:24.934042 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58af1261-b327-4c17-b39a-79f83bc7e5c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:24.935613 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58af1261-b327-4c17-b39a-79f83bc7e5c1 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:24.944950 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 488/959] 10.222.0.70 () {56 vars in 1115 bytes} [Tue May 10 19:08:24 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:08:24.950609 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58af1261-b327-4c17-b39a-79f83bc7e5c1 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:25.008716 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 472/960] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:08:24 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 19:08:25.025612 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9092b3-a88e-49b1-b203-3b0c3550eefb None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:25.054532 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58af1261-b327-4c17-b39a-79f83bc7e5c1 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:25.094765 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95398d80-8f00-4dc4-88fe-21aeb1b69729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:25.096378 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95398d80-8f00-4dc4-88fe-21aeb1b69729 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:25.096703 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95398d80-8f00-4dc4-88fe-21aeb1b69729 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:25.096974 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95398d80-8f00-4dc4-88fe-21aeb1b69729 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:25.109797 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95398d80-8f00-4dc4-88fe-21aeb1b69729 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:25.111662 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95398d80-8f00-4dc4-88fe-21aeb1b69729 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:25.133608 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-95398d80-8f00-4dc4-88fe-21aeb1b69729 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:08:25.133608 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:08:25.133608 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:08:25.133608 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:08:25.133608 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:08:25.133608 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:08:25.133608 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:08:25.133608 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:08:25.133608 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:08:25.133608 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:08:25.133608 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:08:25.133608 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:08:25.133608 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 19:08:25.133608 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 19:08:25.133608 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 19:08:25.135235 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 19:08:25.135235 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:08:25.135235 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:08:25.135235 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:08:25.135235 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:08:25.135235 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:08:25.135235 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:08:25.135235 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:08:25.135235 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( May 10 19:08:25.135235 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:08:25.135235 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() May 10 19:08:25.135235 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:08:25.135235 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:08:25.135235 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:08:25.135235 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() May 10 19:08:25.135235 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:08:25.135235 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( May 10 19:08:25.136140 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 19:08:25.136140 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 19:08:25.136140 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:08:25.136140 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:08:25.136380 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9092b3-a88e-49b1-b203-3b0c3550eefb None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:25.139627 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 489/961] 10.222.0.70 () {56 vars in 1108 bytes} [Tue May 10 19:08:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 19:08:25.141313 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95398d80-8f00-4dc4-88fe-21aeb1b69729 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:25.179619 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728cdd50-15f2-472e-a0f3-405526a6fdf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:25.180735 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728cdd50-15f2-472e-a0f3-405526a6fdf2 None admin] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:25.181116 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728cdd50-15f2-472e-a0f3-405526a6fdf2 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:25.181490 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728cdd50-15f2-472e-a0f3-405526a6fdf2 None admin] PATH_INFO: `/v3/services` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:25.182474 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728cdd50-15f2-472e-a0f3-405526a6fdf2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:25.184775 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728cdd50-15f2-472e-a0f3-405526a6fdf2 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:25.202669 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 473/962] 10.222.0.70 () {60 vars in 1141 bytes} [Tue May 10 19:08:25 2022] POST /identity/v3/services => generated 242 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 19:08:25.259485 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95398d80-8f00-4dc4-88fe-21aeb1b69729 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:25.310134 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c2123e-6f7c-4343-b6c0-383a58335105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:25.310827 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c2123e-6f7c-4343-b6c0-383a58335105 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:25.311159 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c2123e-6f7c-4343-b6c0-383a58335105 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:25.311483 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c2123e-6f7c-4343-b6c0-383a58335105 None admin] PATH_INFO: `/v3/domains` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:25.312210 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c2123e-6f7c-4343-b6c0-383a58335105 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:08:25.312538 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c2123e-6f7c-4343-b6c0-383a58335105 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:25.314200 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c2123e-6f7c-4343-b6c0-383a58335105 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:25.327679 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 490/963] 10.222.0.70 () {56 vars in 1109 bytes} [Tue May 10 19:08:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:08:25.333766 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728cdd50-15f2-472e-a0f3-405526a6fdf2 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:25.438464 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728cdd50-15f2-472e-a0f3-405526a6fdf2 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:25.464046 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa1a248-3e53-43b1-bcd8-4c2909837c13 None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:25.464334 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa1a248-3e53-43b1-bcd8-4c2909837c13 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:25.464652 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa1a248-3e53-43b1-bcd8-4c2909837c13 None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:25.466165 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 491/964] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:08:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:08:25.473247 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272a0087-3fc9-403f-b306-e194f52abe16 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:25.473537 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272a0087-3fc9-403f-b306-e194f52abe16 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:25.473813 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272a0087-3fc9-403f-b306-e194f52abe16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:25.476998 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88df5101-e1f5-4277-aac8-31c6d52ecdd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:25.478047 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88df5101-e1f5-4277-aac8-31c6d52ecdd8 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:25.478509 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88df5101-e1f5-4277-aac8-31c6d52ecdd8 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:25.478972 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88df5101-e1f5-4277-aac8-31c6d52ecdd8 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:25.489225 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88df5101-e1f5-4277-aac8-31c6d52ecdd8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:25.490688 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88df5101-e1f5-4277-aac8-31c6d52ecdd8 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:25.492230 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-272a0087-3fc9-403f-b306-e194f52abe16 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:08:25.493614 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-272a0087-3fc9-403f-b306-e194f52abe16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:08:25.508338 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application [None req-88df5101-e1f5-4277-aac8-31c6d52ecdd8 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 10 19:08:25.508338 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:08:25.508338 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:08:25.508338 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:08:25.508338 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:08:25.508338 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:08:25.508338 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:08:25.508338 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:08:25.508338 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:08:25.508338 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:08:25.508338 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:08:25.508338 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:08:25.508338 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 19:08:25.508338 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 19:08:25.508338 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 19:08:25.508338 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 19:08:25.509377 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:08:25.509377 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:08:25.509377 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 19:08:25.509377 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 19:08:25.509377 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 19:08:25.509377 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 19:08:25.509377 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:08:25.509377 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:08:25.509377 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:08:25.509377 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:08:25.509377 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:08:25.509377 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application with Lock( May 10 19:08:25.509377 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:08:25.509377 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._enter() May 10 19:08:25.509377 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:08:25.509377 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:08:25.509377 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:08:25.509377 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.creator() May 10 19:08:25.510392 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:08:25.510392 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application created_value = creator( May 10 19:08:25.510392 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 19:08:25.510392 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 19:08:25.510392 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 19:08:25.510392 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 19:08:25.510392 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 19:08:25.510392 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 19:08:25.510392 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 10 19:08:25.510392 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application May 10 19:08:25.510392 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 474/965] 10.222.0.70 () {56 vars in 1117 bytes} [Tue May 10 19:08:25 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:08:25.515034 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88df5101-e1f5-4277-aac8-31c6d52ecdd8 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:25.583274 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 492/966] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:08:25 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 19:08:25.605560 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272a0087-3fc9-403f-b306-e194f52abe16 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:25.622254 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88df5101-e1f5-4277-aac8-31c6d52ecdd8 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:25.656511 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b85e4ca-8f3c-4ad5-9542-978935e8b06b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:25.657183 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b85e4ca-8f3c-4ad5-9542-978935e8b06b None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:25.657559 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b85e4ca-8f3c-4ad5-9542-978935e8b06b None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:25.657834 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b85e4ca-8f3c-4ad5-9542-978935e8b06b None admin] PATH_INFO: `/v3/users` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:25.658656 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b85e4ca-8f3c-4ad5-9542-978935e8b06b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:08:25.658957 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b85e4ca-8f3c-4ad5-9542-978935e8b06b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:25.660675 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b85e4ca-8f3c-4ad5-9542-978935e8b06b None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:25.679169 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 475/967] 10.222.0.70 () {56 vars in 1149 bytes} [Tue May 10 19:08:25 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:08:25.684697 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b85e4ca-8f3c-4ad5-9542-978935e8b06b None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:25.735597 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272a0087-3fc9-403f-b306-e194f52abe16 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:25.784971 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b85e4ca-8f3c-4ad5-9542-978935e8b06b None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:25.786321 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4711a9-a208-47ba-a400-cc0c6daa860b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:25.788083 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4711a9-a208-47ba-a400-cc0c6daa860b None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:25.788368 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4711a9-a208-47ba-a400-cc0c6daa860b None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:25.788935 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4711a9-a208-47ba-a400-cc0c6daa860b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:25.789400 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4711a9-a208-47ba-a400-cc0c6daa860b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:25.790775 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4711a9-a208-47ba-a400-cc0c6daa860b None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:25.803290 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-0e4711a9-a208-47ba-a400-cc0c6daa860b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 19:08:25.803290 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:08:25.803290 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 19:08:25.803290 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 19:08:25.803290 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 19:08:25.803290 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 19:08:25.803290 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 19:08:25.803290 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 19:08:25.803290 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 19:08:25.803290 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:08:25.803290 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 19:08:25.803290 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:08:25.803290 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:08:25.803290 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:08:25.803290 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:08:25.803290 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:08:25.803290 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:08:25.804310 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:08:25.804310 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:08:25.804310 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:08:25.804310 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:08:25.804310 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:08:25.804310 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:08:25.804310 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 19:08:25.804310 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 19:08:25.804310 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 19:08:25.804310 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 19:08:25.804310 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:08:25.804310 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:08:25.804310 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:08:25.804310 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:08:25.804310 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:08:25.804310 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:08:25.805218 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:08:25.805218 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( May 10 19:08:25.805218 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:08:25.805218 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() May 10 19:08:25.805218 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:08:25.805218 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:08:25.805218 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:08:25.805218 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() May 10 19:08:25.805218 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:08:25.805218 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( May 10 19:08:25.805218 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 19:08:25.805218 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 19:08:25.805218 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 19:08:25.805218 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:08:25.805218 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 493/968] 10.222.0.70 () {56 vars in 1126 bytes} [Tue May 10 19:08:25 2022] GET /identity/v3/services/object-store => generated 93 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 19:08:25.810385 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4711a9-a208-47ba-a400-cc0c6daa860b None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:25.819323 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cab6b0-30a8-4da6-b810-a88497c50c08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:25.819998 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cab6b0-30a8-4da6-b810-a88497c50c08 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:25.820278 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cab6b0-30a8-4da6-b810-a88497c50c08 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:25.820594 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cab6b0-30a8-4da6-b810-a88497c50c08 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:25.886620 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cab6b0-30a8-4da6-b810-a88497c50c08 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:25.888066 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cab6b0-30a8-4da6-b810-a88497c50c08 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:25.909312 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4711a9-a208-47ba-a400-cc0c6daa860b None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:25.947768 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99881cf0-1b13-406a-bfc6-7fc654461e7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:25.954476 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99881cf0-1b13-406a-bfc6-7fc654461e7f None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:25.954924 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99881cf0-1b13-406a-bfc6-7fc654461e7f None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:25.955361 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99881cf0-1b13-406a-bfc6-7fc654461e7f None admin] PATH_INFO: `/v3/services` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:25.956238 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99881cf0-1b13-406a-bfc6-7fc654461e7f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:08:25.956982 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99881cf0-1b13-406a-bfc6-7fc654461e7f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:25.958523 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99881cf0-1b13-406a-bfc6-7fc654461e7f None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:25.968806 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 494/969] 10.222.0.70 () {56 vars in 1122 bytes} [Tue May 10 19:08:25 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:08:25.970387 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99881cf0-1b13-406a-bfc6-7fc654461e7f None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:25.990195 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 476/970] 10.222.0.70 () {58 vars in 1282 bytes} [Tue May 10 19:08:25 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 10 19:08:25.991055 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cab6b0-30a8-4da6-b810-a88497c50c08 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:26.070634 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99881cf0-1b13-406a-bfc6-7fc654461e7f None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:26.087841 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cab6b0-30a8-4da6-b810-a88497c50c08 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:26.112699 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd24d8c3-c1f3-4f2b-8c6e-3ccd323c9cee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:26.113627 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd24d8c3-c1f3-4f2b-8c6e-3ccd323c9cee None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:26.114083 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd24d8c3-c1f3-4f2b-8c6e-3ccd323c9cee None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:26.114503 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd24d8c3-c1f3-4f2b-8c6e-3ccd323c9cee None admin] PATH_INFO: `/v3/services` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:26.115354 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd24d8c3-c1f3-4f2b-8c6e-3ccd323c9cee None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:08:26.115801 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd24d8c3-c1f3-4f2b-8c6e-3ccd323c9cee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:26.117337 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd24d8c3-c1f3-4f2b-8c6e-3ccd323c9cee None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:26.123991 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fe3639-3f70-446b-bcf6-90d8acf7652a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:26.129955 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fe3639-3f70-446b-bcf6-90d8acf7652a None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:26.129955 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fe3639-3f70-446b-bcf6-90d8acf7652a None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:26.129955 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fe3639-3f70-446b-bcf6-90d8acf7652a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:26.130233 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 495/971] 10.222.0.70 () {56 vars in 1122 bytes} [Tue May 10 19:08:25 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:08:26.132296 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd24d8c3-c1f3-4f2b-8c6e-3ccd323c9cee None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:26.141354 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fe3639-3f70-446b-bcf6-90d8acf7652a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:26.143368 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fe3639-3f70-446b-bcf6-90d8acf7652a None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:26.160989 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application [None req-e4fe3639-3f70-446b-bcf6-90d8acf7652a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:08:26.160989 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:08:26.160989 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:08:26.160989 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:08:26.160989 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:08:26.160989 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:08:26.160989 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:08:26.160989 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:08:26.160989 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:08:26.160989 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:08:26.160989 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:08:26.160989 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:08:26.160989 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 19:08:26.160989 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 19:08:26.160989 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 19:08:26.161958 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 19:08:26.161958 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:08:26.161958 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:08:26.161958 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:08:26.161958 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:08:26.161958 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:08:26.161958 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:08:26.161958 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:08:26.161958 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application with Lock( May 10 19:08:26.161958 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:08:26.161958 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._enter() May 10 19:08:26.161958 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:08:26.161958 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:08:26.161958 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:08:26.161958 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.creator() May 10 19:08:26.161958 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:08:26.161958 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application created_value = creator( May 10 19:08:26.162861 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 19:08:26.162861 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 19:08:26.162861 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:08:26.162861 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application May 10 19:08:26.167074 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 477/972] 10.222.0.70 () {56 vars in 1108 bytes} [Tue May 10 19:08:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 19:08:26.167921 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fe3639-3f70-446b-bcf6-90d8acf7652a None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:26.240630 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd24d8c3-c1f3-4f2b-8c6e-3ccd323c9cee None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:26.266068 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fe3639-3f70-446b-bcf6-90d8acf7652a None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:26.274979 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9515af86-0b77-410d-b40c-5857e7638dc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:26.275923 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9515af86-0b77-410d-b40c-5857e7638dc7 None admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:26.276412 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9515af86-0b77-410d-b40c-5857e7638dc7 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:26.276915 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9515af86-0b77-410d-b40c-5857e7638dc7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:26.277857 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9515af86-0b77-410d-b40c-5857e7638dc7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:26.279451 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9515af86-0b77-410d-b40c-5857e7638dc7 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:26.301423 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1d7511-91a5-4276-b098-5c7ea52cb950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:26.302165 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1d7511-91a5-4276-b098-5c7ea52cb950 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:26.302462 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1d7511-91a5-4276-b098-5c7ea52cb950 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:26.302733 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1d7511-91a5-4276-b098-5c7ea52cb950 None admin] PATH_INFO: `/v3/domains` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:26.303545 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1d7511-91a5-4276-b098-5c7ea52cb950 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:08:26.303848 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1d7511-91a5-4276-b098-5c7ea52cb950 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:26.310153 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1d7511-91a5-4276-b098-5c7ea52cb950 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:26.310935 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 496/973] 10.222.0.70 () {60 vars in 1144 bytes} [Tue May 10 19:08:26 2022] POST /identity/v3/endpoints => generated 349 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:08:26.318453 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 478/974] 10.222.0.70 () {56 vars in 1109 bytes} [Tue May 10 19:08:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:08:26.324411 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9515af86-0b77-410d-b40c-5857e7638dc7 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:26.444488 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9515af86-0b77-410d-b40c-5857e7638dc7 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:26.483507 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab573221-e541-44c1-abe6-6cb649e8ead0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:26.484891 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab573221-e541-44c1-abe6-6cb649e8ead0 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:26.485957 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab573221-e541-44c1-abe6-6cb649e8ead0 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:26.486489 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab573221-e541-44c1-abe6-6cb649e8ead0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:26.495720 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab573221-e541-44c1-abe6-6cb649e8ead0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:26.497677 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab573221-e541-44c1-abe6-6cb649e8ead0 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:26.514243 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-ab573221-e541-44c1-abe6-6cb649e8ead0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 19:08:26.514243 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:08:26.514243 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:08:26.514243 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:08:26.514243 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:08:26.514243 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:08:26.514243 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:08:26.514243 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:08:26.514243 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:08:26.514243 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:08:26.514243 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:08:26.514243 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:08:26.514243 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 19:08:26.514243 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 19:08:26.514243 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 19:08:26.515281 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 19:08:26.515281 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:08:26.515281 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:08:26.515281 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:08:26.515281 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:08:26.515281 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:08:26.515281 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:08:26.515281 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:08:26.515281 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( May 10 19:08:26.515281 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:08:26.515281 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() May 10 19:08:26.515281 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:08:26.515281 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:08:26.515281 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:08:26.515281 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() May 10 19:08:26.515281 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:08:26.515281 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( May 10 19:08:26.516230 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 19:08:26.516230 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 19:08:26.516230 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 19:08:26.516230 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 19:08:26.516230 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 19:08:26.516230 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 19:08:26.516230 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 19:08:26.516230 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:08:26.519469 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 497/975] 10.222.0.70 () {56 vars in 1111 bytes} [Tue May 10 19:08:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:08:26.524930 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1d7511-91a5-4276-b098-5c7ea52cb950 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:26.630096 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1d7511-91a5-4276-b098-5c7ea52cb950 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:26.664183 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecd1a01-6cd9-4f80-af55-acc87ef23245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:26.665235 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecd1a01-6cd9-4f80-af55-acc87ef23245 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:26.665727 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecd1a01-6cd9-4f80-af55-acc87ef23245 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:26.666204 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecd1a01-6cd9-4f80-af55-acc87ef23245 None admin] PATH_INFO: `/v3/projects` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:26.667211 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecd1a01-6cd9-4f80-af55-acc87ef23245 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:08:26.667723 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecd1a01-6cd9-4f80-af55-acc87ef23245 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:26.669723 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde3af5a-6004-4d17-9d27-86647bdd259d None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:26.670010 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde3af5a-6004-4d17-9d27-86647bdd259d None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:26.670283 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde3af5a-6004-4d17-9d27-86647bdd259d None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:26.671784 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 498/976] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:08:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 19:08:26.673073 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecd1a01-6cd9-4f80-af55-acc87ef23245 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:26.677384 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718bb32c-6a9c-4ab4-b82d-f6bee8a51796 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:26.677910 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718bb32c-6a9c-4ab4-b82d-f6bee8a51796 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:26.678390 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718bb32c-6a9c-4ab4-b82d-f6bee8a51796 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:26.687003 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 479/977] 10.222.0.70 () {56 vars in 1148 bytes} [Tue May 10 19:08:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:08:26.693776 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecd1a01-6cd9-4f80-af55-acc87ef23245 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:26.699384 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-718bb32c-6a9c-4ab4-b82d-f6bee8a51796 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:08:26.700839 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-718bb32c-6a9c-4ab4-b82d-f6bee8a51796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:08:26.784519 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 499/978] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:08:26 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 19:08:26.805134 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecd1a01-6cd9-4f80-af55-acc87ef23245 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:26.806251 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718bb32c-6a9c-4ab4-b82d-f6bee8a51796 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:26.839700 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87edd532-4a9c-42f2-b0fc-7f9958b147cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:26.840386 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87edd532-4a9c-42f2-b0fc-7f9958b147cb None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:26.840698 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87edd532-4a9c-42f2-b0fc-7f9958b147cb None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:26.840958 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87edd532-4a9c-42f2-b0fc-7f9958b147cb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:26.842480 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87edd532-4a9c-42f2-b0fc-7f9958b147cb None admin] RBAC: Adding query filter params (role.id=128f76acc6c8422797401b4d627ca236, scope.project.id=2ee9ec5b515440fe9b39aedf3e339c79, user.id=058e52f1bf0b4aba965d945815d4acb3) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:08:26.842480 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87edd532-4a9c-42f2-b0fc-7f9958b147cb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:26.843511 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87edd532-4a9c-42f2-b0fc-7f9958b147cb None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:26.850425 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 480/979] 10.222.0.70 () {56 vars in 1374 bytes} [Tue May 10 19:08:26 2022] GET /identity/v3/role_assignments?user.id=058e52f1bf0b4aba965d945815d4acb3&scope.project.id=2ee9ec5b515440fe9b39aedf3e339c79&role.id=128f76acc6c8422797401b4d627ca236 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:08:26.918643 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718bb32c-6a9c-4ab4-b82d-f6bee8a51796 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:26.961883 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a5a6f6-574f-4d44-bbcd-64fd170f6828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:26.962578 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a5a6f6-574f-4d44-bbcd-64fd170f6828 None admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:26.962868 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a5a6f6-574f-4d44-bbcd-64fd170f6828 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:26.963143 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a5a6f6-574f-4d44-bbcd-64fd170f6828 None admin] PATH_INFO: `/v3/users` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:26.963857 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a5a6f6-574f-4d44-bbcd-64fd170f6828 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:26.965346 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a5a6f6-574f-4d44-bbcd-64fd170f6828 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:26.982338 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.sql.core [None req-35a5a6f6-574f-4d44-bbcd-64fd170f6828 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 10 19:08:26.982338 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 10 19:08:26.982338 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [parameters: {'user_id': 'de3f536e1b404db1a8b8e65a6996591d', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 10 19:08:26.982338 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79994) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 10 19:08:26.991298 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-35a5a6f6-574f-4d44-bbcd-64fd170f6828 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 10 19:08:26.991298 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:08:26.991298 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 10 19:08:26.991298 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application self.dialect.do_execute( May 10 19:08:26.991298 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 10 19:08:26.991298 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 10 19:08:26.991298 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 10 19:08:26.991298 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application result = self._query(query) May 10 19:08:26.991298 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 10 19:08:26.991298 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application conn.query(q) May 10 19:08:26.991298 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 10 19:08:26.991298 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 10 19:08:26.991298 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 10 19:08:26.991298 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application result.read() May 10 19:08:26.991298 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 10 19:08:26.992244 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 10 19:08:26.992244 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 10 19:08:26.992244 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application packet.raise_for_error() May 10 19:08:26.992244 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 10 19:08:26.992244 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 10 19:08:26.992244 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 10 19:08:26.992244 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 10 19:08:26.992244 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 10 19:08:26.992244 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:08:26.992244 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 10 19:08:26.992244 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:08:26.992244 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:08:26.992244 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 10 19:08:26.992244 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 10 19:08:26.992244 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user May 10 19:08:26.992244 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) May 10 19:08:26.992244 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 10 19:08:26.992244 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application next(self.gen) May 10 19:08:26.993264 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 10 19:08:26.993264 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application yield resource May 10 19:08:26.993264 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 10 19:08:26.993264 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application next(self.gen) May 10 19:08:26.993264 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 10 19:08:26.993264 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application self.session.rollback() May 10 19:08:26.993264 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 10 19:08:26.993264 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application self.force_reraise() May 10 19:08:26.993264 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 10 19:08:26.993264 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise self.value May 10 19:08:26.993264 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 10 19:08:26.993264 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 10 19:08:26.993264 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 10 19:08:26.993264 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application session.commit() May 10 19:08:26.993264 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 10 19:08:26.993264 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 10 19:08:26.993264 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 10 19:08:26.994183 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application self._prepare_impl() May 10 19:08:26.994183 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 10 19:08:26.994183 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application self.session.flush() May 10 19:08:26.994183 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 10 19:08:26.994183 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application self._flush(objects) May 10 19:08:26.994183 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 10 19:08:26.994183 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 10 19:08:26.994183 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 10 19:08:26.994183 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application compat.raise_( May 10 19:08:26.994183 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 10 19:08:26.994183 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception May 10 19:08:26.994183 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 10 19:08:26.994183 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application flush_context.execute() May 10 19:08:26.994183 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 10 19:08:26.994183 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rec.execute(self) May 10 19:08:26.994183 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 10 19:08:26.994183 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 10 19:08:26.995116 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 10 19:08:26.995116 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application _emit_insert_statements( May 10 19:08:26.995116 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 10 19:08:26.995116 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application result = connection._execute_20( May 10 19:08:26.995116 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 10 19:08:26.995116 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 10 19:08:26.995116 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 10 19:08:26.995116 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 10 19:08:26.995116 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 10 19:08:26.995116 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ret = self._execute_context( May 10 19:08:26.995116 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 10 19:08:26.995116 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 10 19:08:26.995116 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 10 19:08:26.995116 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 10 19:08:26.995116 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 10 19:08:26.995116 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception May 10 19:08:26.995985 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 10 19:08:26.995985 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application self.dialect.do_execute( May 10 19:08:26.995985 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 10 19:08:26.995985 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 10 19:08:26.995985 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 10 19:08:26.995985 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application result = self._query(query) May 10 19:08:26.995985 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 10 19:08:26.995985 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application conn.query(q) May 10 19:08:26.995985 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 10 19:08:26.995985 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 10 19:08:26.995985 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 10 19:08:26.995985 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application result.read() May 10 19:08:26.995985 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 10 19:08:26.995985 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 10 19:08:26.995985 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 10 19:08:26.995985 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application packet.raise_for_error() May 10 19:08:26.998424 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 10 19:08:26.998424 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 10 19:08:26.998424 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 10 19:08:26.998424 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 10 19:08:26.998424 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 10 19:08:26.998424 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 10 19:08:26.998424 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [parameters: {'user_id': 'de3f536e1b404db1a8b8e65a6996591d', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 10 19:08:26.998424 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 10 19:08:26.998424 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:08:26.998424 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 19:08:26.998424 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:08:26.998424 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:08:26.998424 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:08:26.998424 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:08:26.998424 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:08:27.000176 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:08:27.000176 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:08:27.000176 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:08:27.000176 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:08:27.000176 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:08:27.000176 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:08:27.000176 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:08:27.000176 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 10 19:08:27.000176 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 10 19:08:27.000176 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:08:27.000176 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:08:27.000176 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 19:08:27.000176 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 19:08:27.000176 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 19:08:27.000176 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 19:08:27.000176 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 10 19:08:27.000176 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 10 19:08:27.003449 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 10 19:08:27.003449 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 10 19:08:27.003449 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 10 19:08:27.003449 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 10 19:08:27.003449 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 10 19:08:27.003449 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:08:27.003449 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 500/980] 10.222.0.70 () {60 vars in 1131 bytes} [Tue May 10 19:08:26 2022] POST /identity/v3/users => generated 160 bytes in 187 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 10 19:08:27.003938 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87edd532-4a9c-42f2-b0fc-7f9958b147cb None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:27.119532 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87edd532-4a9c-42f2-b0fc-7f9958b147cb None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:27.154263 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c679b7-a948-4095-a325-1352c8b9f494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:27.155071 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c679b7-a948-4095-a325-1352c8b9f494 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:27.155350 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c679b7-a948-4095-a325-1352c8b9f494 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:27.155627 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c679b7-a948-4095-a325-1352c8b9f494 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:27.163957 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c679b7-a948-4095-a325-1352c8b9f494 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:27.165516 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c679b7-a948-4095-a325-1352c8b9f494 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:27.180577 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application [None req-91c679b7-a948-4095-a325-1352c8b9f494 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 10 19:08:27.180577 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:08:27.180577 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:08:27.180577 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:08:27.180577 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:08:27.180577 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:08:27.180577 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:08:27.180577 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:08:27.180577 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:08:27.180577 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:08:27.180577 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:08:27.180577 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:08:27.180577 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 19:08:27.180577 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 19:08:27.180577 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 19:08:27.180577 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 19:08:27.181564 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:08:27.181564 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:08:27.181564 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 19:08:27.181564 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 19:08:27.181564 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 19:08:27.181564 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 19:08:27.181564 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:08:27.181564 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:08:27.181564 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:08:27.181564 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:08:27.181564 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:08:27.181564 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application with Lock( May 10 19:08:27.181564 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:08:27.181564 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._enter() May 10 19:08:27.181564 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:08:27.181564 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:08:27.181564 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:08:27.181564 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.creator() May 10 19:08:27.182546 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:08:27.182546 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application created_value = creator( May 10 19:08:27.182546 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 19:08:27.182546 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 19:08:27.182546 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 19:08:27.182546 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 19:08:27.182546 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 19:08:27.182546 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 19:08:27.182546 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 10 19:08:27.182546 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application May 10 19:08:27.186750 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 481/981] 10.222.0.70 () {56 vars in 1099 bytes} [Tue May 10 19:08:27 2022] GET /identity/v3/users/cinder => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:08:27.188311 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a5a6f6-574f-4d44-bbcd-64fd170f6828 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:27.290924 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a5a6f6-574f-4d44-bbcd-64fd170f6828 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:27.324502 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842e34da-485a-4f10-9d32-72b9263c1b4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:27.325176 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842e34da-485a-4f10-9d32-72b9263c1b4e None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:27.325458 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842e34da-485a-4f10-9d32-72b9263c1b4e None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:27.325732 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842e34da-485a-4f10-9d32-72b9263c1b4e None admin] PATH_INFO: `/v3/users` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:27.326603 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842e34da-485a-4f10-9d32-72b9263c1b4e None admin] RBAC: Adding query filter params (name=cinder) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:08:27.326907 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842e34da-485a-4f10-9d32-72b9263c1b4e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:27.328557 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842e34da-485a-4f10-9d32-72b9263c1b4e None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:27.372985 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 501/982] 10.222.0.70 () {56 vars in 1101 bytes} [Tue May 10 19:08:27 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:08:27.569715 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca04cd8-d70f-48ca-a576-162989fda4a2 None None] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:27.570083 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca04cd8-d70f-48ca-a576-162989fda4a2 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:27.570256 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca04cd8-d70f-48ca-a576-162989fda4a2 None None] PATH_INFO: `/` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:27.571602 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 482/983] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:08:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:08:27.577327 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b3f626-1031-4765-aaa5-cf7c37183842 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:27.577631 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b3f626-1031-4765-aaa5-cf7c37183842 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:27.577952 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b3f626-1031-4765-aaa5-cf7c37183842 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:27.597946 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-06b3f626-1031-4765-aaa5-cf7c37183842 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:08:27.599456 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-06b3f626-1031-4765-aaa5-cf7c37183842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:08:27.666319 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 502/984] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:08:27 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 19:08:27.689078 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca04cd8-d70f-48ca-a576-162989fda4a2 None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:27.785927 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca04cd8-d70f-48ca-a576-162989fda4a2 None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:27.817976 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdca697-8af9-41e0-a81a-4b91779c1e80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:27.818784 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdca697-8af9-41e0-a81a-4b91779c1e80 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:27.819065 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdca697-8af9-41e0-a81a-4b91779c1e80 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:27.819341 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdca697-8af9-41e0-a81a-4b91779c1e80 None admin] PATH_INFO: `/v3/services/compute` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:27.820035 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdca697-8af9-41e0-a81a-4b91779c1e80 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:27.821379 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdca697-8af9-41e0-a81a-4b91779c1e80 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:27.834290 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application [None req-6cdca697-8af9-41e0-a81a-4b91779c1e80 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 10 19:08:27.834290 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:08:27.834290 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 19:08:27.834290 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 19:08:27.834290 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 19:08:27.834290 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 19:08:27.834290 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 19:08:27.834290 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 19:08:27.834290 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 10 19:08:27.834290 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application May 10 19:08:27.834290 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 19:08:27.834290 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application May 10 19:08:27.834290 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:08:27.834290 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:08:27.834290 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:08:27.834290 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:08:27.834290 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:08:27.835379 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:08:27.835379 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:08:27.835379 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:08:27.835379 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:08:27.835379 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:08:27.835379 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:08:27.835379 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 19:08:27.835379 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 19:08:27.835379 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 19:08:27.835379 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 19:08:27.835379 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:08:27.835379 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:08:27.835379 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:08:27.835379 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:08:27.835379 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:08:27.835379 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:08:27.836707 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:08:27.836707 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application with Lock( May 10 19:08:27.836707 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:08:27.836707 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._enter() May 10 19:08:27.836707 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:08:27.836707 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:08:27.836707 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:08:27.836707 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.creator() May 10 19:08:27.836707 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:08:27.836707 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application created_value = creator( May 10 19:08:27.836707 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 19:08:27.836707 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 19:08:27.836707 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 10 19:08:27.836707 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application May 10 19:08:27.838009 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 483/985] 10.222.0.70 () {56 vars in 1111 bytes} [Tue May 10 19:08:27 2022] GET /identity/v3/services/compute => generated 88 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:08:27.843649 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b3f626-1031-4765-aaa5-cf7c37183842 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:27.940360 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b3f626-1031-4765-aaa5-cf7c37183842 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:27.976725 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dfc911-ec24-468d-95bd-fb070f6de1ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:27.977389 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dfc911-ec24-468d-95bd-fb070f6de1ea None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:27.977665 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dfc911-ec24-468d-95bd-fb070f6de1ea None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:27.977934 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dfc911-ec24-468d-95bd-fb070f6de1ea None admin] PATH_INFO: `/v3/services` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:27.978625 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dfc911-ec24-468d-95bd-fb070f6de1ea None admin] RBAC: Adding query filter params (name=compute) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:08:27.978927 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dfc911-ec24-468d-95bd-fb070f6de1ea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:27.980272 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dfc911-ec24-468d-95bd-fb070f6de1ea None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:27.989557 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 503/986] 10.222.0.70 () {56 vars in 1112 bytes} [Tue May 10 19:08:27 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:08:27.990655 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdca697-8af9-41e0-a81a-4b91779c1e80 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:28.085194 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdca697-8af9-41e0-a81a-4b91779c1e80 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:28.118590 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739b6d13-f330-4c64-a39c-92fda472f9e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:28.119248 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739b6d13-f330-4c64-a39c-92fda472f9e9 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:28.119527 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739b6d13-f330-4c64-a39c-92fda472f9e9 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:28.119792 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739b6d13-f330-4c64-a39c-92fda472f9e9 None admin] PATH_INFO: `/v3/services` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:28.120515 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739b6d13-f330-4c64-a39c-92fda472f9e9 None admin] RBAC: Adding query filter params (type=compute) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:08:28.120815 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739b6d13-f330-4c64-a39c-92fda472f9e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:28.122165 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739b6d13-f330-4c64-a39c-92fda472f9e9 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:28.131535 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 484/987] 10.222.0.70 () {56 vars in 1112 bytes} [Tue May 10 19:08:27 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:08:28.132821 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dfc911-ec24-468d-95bd-fb070f6de1ea None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:28.235691 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dfc911-ec24-468d-95bd-fb070f6de1ea None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:28.268510 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652a8b24-7f97-4f5a-bf92-71a183492a76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:28.269177 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652a8b24-7f97-4f5a-bf92-71a183492a76 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:28.269457 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652a8b24-7f97-4f5a-bf92-71a183492a76 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:28.269731 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652a8b24-7f97-4f5a-bf92-71a183492a76 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:28.270516 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652a8b24-7f97-4f5a-bf92-71a183492a76 None admin] RBAC: Adding query filter params (interface=public, service_id=39c0023febbe46eea38acc6611d5ffbc, region_id=RegionOne) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:08:28.270824 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652a8b24-7f97-4f5a-bf92-71a183492a76 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:28.272182 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652a8b24-7f97-4f5a-bf92-71a183492a76 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:28.277182 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 504/988] 10.222.0.70 () {56 vars in 1251 bytes} [Tue May 10 19:08:28 2022] GET /identity/v3/endpoints?service_id=39c0023febbe46eea38acc6611d5ffbc&interface=public®ion_id=RegionOne => generated 194 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:08:28.282954 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739b6d13-f330-4c64-a39c-92fda472f9e9 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:28.375574 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739b6d13-f330-4c64-a39c-92fda472f9e9 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:28.406865 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1d752a-1822-4a86-9b9a-4e61123b0535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:28.407545 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1d752a-1822-4a86-9b9a-4e61123b0535 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:28.407824 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1d752a-1822-4a86-9b9a-4e61123b0535 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:28.408094 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1d752a-1822-4a86-9b9a-4e61123b0535 None admin] PATH_INFO: `/v3/services` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:28.408781 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1d752a-1822-4a86-9b9a-4e61123b0535 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:28.410131 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1d752a-1822-4a86-9b9a-4e61123b0535 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:28.416174 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 485/989] 10.222.0.70 () {56 vars in 1087 bytes} [Tue May 10 19:08:28 2022] GET /identity/v3/services => generated 1727 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:08:28.646688 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0535b732-0db6-46d0-877a-a9d3c92ba7e3 None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:28.646877 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0535b732-0db6-46d0-877a-a9d3c92ba7e3 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:28.647151 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0535b732-0db6-46d0-877a-a9d3c92ba7e3 None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:28.648689 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 505/990] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:08:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:08:28.653905 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fd9848-8ff2-490c-955a-f2b6eeb227b5 None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:28.654193 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fd9848-8ff2-490c-955a-f2b6eeb227b5 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:28.654467 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fd9848-8ff2-490c-955a-f2b6eeb227b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:28.671203 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-d5fd9848-8ff2-490c-955a-f2b6eeb227b5 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:08:28.672467 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-d5fd9848-8ff2-490c-955a-f2b6eeb227b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:08:28.736449 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 486/991] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:08:28 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 19:08:28.758277 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0535b732-0db6-46d0-877a-a9d3c92ba7e3 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:28.858756 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0535b732-0db6-46d0-877a-a9d3c92ba7e3 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:28.892467 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb20163-55fc-41ef-8d35-805a50a737fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:28.893291 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb20163-55fc-41ef-8d35-805a50a737fc None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:28.893575 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb20163-55fc-41ef-8d35-805a50a737fc None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:28.893848 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb20163-55fc-41ef-8d35-805a50a737fc None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:28.894496 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb20163-55fc-41ef-8d35-805a50a737fc None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:28.895864 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb20163-55fc-41ef-8d35-805a50a737fc None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:28.907829 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-beb20163-55fc-41ef-8d35-805a50a737fc None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 19:08:28.907829 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:08:28.907829 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 19:08:28.907829 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 19:08:28.907829 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 19:08:28.907829 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 19:08:28.907829 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 19:08:28.907829 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 19:08:28.907829 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 19:08:28.907829 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:08:28.907829 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 19:08:28.907829 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:08:28.907829 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:08:28.907829 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:08:28.907829 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:08:28.907829 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:08:28.907829 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:08:28.908888 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:08:28.908888 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:08:28.908888 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:08:28.908888 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:08:28.908888 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:08:28.908888 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:08:28.908888 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 19:08:28.908888 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 19:08:28.908888 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 19:08:28.908888 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 19:08:28.908888 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:08:28.908888 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:08:28.908888 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:08:28.908888 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:08:28.908888 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:08:28.908888 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:08:28.909742 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:08:28.909742 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( May 10 19:08:28.909742 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:08:28.909742 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() May 10 19:08:28.909742 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:08:28.909742 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:08:28.909742 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:08:28.909742 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() May 10 19:08:28.909742 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:08:28.909742 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( May 10 19:08:28.909742 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 19:08:28.909742 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 19:08:28.909742 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 19:08:28.909742 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:08:28.909742 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 506/992] 10.222.0.70 () {56 vars in 1126 bytes} [Tue May 10 19:08:28 2022] GET /identity/v3/services/object-store => generated 93 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:08:28.916649 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fd9848-8ff2-490c-955a-f2b6eeb227b5 None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:29.021235 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fd9848-8ff2-490c-955a-f2b6eeb227b5 None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:29.053559 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17665f0-4fc9-4a64-96ad-9b4be8e527a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:29.054567 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17665f0-4fc9-4a64-96ad-9b4be8e527a6 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:29.055003 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17665f0-4fc9-4a64-96ad-9b4be8e527a6 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:29.055434 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17665f0-4fc9-4a64-96ad-9b4be8e527a6 None admin] PATH_INFO: `/v3/services` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:29.056311 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17665f0-4fc9-4a64-96ad-9b4be8e527a6 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:08:29.056810 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17665f0-4fc9-4a64-96ad-9b4be8e527a6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:29.058395 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17665f0-4fc9-4a64-96ad-9b4be8e527a6 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:29.064626 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 487/993] 10.222.0.70 () {56 vars in 1122 bytes} [Tue May 10 19:08:28 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:08:29.070720 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb20163-55fc-41ef-8d35-805a50a737fc None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:29.172113 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb20163-55fc-41ef-8d35-805a50a737fc None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:29.211734 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43909aa-47b4-49ed-b436-ef9449e42517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:29.211942 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43909aa-47b4-49ed-b436-ef9449e42517 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:29.212190 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43909aa-47b4-49ed-b436-ef9449e42517 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:29.212354 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43909aa-47b4-49ed-b436-ef9449e42517 None admin] PATH_INFO: `/v3/services` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:29.213586 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43909aa-47b4-49ed-b436-ef9449e42517 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:08:29.213586 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43909aa-47b4-49ed-b436-ef9449e42517 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:29.214699 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43909aa-47b4-49ed-b436-ef9449e42517 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:29.219770 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 507/994] 10.222.0.70 () {56 vars in 1122 bytes} [Tue May 10 19:08:29 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:08:29.225513 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17665f0-4fc9-4a64-96ad-9b4be8e527a6 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:29.242884 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d66d14-3fb5-49a9-a706-14814777747c None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:29.243183 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d66d14-3fb5-49a9-a706-14814777747c None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:29.243454 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d66d14-3fb5-49a9-a706-14814777747c None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:29.244848 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 508/995] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:08:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 19:08:29.250018 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5d9259-bb58-46fd-8187-2ef0d99e460b None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:29.250311 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5d9259-bb58-46fd-8187-2ef0d99e460b None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:29.250592 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5d9259-bb58-46fd-8187-2ef0d99e460b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:29.268521 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-5e5d9259-bb58-46fd-8187-2ef0d99e460b None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:08:29.269713 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-5e5d9259-bb58-46fd-8187-2ef0d99e460b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:08:29.328054 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17665f0-4fc9-4a64-96ad-9b4be8e527a6 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:29.333575 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 509/996] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:08:29 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 19:08:29.355052 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5d9259-bb58-46fd-8187-2ef0d99e460b None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:29.361684 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69686fb0-c25f-43dd-b534-1b123d6530a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:29.362348 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69686fb0-c25f-43dd-b534-1b123d6530a7 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:29.362629 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69686fb0-c25f-43dd-b534-1b123d6530a7 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:29.362909 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69686fb0-c25f-43dd-b534-1b123d6530a7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:29.363701 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69686fb0-c25f-43dd-b534-1b123d6530a7 None admin] RBAC: Adding query filter params (interface=admin, service_id=755e726ec21c475a92f53f7efe4f6b3d, region_id=RegionOne) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:08:29.364010 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69686fb0-c25f-43dd-b534-1b123d6530a7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:29.365423 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69686fb0-c25f-43dd-b534-1b123d6530a7 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:29.374765 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 488/997] 10.222.0.70 () {56 vars in 1249 bytes} [Tue May 10 19:08:29 2022] GET /identity/v3/endpoints?service_id=755e726ec21c475a92f53f7efe4f6b3d&interface=admin®ion_id=RegionOne => generated 193 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:08:29.375712 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69686fb0-c25f-43dd-b534-1b123d6530a7 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:29.451167 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5d9259-bb58-46fd-8187-2ef0d99e460b None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:29.471233 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69686fb0-c25f-43dd-b534-1b123d6530a7 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:29.485180 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3a0e79-40df-47a1-a02b-50302fac885b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:29.486495 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3a0e79-40df-47a1-a02b-50302fac885b None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:29.486780 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3a0e79-40df-47a1-a02b-50302fac885b None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:29.487053 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3a0e79-40df-47a1-a02b-50302fac885b None admin] PATH_INFO: `/v3/services/image` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:29.487700 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3a0e79-40df-47a1-a02b-50302fac885b None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:29.489085 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3a0e79-40df-47a1-a02b-50302fac885b None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:29.500285 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-de3a0e79-40df-47a1-a02b-50302fac885b None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 10 19:08:29.500285 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:08:29.500285 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 19:08:29.500285 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 19:08:29.500285 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 19:08:29.500285 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 19:08:29.500285 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 19:08:29.500285 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 19:08:29.500285 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 10 19:08:29.500285 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:08:29.500285 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 19:08:29.500285 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:08:29.500285 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:08:29.500285 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:08:29.500285 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:08:29.500285 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:08:29.500285 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:08:29.501947 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:08:29.501947 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:08:29.501947 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:08:29.501947 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:08:29.501947 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:08:29.501947 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:08:29.501947 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 19:08:29.501947 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 19:08:29.501947 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 19:08:29.501947 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 19:08:29.501947 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:08:29.501947 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:08:29.501947 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:08:29.501947 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:08:29.501947 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:08:29.501947 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:08:29.508140 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:08:29.508140 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( May 10 19:08:29.508140 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:08:29.508140 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() May 10 19:08:29.508140 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:08:29.508140 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:08:29.508140 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:08:29.508140 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() May 10 19:08:29.508140 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:08:29.508140 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( May 10 19:08:29.508140 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 19:08:29.508140 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 19:08:29.508140 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 10 19:08:29.508140 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:08:29.508140 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 510/998] 10.222.0.70 () {56 vars in 1105 bytes} [Tue May 10 19:08:29 2022] GET /identity/v3/services/image => generated 86 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 19:08:29.509246 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3a0e79-40df-47a1-a02b-50302fac885b None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:29.512258 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870ea010-3841-49ba-a7e6-145d8366b713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:29.513036 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870ea010-3841-49ba-a7e6-145d8366b713 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:29.513322 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870ea010-3841-49ba-a7e6-145d8366b713 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:29.513600 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870ea010-3841-49ba-a7e6-145d8366b713 None admin] PATH_INFO: `/v3/services` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:29.514281 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870ea010-3841-49ba-a7e6-145d8366b713 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:29.515653 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870ea010-3841-49ba-a7e6-145d8366b713 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:29.528519 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 489/999] 10.222.0.70 () {56 vars in 1087 bytes} [Tue May 10 19:08:29 2022] GET /identity/v3/services => generated 1727 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 19:08:29.614133 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3a0e79-40df-47a1-a02b-50302fac885b None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:29.648615 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb09636-f198-442b-9d66-51c255ad04d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:29.649300 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb09636-f198-442b-9d66-51c255ad04d7 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:29.649587 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb09636-f198-442b-9d66-51c255ad04d7 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:29.649868 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb09636-f198-442b-9d66-51c255ad04d7 None admin] PATH_INFO: `/v3/services` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:29.650594 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb09636-f198-442b-9d66-51c255ad04d7 None admin] RBAC: Adding query filter params (name=image) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:08:29.650905 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb09636-f198-442b-9d66-51c255ad04d7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:29.652324 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb09636-f198-442b-9d66-51c255ad04d7 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:29.662853 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 511/1000] 10.222.0.70 () {56 vars in 1108 bytes} [Tue May 10 19:08:29 2022] GET /identity/v3/services?name=image => generated 122 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:08:29.664619 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870ea010-3841-49ba-a7e6-145d8366b713 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:29.761913 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870ea010-3841-49ba-a7e6-145d8366b713 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:29.793888 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd537762-4d1a-4ffd-a2f6-03373be54a13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:29.794568 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd537762-4d1a-4ffd-a2f6-03373be54a13 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:29.794827 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd537762-4d1a-4ffd-a2f6-03373be54a13 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:29.795101 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd537762-4d1a-4ffd-a2f6-03373be54a13 None admin] PATH_INFO: `/v3/services` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:29.795793 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd537762-4d1a-4ffd-a2f6-03373be54a13 None admin] RBAC: Adding query filter params (type=image) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:08:29.796094 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd537762-4d1a-4ffd-a2f6-03373be54a13 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:29.797534 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd537762-4d1a-4ffd-a2f6-03373be54a13 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:29.802507 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 490/1001] 10.222.0.70 () {56 vars in 1108 bytes} [Tue May 10 19:08:29 2022] GET /identity/v3/services?type=image => generated 122 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:08:30.676673 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17077ad-7c29-4956-b277-6ef061ce0c53 None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:30.677190 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17077ad-7c29-4956-b277-6ef061ce0c53 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:30.677297 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17077ad-7c29-4956-b277-6ef061ce0c53 None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:30.678625 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 512/1002] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:08:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:08:30.683744 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107d6a0d-3d5a-4eac-8314-59d29a156772 None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:30.684137 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107d6a0d-3d5a-4eac-8314-59d29a156772 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:30.684331 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107d6a0d-3d5a-4eac-8314-59d29a156772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:30.700405 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-107d6a0d-3d5a-4eac-8314-59d29a156772 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:08:30.701600 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-107d6a0d-3d5a-4eac-8314-59d29a156772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:08:30.765590 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 491/1003] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:08:30 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 19:08:30.788221 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17077ad-7c29-4956-b277-6ef061ce0c53 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:30.887405 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17077ad-7c29-4956-b277-6ef061ce0c53 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:30.921886 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5042b5f-1f9e-4575-a9e4-9e95ab165ea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:30.923209 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5042b5f-1f9e-4575-a9e4-9e95ab165ea3 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:30.923495 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5042b5f-1f9e-4575-a9e4-9e95ab165ea3 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:30.923766 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5042b5f-1f9e-4575-a9e4-9e95ab165ea3 None admin] PATH_INFO: `/v3/services/compute` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:30.924412 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5042b5f-1f9e-4575-a9e4-9e95ab165ea3 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:30.925784 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5042b5f-1f9e-4575-a9e4-9e95ab165ea3 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:30.937240 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-a5042b5f-1f9e-4575-a9e4-9e95ab165ea3 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 10 19:08:30.937240 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:08:30.937240 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 19:08:30.937240 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 19:08:30.937240 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 19:08:30.937240 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 19:08:30.937240 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 19:08:30.937240 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 19:08:30.937240 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 10 19:08:30.937240 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:08:30.937240 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 19:08:30.937240 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:08:30.937240 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:08:30.937240 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:08:30.937240 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:08:30.937240 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:08:30.937240 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:08:30.938395 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:08:30.938395 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:08:30.938395 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:08:30.938395 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:08:30.938395 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:08:30.938395 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:08:30.938395 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 19:08:30.938395 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 19:08:30.938395 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 19:08:30.938395 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 19:08:30.938395 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:08:30.938395 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:08:30.938395 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:08:30.938395 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:08:30.938395 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:08:30.938395 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:08:30.939291 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:08:30.939291 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( May 10 19:08:30.939291 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:08:30.939291 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() May 10 19:08:30.939291 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:08:30.939291 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:08:30.939291 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:08:30.939291 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() May 10 19:08:30.939291 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:08:30.939291 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( May 10 19:08:30.939291 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 19:08:30.939291 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 19:08:30.939291 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 10 19:08:30.939291 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:08:30.940748 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 513/1004] 10.222.0.70 () {56 vars in 1111 bytes} [Tue May 10 19:08:30 2022] GET /identity/v3/services/compute => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:08:30.947403 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107d6a0d-3d5a-4eac-8314-59d29a156772 None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:31.043070 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107d6a0d-3d5a-4eac-8314-59d29a156772 None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:31.075155 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32891e9-20d8-4b5d-86e9-184333b58f67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:31.075828 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32891e9-20d8-4b5d-86e9-184333b58f67 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:31.076115 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32891e9-20d8-4b5d-86e9-184333b58f67 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:31.076389 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32891e9-20d8-4b5d-86e9-184333b58f67 None admin] PATH_INFO: `/v3/services` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:31.078594 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32891e9-20d8-4b5d-86e9-184333b58f67 None admin] RBAC: Adding query filter params (name=compute) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:08:31.079420 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32891e9-20d8-4b5d-86e9-184333b58f67 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:31.080868 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32891e9-20d8-4b5d-86e9-184333b58f67 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:31.086115 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 492/1005] 10.222.0.70 () {56 vars in 1112 bytes} [Tue May 10 19:08:30 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:08:31.091505 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5042b5f-1f9e-4575-a9e4-9e95ab165ea3 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:31.186999 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5042b5f-1f9e-4575-a9e4-9e95ab165ea3 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:31.223369 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4155410-4afc-4e90-b68e-013125de4f70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:31.223959 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4155410-4afc-4e90-b68e-013125de4f70 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:31.224242 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4155410-4afc-4e90-b68e-013125de4f70 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:31.224538 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4155410-4afc-4e90-b68e-013125de4f70 None admin] PATH_INFO: `/v3/services` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:31.225236 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4155410-4afc-4e90-b68e-013125de4f70 None admin] RBAC: Adding query filter params (type=compute) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:08:31.225545 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4155410-4afc-4e90-b68e-013125de4f70 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:31.226906 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4155410-4afc-4e90-b68e-013125de4f70 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:31.236784 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 514/1006] 10.222.0.70 () {56 vars in 1112 bytes} [Tue May 10 19:08:31 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:08:31.237749 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32891e9-20d8-4b5d-86e9-184333b58f67 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:31.348538 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32891e9-20d8-4b5d-86e9-184333b58f67 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:31.380678 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b056a1cb-c702-4d9b-954f-ee0276783178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:31.381345 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b056a1cb-c702-4d9b-954f-ee0276783178 None admin] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:31.381629 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b056a1cb-c702-4d9b-954f-ee0276783178 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:31.381906 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b056a1cb-c702-4d9b-954f-ee0276783178 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:31.382646 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b056a1cb-c702-4d9b-954f-ee0276783178 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:31.384013 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b056a1cb-c702-4d9b-954f-ee0276783178 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:31.407591 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 493/1007] 10.222.0.70 () {60 vars in 1144 bytes} [Tue May 10 19:08:31 2022] POST /identity/v3/endpoints => generated 334 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 19:08:31.750636 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fb60d3-0152-4be9-b213-cd2b66c25392 None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:31.751245 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fb60d3-0152-4be9-b213-cd2b66c25392 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:31.751245 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fb60d3-0152-4be9-b213-cd2b66c25392 None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:31.752765 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 515/1008] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:08:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:08:31.757856 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d880fc-99f3-4564-8ce3-a191c2ad363f None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:31.758260 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d880fc-99f3-4564-8ce3-a191c2ad363f None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:31.758431 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d880fc-99f3-4564-8ce3-a191c2ad363f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:31.774978 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-18d880fc-99f3-4564-8ce3-a191c2ad363f None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:08:31.776124 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-18d880fc-99f3-4564-8ce3-a191c2ad363f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:08:31.843881 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 494/1009] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:08:31 2022] POST /identity/v3/auth/tokens => generated 1716 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 19:08:31.867025 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fb60d3-0152-4be9-b213-cd2b66c25392 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:31.971056 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fb60d3-0152-4be9-b213-cd2b66c25392 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:32.003050 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64aac7b5-ed35-44e0-b70f-e3520074a798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:32.004189 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aac7b5-ed35-44e0-b70f-e3520074a798 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:32.004695 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aac7b5-ed35-44e0-b70f-e3520074a798 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:32.004970 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aac7b5-ed35-44e0-b70f-e3520074a798 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:32.005616 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64aac7b5-ed35-44e0-b70f-e3520074a798 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:32.006977 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64aac7b5-ed35-44e0-b70f-e3520074a798 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:32.019520 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-64aac7b5-ed35-44e0-b70f-e3520074a798 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 19:08:32.019520 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:08:32.019520 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 19:08:32.019520 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 19:08:32.019520 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 19:08:32.019520 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 19:08:32.019520 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 19:08:32.019520 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 19:08:32.019520 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 19:08:32.019520 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:08:32.019520 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 19:08:32.019520 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:08:32.019520 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:08:32.019520 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:08:32.019520 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:08:32.019520 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:08:32.019520 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:08:32.020910 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:08:32.020910 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:08:32.020910 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:08:32.020910 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:08:32.020910 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:08:32.020910 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:08:32.020910 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 19:08:32.020910 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 19:08:32.020910 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 19:08:32.020910 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 19:08:32.020910 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:08:32.020910 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:08:32.020910 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:08:32.020910 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:08:32.020910 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:08:32.020910 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:08:32.021781 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:08:32.021781 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( May 10 19:08:32.021781 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:08:32.021781 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() May 10 19:08:32.021781 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:08:32.021781 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:08:32.021781 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:08:32.021781 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() May 10 19:08:32.021781 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:08:32.021781 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( May 10 19:08:32.021781 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 19:08:32.021781 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 19:08:32.021781 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 19:08:32.021781 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:08:32.024772 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 516/1010] 10.222.0.70 () {56 vars in 1126 bytes} [Tue May 10 19:08:31 2022] GET /identity/v3/services/object-store => generated 93 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:08:32.026666 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d880fc-99f3-4564-8ce3-a191c2ad363f None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:32.050038 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89944c8-2f1b-49c0-9a21-539f0373dd9f None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:32.050356 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89944c8-2f1b-49c0-9a21-539f0373dd9f None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:32.050599 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89944c8-2f1b-49c0-9a21-539f0373dd9f None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:32.051963 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 517/1011] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:08:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 19:08:32.056964 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd86b001-014d-46d0-bedf-2aab23bccd67 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:32.057256 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd86b001-014d-46d0-bedf-2aab23bccd67 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:32.057538 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd86b001-014d-46d0-bedf-2aab23bccd67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:32.074174 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-bd86b001-014d-46d0-bedf-2aab23bccd67 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:08:32.075346 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-bd86b001-014d-46d0-bedf-2aab23bccd67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:08:32.129493 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d880fc-99f3-4564-8ce3-a191c2ad363f None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:32.148459 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 518/1012] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:08:32 2022] POST /identity/v3/auth/tokens => generated 1716 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 19:08:32.166641 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d84a69e-126b-4ab1-aee4-a260870fb1df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:32.167431 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d84a69e-126b-4ab1-aee4-a260870fb1df None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:32.167779 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d84a69e-126b-4ab1-aee4-a260870fb1df None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:32.167878 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd86b001-014d-46d0-bedf-2aab23bccd67 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:32.168158 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d84a69e-126b-4ab1-aee4-a260870fb1df None admin] PATH_INFO: `/v3/services` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:32.168976 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d84a69e-126b-4ab1-aee4-a260870fb1df None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:08:32.169333 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d84a69e-126b-4ab1-aee4-a260870fb1df None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:32.170706 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d84a69e-126b-4ab1-aee4-a260870fb1df None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:32.181105 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 495/1013] 10.222.0.70 () {56 vars in 1122 bytes} [Tue May 10 19:08:32 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:08:32.182101 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d84a69e-126b-4ab1-aee4-a260870fb1df None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:32.274858 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd86b001-014d-46d0-bedf-2aab23bccd67 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:32.282407 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d84a69e-126b-4ab1-aee4-a260870fb1df None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:32.314854 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3c909c-cac7-4371-b193-ae8df123b758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:32.315078 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7daa84c-a8db-46b0-aa55-d9cf34085d68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:32.315525 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3c909c-cac7-4371-b193-ae8df123b758 None admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:32.315698 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7daa84c-a8db-46b0-aa55-d9cf34085d68 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:32.315807 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3c909c-cac7-4371-b193-ae8df123b758 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:32.315959 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7daa84c-a8db-46b0-aa55-d9cf34085d68 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:32.316052 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3c909c-cac7-4371-b193-ae8df123b758 None admin] PATH_INFO: `/v3/services` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:32.316198 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7daa84c-a8db-46b0-aa55-d9cf34085d68 None admin] PATH_INFO: `/v3/services` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:32.316794 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3c909c-cac7-4371-b193-ae8df123b758 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:32.316970 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7daa84c-a8db-46b0-aa55-d9cf34085d68 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:08:32.317232 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7daa84c-a8db-46b0-aa55-d9cf34085d68 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:32.318162 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3c909c-cac7-4371-b193-ae8df123b758 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:32.318578 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7daa84c-a8db-46b0-aa55-d9cf34085d68 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:32.324135 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 496/1014] 10.222.0.70 () {56 vars in 1122 bytes} [Tue May 10 19:08:32 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:08:32.336089 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7daa84c-a8db-46b0-aa55-d9cf34085d68 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:32.348829 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 519/1015] 10.222.0.70 () {60 vars in 1141 bytes} [Tue May 10 19:08:32 2022] POST /identity/v3/services => generated 242 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:08:32.440679 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7daa84c-a8db-46b0-aa55-d9cf34085d68 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:32.487662 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ed81fe-6683-4871-8753-8e62460c6629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:32.488757 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ed81fe-6683-4871-8753-8e62460c6629 None admin] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:32.489209 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ed81fe-6683-4871-8753-8e62460c6629 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:32.489636 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ed81fe-6683-4871-8753-8e62460c6629 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:32.490565 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ed81fe-6683-4871-8753-8e62460c6629 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:32.492111 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ed81fe-6683-4871-8753-8e62460c6629 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:32.509466 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 497/1016] 10.222.0.70 () {60 vars in 1144 bytes} [Tue May 10 19:08:32 2022] POST /identity/v3/endpoints => generated 325 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 19:08:33.733654 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ad1834-f69b-46bd-8c3d-17ef7e0eee29 None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:33.734231 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ad1834-f69b-46bd-8c3d-17ef7e0eee29 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:33.734231 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ad1834-f69b-46bd-8c3d-17ef7e0eee29 None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:33.735783 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 520/1017] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:08:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:08:33.740818 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ba96c1-c6e3-435d-bf02-380a7239d506 None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:33.741222 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ba96c1-c6e3-435d-bf02-380a7239d506 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:33.741410 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ba96c1-c6e3-435d-bf02-380a7239d506 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:33.757968 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-13ba96c1-c6e3-435d-bf02-380a7239d506 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:08:33.759119 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-13ba96c1-c6e3-435d-bf02-380a7239d506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:08:33.827241 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 498/1018] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:08:33 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 19:08:33.851220 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ad1834-f69b-46bd-8c3d-17ef7e0eee29 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:33.949262 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ad1834-f69b-46bd-8c3d-17ef7e0eee29 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:33.983590 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe06b8f7-0adb-4332-a958-b442e040d09b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:33.984473 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe06b8f7-0adb-4332-a958-b442e040d09b None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:33.984706 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe06b8f7-0adb-4332-a958-b442e040d09b None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:33.984972 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe06b8f7-0adb-4332-a958-b442e040d09b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:33.994589 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe06b8f7-0adb-4332-a958-b442e040d09b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:08:34.002575 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-fe06b8f7-0adb-4332-a958-b442e040d09b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 10 19:08:34.002575 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:08:34.002575 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:08:34.002575 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:08:34.002575 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:08:34.002575 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:08:34.002575 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:08:34.002575 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:08:34.002575 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:08:34.002575 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:08:34.002575 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:08:34.002575 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:08:34.002575 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:08:34.002575 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:08:34.002575 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:08:34.002575 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:08:34.003526 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:08:34.003526 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:08:34.003526 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:08:34.003526 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:08:34.003526 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:08:34.003526 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:08:34.003526 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:08:34.003526 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:08:34.003526 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:08:34.003526 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:08:34.003526 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:08:34.003526 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( May 10 19:08:34.003526 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:08:34.003526 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() May 10 19:08:34.003526 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:08:34.003526 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:08:34.004404 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:08:34.004404 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() May 10 19:08:34.004404 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:08:34.004404 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( May 10 19:08:34.004404 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:08:34.004404 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:08:34.004404 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:08:34.004404 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:08:34.004404 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:08:34.004404 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:08:34.004404 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 10 19:08:34.004404 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:08:34.004404 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 521/1019] 10.222.0.70 () {56 vars in 1120 bytes} [Tue May 10 19:08:33 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:08:34.011040 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ba96c1-c6e3-435d-bf02-380a7239d506 None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:34.105681 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ba96c1-c6e3-435d-bf02-380a7239d506 None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:34.137320 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b68c8a-ab3e-4c8d-9aa2-6c86ca792e6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:34.137991 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b68c8a-ab3e-4c8d-9aa2-6c86ca792e6b None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:34.138275 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b68c8a-ab3e-4c8d-9aa2-6c86ca792e6b None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:34.138551 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b68c8a-ab3e-4c8d-9aa2-6c86ca792e6b None admin] PATH_INFO: `/v3/roles` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:34.139289 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b68c8a-ab3e-4c8d-9aa2-6c86ca792e6b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:08:34.139595 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b68c8a-ab3e-4c8d-9aa2-6c86ca792e6b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:34.140996 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b68c8a-ab3e-4c8d-9aa2-6c86ca792e6b None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:34.153896 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 499/1020] 10.222.0.70 () {56 vars in 1115 bytes} [Tue May 10 19:08:34 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:08:34.155352 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe06b8f7-0adb-4332-a958-b442e040d09b None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:34.250602 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe06b8f7-0adb-4332-a958-b442e040d09b None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:34.282848 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1d6e97-53df-4591-96e7-7ada6560524d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:34.283651 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1d6e97-53df-4591-96e7-7ada6560524d None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:34.283931 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1d6e97-53df-4591-96e7-7ada6560524d None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:34.284200 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1d6e97-53df-4591-96e7-7ada6560524d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:34.294307 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1d6e97-53df-4591-96e7-7ada6560524d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:34.295743 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1d6e97-53df-4591-96e7-7ada6560524d None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:34.311968 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-6a1d6e97-53df-4591-96e7-7ada6560524d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:08:34.311968 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:08:34.311968 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:08:34.311968 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:08:34.311968 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:08:34.311968 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:08:34.311968 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:08:34.311968 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:08:34.311968 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:08:34.311968 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:08:34.311968 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:08:34.311968 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:08:34.311968 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 19:08:34.311968 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 19:08:34.311968 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 19:08:34.312975 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 19:08:34.312975 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:08:34.312975 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:08:34.312975 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:08:34.312975 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:08:34.312975 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:08:34.312975 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:08:34.312975 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:08:34.312975 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( May 10 19:08:34.312975 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:08:34.312975 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() May 10 19:08:34.312975 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:08:34.312975 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:08:34.312975 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:08:34.312975 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() May 10 19:08:34.312975 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:08:34.312975 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( May 10 19:08:34.314422 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 19:08:34.314422 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 19:08:34.314422 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:08:34.314422 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:08:34.315233 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 522/1021] 10.222.0.70 () {56 vars in 1108 bytes} [Tue May 10 19:08:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 19:08:34.319502 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b68c8a-ab3e-4c8d-9aa2-6c86ca792e6b None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:34.414481 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b68c8a-ab3e-4c8d-9aa2-6c86ca792e6b None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:34.450065 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6ffcef-6cd2-4bd4-95b8-e02741ddc5ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:34.450737 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6ffcef-6cd2-4bd4-95b8-e02741ddc5ec None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:34.451020 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6ffcef-6cd2-4bd4-95b8-e02741ddc5ec None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:34.451292 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6ffcef-6cd2-4bd4-95b8-e02741ddc5ec None admin] PATH_INFO: `/v3/domains` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:34.452011 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6ffcef-6cd2-4bd4-95b8-e02741ddc5ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:08:34.452314 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6ffcef-6cd2-4bd4-95b8-e02741ddc5ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:34.453711 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6ffcef-6cd2-4bd4-95b8-e02741ddc5ec None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:34.470550 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 500/1022] 10.222.0.70 () {56 vars in 1109 bytes} [Tue May 10 19:08:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:08:34.471823 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1d6e97-53df-4591-96e7-7ada6560524d None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:34.573931 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1d6e97-53df-4591-96e7-7ada6560524d None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:34.612611 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011d3437-6d60-4dda-b2b1-3254bb86092e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:34.613422 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011d3437-6d60-4dda-b2b1-3254bb86092e None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:34.613699 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011d3437-6d60-4dda-b2b1-3254bb86092e None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:34.613967 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011d3437-6d60-4dda-b2b1-3254bb86092e None admin] PATH_INFO: `/v3/users/nova` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:34.619267 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9173b8-9b64-4e85-b6ed-85ace3b3de4f None None] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:34.619621 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9173b8-9b64-4e85-b6ed-85ace3b3de4f None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:34.620013 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9173b8-9b64-4e85-b6ed-85ace3b3de4f None None] PATH_INFO: `/` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:34.621687 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 501/1023] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:08:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 19:08:34.622105 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011d3437-6d60-4dda-b2b1-3254bb86092e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:34.623537 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011d3437-6d60-4dda-b2b1-3254bb86092e None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:34.626784 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77e50be-c7c3-4440-84cf-1f7615cf55e9 None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:34.627069 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77e50be-c7c3-4440-84cf-1f7615cf55e9 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:34.627342 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77e50be-c7c3-4440-84cf-1f7615cf55e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:34.637482 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-011d3437-6d60-4dda-b2b1-3254bb86092e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 10 19:08:34.637482 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:08:34.637482 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:08:34.637482 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:08:34.637482 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:08:34.637482 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:08:34.637482 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:08:34.637482 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:08:34.637482 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:08:34.637482 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:08:34.637482 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:08:34.637482 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:08:34.637482 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 19:08:34.637482 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 19:08:34.637482 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 19:08:34.637482 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 19:08:34.638498 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:08:34.638498 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:08:34.638498 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 19:08:34.638498 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 19:08:34.638498 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 19:08:34.638498 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 19:08:34.638498 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:08:34.638498 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:08:34.638498 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:08:34.638498 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:08:34.638498 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:08:34.638498 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( May 10 19:08:34.638498 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:08:34.638498 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() May 10 19:08:34.638498 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:08:34.638498 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:08:34.638498 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:08:34.638498 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() May 10 19:08:34.639521 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:08:34.639521 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( May 10 19:08:34.639521 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 19:08:34.639521 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 19:08:34.639521 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 19:08:34.639521 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 19:08:34.639521 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 19:08:34.639521 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 19:08:34.639521 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 10 19:08:34.639521 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:08:34.639521 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 523/1024] 10.222.0.70 () {56 vars in 1093 bytes} [Tue May 10 19:08:34 2022] GET /identity/v3/users/nova => generated 82 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 19:08:34.644642 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011d3437-6d60-4dda-b2b1-3254bb86092e None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:34.646810 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-b77e50be-c7c3-4440-84cf-1f7615cf55e9 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:08:34.648091 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-b77e50be-c7c3-4440-84cf-1f7615cf55e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:08:34.713565 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 502/1025] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:08:34 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 19:08:34.736370 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77e50be-c7c3-4440-84cf-1f7615cf55e9 None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:34.741256 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011d3437-6d60-4dda-b2b1-3254bb86092e None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:34.774825 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db8ca92-fd35-4724-bfa1-ca6bcfe16c00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:34.775493 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db8ca92-fd35-4724-bfa1-ca6bcfe16c00 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:34.775774 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db8ca92-fd35-4724-bfa1-ca6bcfe16c00 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:34.776050 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db8ca92-fd35-4724-bfa1-ca6bcfe16c00 None admin] PATH_INFO: `/v3/users` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:34.776920 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db8ca92-fd35-4724-bfa1-ca6bcfe16c00 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:08:34.777230 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db8ca92-fd35-4724-bfa1-ca6bcfe16c00 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:34.778665 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db8ca92-fd35-4724-bfa1-ca6bcfe16c00 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:34.795889 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 524/1026] 10.222.0.70 () {56 vars in 1133 bytes} [Tue May 10 19:08:34 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:08:34.797328 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9823ec3a-432b-4c07-97a3-244cc6d26ee2 None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:34.798142 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9823ec3a-432b-4c07-97a3-244cc6d26ee2 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:34.798427 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9823ec3a-432b-4c07-97a3-244cc6d26ee2 None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:34.799775 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 525/1027] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:08:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:08:34.804764 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9823ec3a-432b-4c07-97a3-244cc6d26ee2 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:34.832214 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77e50be-c7c3-4440-84cf-1f7615cf55e9 None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:34.864040 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f585f767-e8c1-434c-8ec9-f40d6f695628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:34.864857 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f585f767-e8c1-434c-8ec9-f40d6f695628 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:34.865143 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f585f767-e8c1-434c-8ec9-f40d6f695628 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:34.865418 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f585f767-e8c1-434c-8ec9-f40d6f695628 None admin] PATH_INFO: `/v3/services/image` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:34.866060 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f585f767-e8c1-434c-8ec9-f40d6f695628 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:34.867430 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f585f767-e8c1-434c-8ec9-f40d6f695628 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:34.878613 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application [None req-f585f767-e8c1-434c-8ec9-f40d6f695628 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 10 19:08:34.878613 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:08:34.878613 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 19:08:34.878613 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 19:08:34.878613 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 19:08:34.878613 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 19:08:34.878613 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 19:08:34.878613 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 19:08:34.878613 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 10 19:08:34.878613 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application May 10 19:08:34.878613 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 19:08:34.878613 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application May 10 19:08:34.878613 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:08:34.878613 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:08:34.878613 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:08:34.878613 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:08:34.878613 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:08:34.879596 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:08:34.879596 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:08:34.879596 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:08:34.879596 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:08:34.879596 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:08:34.879596 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:08:34.879596 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 19:08:34.879596 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 19:08:34.879596 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 19:08:34.879596 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 19:08:34.879596 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:08:34.879596 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:08:34.879596 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:08:34.879596 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:08:34.879596 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:08:34.879596 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:08:34.880467 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:08:34.880467 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application with Lock( May 10 19:08:34.880467 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:08:34.880467 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._enter() May 10 19:08:34.880467 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:08:34.880467 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:08:34.880467 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:08:34.880467 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.creator() May 10 19:08:34.880467 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:08:34.880467 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application created_value = creator( May 10 19:08:34.880467 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 19:08:34.880467 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 19:08:34.880467 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 10 19:08:34.880467 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application May 10 19:08:34.880467 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 503/1028] 10.222.0.70 () {56 vars in 1105 bytes} [Tue May 10 19:08:34 2022] GET /identity/v3/services/image => generated 86 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 19:08:34.881312 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbff20ed-347c-4c33-8f4f-fab83885ff11 None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:34.881891 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbff20ed-347c-4c33-8f4f-fab83885ff11 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:34.881891 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbff20ed-347c-4c33-8f4f-fab83885ff11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:34.897874 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-cbff20ed-347c-4c33-8f4f-fab83885ff11 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:08:34.899046 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-cbff20ed-347c-4c33-8f4f-fab83885ff11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:08:34.899749 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9823ec3a-432b-4c07-97a3-244cc6d26ee2 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:34.931496 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaa2390-620f-406a-878d-c9d277471086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:34.932139 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaa2390-620f-406a-878d-c9d277471086 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:34.932441 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaa2390-620f-406a-878d-c9d277471086 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:34.932713 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaa2390-620f-406a-878d-c9d277471086 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:34.963037 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 504/1029] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:08:34 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 19:08:34.963880 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbff20ed-347c-4c33-8f4f-fab83885ff11 None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:34.998142 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaa2390-620f-406a-878d-c9d277471086 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:34.999588 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaa2390-620f-406a-878d-c9d277471086 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:35.055045 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbff20ed-347c-4c33-8f4f-fab83885ff11 None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:35.099169 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb2f75d-a9df-4ccb-a6b7-9ba27be78c94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:35.099756 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb2f75d-a9df-4ccb-a6b7-9ba27be78c94 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:35.100036 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb2f75d-a9df-4ccb-a6b7-9ba27be78c94 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:35.100336 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb2f75d-a9df-4ccb-a6b7-9ba27be78c94 None admin] PATH_INFO: `/v3/services` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:35.101063 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb2f75d-a9df-4ccb-a6b7-9ba27be78c94 None admin] RBAC: Adding query filter params (name=image) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:08:35.101362 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb2f75d-a9df-4ccb-a6b7-9ba27be78c94 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:35.102739 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb2f75d-a9df-4ccb-a6b7-9ba27be78c94 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:35.103818 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 526/1030] 10.222.0.70 () {58 vars in 1282 bytes} [Tue May 10 19:08:34 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 19:08:35.105436 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaa2390-620f-406a-878d-c9d277471086 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:35.112109 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 505/1031] 10.222.0.70 () {56 vars in 1108 bytes} [Tue May 10 19:08:34 2022] GET /identity/v3/services?name=image => generated 122 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:08:35.112109 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb2f75d-a9df-4ccb-a6b7-9ba27be78c94 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:35.199402 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaa2390-620f-406a-878d-c9d277471086 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:35.200110 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb2f75d-a9df-4ccb-a6b7-9ba27be78c94 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:35.231497 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6ae5d8-fc0d-4e4a-9edc-9a2ef40e5a24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:35.232287 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6ae5d8-fc0d-4e4a-9edc-9a2ef40e5a24 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:35.232605 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6ae5d8-fc0d-4e4a-9edc-9a2ef40e5a24 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:35.232881 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6ae5d8-fc0d-4e4a-9edc-9a2ef40e5a24 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:35.234022 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6ae5d8-fc0d-4e4a-9edc-9a2ef40e5a24 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:35.234634 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2f78a3-bcc5-4e10-8465-4745f8b7fdf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:35.235595 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6ae5d8-fc0d-4e4a-9edc-9a2ef40e5a24 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:35.235695 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2f78a3-bcc5-4e10-8465-4745f8b7fdf3 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:35.236081 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2f78a3-bcc5-4e10-8465-4745f8b7fdf3 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:35.236619 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2f78a3-bcc5-4e10-8465-4745f8b7fdf3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:35.237245 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 527/1032] 10.222.0.70 () {56 vars in 1108 bytes} [Tue May 10 19:08:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:08:35.237993 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6ae5d8-fc0d-4e4a-9edc-9a2ef40e5a24 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:35.251308 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2f78a3-bcc5-4e10-8465-4745f8b7fdf3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:35.252776 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2f78a3-bcc5-4e10-8465-4745f8b7fdf3 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:35.269319 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application [None req-ee2f78a3-bcc5-4e10-8465-4745f8b7fdf3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:08:35.269319 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:08:35.269319 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:08:35.269319 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:08:35.269319 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:08:35.269319 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:08:35.269319 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:08:35.269319 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:08:35.269319 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:08:35.269319 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:08:35.269319 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:08:35.269319 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:08:35.269319 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 19:08:35.269319 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 19:08:35.269319 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 19:08:35.270262 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 19:08:35.270262 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:08:35.270262 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:08:35.270262 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:08:35.270262 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:08:35.270262 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:08:35.270262 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:08:35.270262 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:08:35.270262 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application with Lock( May 10 19:08:35.270262 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:08:35.270262 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._enter() May 10 19:08:35.270262 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:08:35.270262 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:08:35.270262 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:08:35.270262 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.creator() May 10 19:08:35.270262 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:08:35.270262 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application created_value = creator( May 10 19:08:35.271189 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 19:08:35.271189 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 19:08:35.271189 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:08:35.271189 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application May 10 19:08:35.271189 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 506/1033] 10.222.0.70 () {56 vars in 1108 bytes} [Tue May 10 19:08:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:08:35.271623 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2f78a3-bcc5-4e10-8465-4745f8b7fdf3 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:35.336683 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6ae5d8-fc0d-4e4a-9edc-9a2ef40e5a24 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:35.365363 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2f78a3-bcc5-4e10-8465-4745f8b7fdf3 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:35.367854 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a977a66-0584-46b4-8de0-7706cb6b7305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:35.368533 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a977a66-0584-46b4-8de0-7706cb6b7305 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:35.368810 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a977a66-0584-46b4-8de0-7706cb6b7305 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:35.369079 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a977a66-0584-46b4-8de0-7706cb6b7305 None admin] PATH_INFO: `/v3/services` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:35.369768 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a977a66-0584-46b4-8de0-7706cb6b7305 None admin] RBAC: Adding query filter params (type=image) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:08:35.370068 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a977a66-0584-46b4-8de0-7706cb6b7305 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:35.371410 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a977a66-0584-46b4-8de0-7706cb6b7305 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:35.376017 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 528/1034] 10.222.0.70 () {56 vars in 1108 bytes} [Tue May 10 19:08:35 2022] GET /identity/v3/services?type=image => generated 350 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:08:35.376794 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a977a66-0584-46b4-8de0-7706cb6b7305 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:35.397437 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a438e5ad-b47e-463e-ad46-75e1caab8727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:35.398091 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a438e5ad-b47e-463e-ad46-75e1caab8727 None admin] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:35.398380 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a438e5ad-b47e-463e-ad46-75e1caab8727 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:35.398656 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a438e5ad-b47e-463e-ad46-75e1caab8727 None admin] PATH_INFO: `/v3/projects` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:35.399350 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a438e5ad-b47e-463e-ad46-75e1caab8727 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:35.400806 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a438e5ad-b47e-463e-ad46-75e1caab8727 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:35.425131 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 507/1035] 10.222.0.70 () {60 vars in 1141 bytes} [Tue May 10 19:08:35 2022] POST /identity/v3/projects => generated 311 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:08:35.425951 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a438e5ad-b47e-463e-ad46-75e1caab8727 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:35.475225 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a977a66-0584-46b4-8de0-7706cb6b7305 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:35.512959 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2e1cd4-2961-41a0-8b82-ae1d9b9b059b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:35.514144 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2e1cd4-2961-41a0-8b82-ae1d9b9b059b None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:35.514634 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2e1cd4-2961-41a0-8b82-ae1d9b9b059b None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:35.515123 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2e1cd4-2961-41a0-8b82-ae1d9b9b059b None admin] PATH_INFO: `/v3/domains` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:35.516110 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2e1cd4-2961-41a0-8b82-ae1d9b9b059b None admin] RBAC: Adding query filter params (name=Default) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:08:35.516684 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2e1cd4-2961-41a0-8b82-ae1d9b9b059b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:35.518359 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2e1cd4-2961-41a0-8b82-ae1d9b9b059b None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:35.530280 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a438e5ad-b47e-463e-ad46-75e1caab8727 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:35.535866 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 529/1036] 10.222.0.70 () {56 vars in 1109 bytes} [Tue May 10 19:08:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:08:35.537067 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2e1cd4-2961-41a0-8b82-ae1d9b9b059b None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:35.564708 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f932d3-75f0-46ad-bcf5-8a14632a2661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:35.565389 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f932d3-75f0-46ad-bcf5-8a14632a2661 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:35.565671 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f932d3-75f0-46ad-bcf5-8a14632a2661 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:35.565944 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f932d3-75f0-46ad-bcf5-8a14632a2661 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:35.566741 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f932d3-75f0-46ad-bcf5-8a14632a2661 None admin] RBAC: Adding query filter params (interface=public, service_id=3dd14cc3ddfd4630b2a1e719807a11e2, region_id=RegionOne) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:08:35.567047 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f932d3-75f0-46ad-bcf5-8a14632a2661 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:35.568465 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f932d3-75f0-46ad-bcf5-8a14632a2661 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:35.574175 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 508/1037] 10.222.0.70 () {56 vars in 1251 bytes} [Tue May 10 19:08:35 2022] GET /identity/v3/endpoints?service_id=3dd14cc3ddfd4630b2a1e719807a11e2&interface=public®ion_id=RegionOne => generated 194 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:08:35.580745 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f932d3-75f0-46ad-bcf5-8a14632a2661 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:35.663841 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2e1cd4-2961-41a0-8b82-ae1d9b9b059b None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:35.695052 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f932d3-75f0-46ad-bcf5-8a14632a2661 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:35.697999 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642a219c-44c1-4fc7-9baf-56d57f4f10ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:35.698800 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642a219c-44c1-4fc7-9baf-56d57f4f10ab None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:35.699077 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642a219c-44c1-4fc7-9baf-56d57f4f10ab None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:35.699344 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642a219c-44c1-4fc7-9baf-56d57f4f10ab None admin] PATH_INFO: `/v3/projects/service` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:35.706806 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642a219c-44c1-4fc7-9baf-56d57f4f10ab None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:35.708238 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642a219c-44c1-4fc7-9baf-56d57f4f10ab None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:35.722127 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-642a219c-44c1-4fc7-9baf-56d57f4f10ab None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 19:08:35.722127 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:08:35.722127 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:08:35.722127 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:08:35.722127 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:08:35.722127 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:08:35.722127 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:08:35.722127 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:08:35.722127 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:08:35.722127 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:08:35.722127 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:08:35.722127 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:08:35.722127 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 19:08:35.722127 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 19:08:35.722127 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 19:08:35.723059 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 19:08:35.723059 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:08:35.723059 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:08:35.723059 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:08:35.723059 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:08:35.723059 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:08:35.723059 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:08:35.723059 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:08:35.723059 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( May 10 19:08:35.723059 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:08:35.723059 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() May 10 19:08:35.723059 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:08:35.723059 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:08:35.723059 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:08:35.723059 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() May 10 19:08:35.723059 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:08:35.723059 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( May 10 19:08:35.729046 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 19:08:35.729046 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 19:08:35.729046 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 19:08:35.729046 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 19:08:35.729046 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 19:08:35.729046 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 19:08:35.729046 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 19:08:35.729046 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:08:35.729046 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 530/1038] 10.222.0.70 () {56 vars in 1111 bytes} [Tue May 10 19:08:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:08:35.729046 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642a219c-44c1-4fc7-9baf-56d57f4f10ab None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:35.729616 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87845afe-3f05-4c4f-8675-ae2122e7b47e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:35.729962 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87845afe-3f05-4c4f-8675-ae2122e7b47e None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:35.730122 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87845afe-3f05-4c4f-8675-ae2122e7b47e None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:35.730369 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87845afe-3f05-4c4f-8675-ae2122e7b47e None admin] PATH_INFO: `/v3/services` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:35.731034 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87845afe-3f05-4c4f-8675-ae2122e7b47e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:35.732395 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87845afe-3f05-4c4f-8675-ae2122e7b47e None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:35.739625 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 509/1039] 10.222.0.70 () {56 vars in 1087 bytes} [Tue May 10 19:08:35 2022] GET /identity/v3/services => generated 1957 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 19:08:35.834631 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642a219c-44c1-4fc7-9baf-56d57f4f10ab None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:35.869549 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730463c1-fc25-4c2b-b2d0-1e0636401b3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:35.870226 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730463c1-fc25-4c2b-b2d0-1e0636401b3e None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:35.870505 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730463c1-fc25-4c2b-b2d0-1e0636401b3e None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:35.870776 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730463c1-fc25-4c2b-b2d0-1e0636401b3e None admin] PATH_INFO: `/v3/projects` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:35.871561 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730463c1-fc25-4c2b-b2d0-1e0636401b3e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:08:35.871864 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730463c1-fc25-4c2b-b2d0-1e0636401b3e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:35.873358 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730463c1-fc25-4c2b-b2d0-1e0636401b3e None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:35.890680 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 531/1040] 10.222.0.70 () {56 vars in 1148 bytes} [Tue May 10 19:08:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:08:35.892435 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87845afe-3f05-4c4f-8675-ae2122e7b47e None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:35.993681 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87845afe-3f05-4c4f-8675-ae2122e7b47e None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:36.026264 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0de8d33-2457-4434-b25f-ce6a040015df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:36.026919 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0de8d33-2457-4434-b25f-ce6a040015df None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:36.027202 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0de8d33-2457-4434-b25f-ce6a040015df None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:36.027478 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0de8d33-2457-4434-b25f-ce6a040015df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:36.028298 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0de8d33-2457-4434-b25f-ce6a040015df None admin] RBAC: Adding query filter params (role.id=128f76acc6c8422797401b4d627ca236, scope.project.id=2ee9ec5b515440fe9b39aedf3e339c79, user.id=b9f310a468ec4058b3c95356ea60ab4c) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:08:36.028639 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0de8d33-2457-4434-b25f-ce6a040015df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:36.030079 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0de8d33-2457-4434-b25f-ce6a040015df None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:36.040443 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 510/1041] 10.222.0.70 () {56 vars in 1374 bytes} [Tue May 10 19:08:35 2022] GET /identity/v3/role_assignments?user.id=b9f310a468ec4058b3c95356ea60ab4c&scope.project.id=2ee9ec5b515440fe9b39aedf3e339c79&role.id=128f76acc6c8422797401b4d627ca236 => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:08:37.729165 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ca0b62-11ef-4333-a39d-a5b5123b463c None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:37.729712 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ca0b62-11ef-4333-a39d-a5b5123b463c None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:37.729712 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ca0b62-11ef-4333-a39d-a5b5123b463c None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:37.731218 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 532/1042] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:08:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:08:37.736787 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeed73b5-85f4-4d4d-89cc-694ed7f093b0 None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:37.737174 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeed73b5-85f4-4d4d-89cc-694ed7f093b0 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:37.737345 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeed73b5-85f4-4d4d-89cc-694ed7f093b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:37.754222 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-aeed73b5-85f4-4d4d-89cc-694ed7f093b0 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:08:37.755461 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-aeed73b5-85f4-4d4d-89cc-694ed7f093b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:08:37.823451 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 511/1043] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:08:37 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 19:08:37.848563 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ca0b62-11ef-4333-a39d-a5b5123b463c None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:37.947918 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ca0b62-11ef-4333-a39d-a5b5123b463c None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:37.949340 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9a0fee-9c97-4579-baaf-34d7a43ab101 None None] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:37.949631 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9a0fee-9c97-4579-baaf-34d7a43ab101 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:37.949908 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9a0fee-9c97-4579-baaf-34d7a43ab101 None None] PATH_INFO: `/` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:37.951406 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 512/1044] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:08:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:08:37.957426 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab61e32-c9d5-4b23-8591-4451106aadaf None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:37.957709 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab61e32-c9d5-4b23-8591-4451106aadaf None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:37.957981 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab61e32-c9d5-4b23-8591-4451106aadaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:37.973924 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-3ab61e32-c9d5-4b23-8591-4451106aadaf None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:08:37.975088 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-3ab61e32-c9d5-4b23-8591-4451106aadaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:08:37.984519 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228a00fb-8013-4d22-8ec6-64c7a04e3859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:37.985268 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228a00fb-8013-4d22-8ec6-64c7a04e3859 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:37.985548 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228a00fb-8013-4d22-8ec6-64c7a04e3859 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:37.985825 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228a00fb-8013-4d22-8ec6-64c7a04e3859 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:37.986986 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228a00fb-8013-4d22-8ec6-64c7a04e3859 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:37.988405 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228a00fb-8013-4d22-8ec6-64c7a04e3859 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:37.990180 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 533/1045] 10.222.0.70 () {56 vars in 1108 bytes} [Tue May 10 19:08:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:08:37.995558 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228a00fb-8013-4d22-8ec6-64c7a04e3859 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:38.043237 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 513/1046] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:08:37 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 19:08:38.066194 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab61e32-c9d5-4b23-8591-4451106aadaf None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:38.096552 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228a00fb-8013-4d22-8ec6-64c7a04e3859 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:38.128829 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13969510-c831-48f3-8f57-612c4c1758fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:38.129501 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13969510-c831-48f3-8f57-612c4c1758fd None admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:38.129780 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13969510-c831-48f3-8f57-612c4c1758fd None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:38.130166 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13969510-c831-48f3-8f57-612c4c1758fd None admin] PATH_INFO: `/v3/users` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:38.130784 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13969510-c831-48f3-8f57-612c4c1758fd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:38.132178 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13969510-c831-48f3-8f57-612c4c1758fd None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:38.153267 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 534/1047] 10.222.0.70 () {60 vars in 1132 bytes} [Tue May 10 19:08:37 2022] POST /identity/v3/users => generated 285 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 19:08:38.164130 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab61e32-c9d5-4b23-8591-4451106aadaf None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:38.202297 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155d238e-3293-4092-b353-48a727d07a67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:38.203106 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155d238e-3293-4092-b353-48a727d07a67 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:38.203391 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155d238e-3293-4092-b353-48a727d07a67 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:38.204234 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155d238e-3293-4092-b353-48a727d07a67 None admin] PATH_INFO: `/v3/services/image` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:38.204932 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155d238e-3293-4092-b353-48a727d07a67 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:38.206589 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155d238e-3293-4092-b353-48a727d07a67 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:38.218703 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application [None req-155d238e-3293-4092-b353-48a727d07a67 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 10 19:08:38.218703 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:08:38.218703 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 19:08:38.218703 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 19:08:38.218703 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 19:08:38.218703 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 19:08:38.218703 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 19:08:38.218703 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 19:08:38.218703 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 10 19:08:38.218703 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application May 10 19:08:38.218703 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 19:08:38.218703 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application May 10 19:08:38.218703 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:08:38.218703 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:08:38.218703 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:08:38.218703 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:08:38.218703 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:08:38.219892 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:08:38.219892 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:08:38.219892 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:08:38.219892 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:08:38.219892 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:08:38.219892 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:08:38.219892 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 19:08:38.219892 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 19:08:38.219892 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 19:08:38.219892 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 19:08:38.219892 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:08:38.219892 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:08:38.219892 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:08:38.219892 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:08:38.219892 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:08:38.219892 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:08:38.226066 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:08:38.226066 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application with Lock( May 10 19:08:38.226066 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:08:38.226066 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._enter() May 10 19:08:38.226066 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:08:38.226066 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:08:38.226066 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:08:38.226066 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.creator() May 10 19:08:38.226066 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:08:38.226066 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application created_value = creator( May 10 19:08:38.226066 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 19:08:38.226066 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 19:08:38.226066 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 10 19:08:38.226066 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application May 10 19:08:38.226066 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 514/1048] 10.222.0.70 () {56 vars in 1105 bytes} [Tue May 10 19:08:38 2022] GET /identity/v3/services/image => generated 86 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 19:08:38.227602 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13969510-c831-48f3-8f57-612c4c1758fd None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:38.236565 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c6b35c-b49c-40ab-91b0-67c4fa07778e None None] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:38.236565 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c6b35c-b49c-40ab-91b0-67c4fa07778e None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:38.237043 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c6b35c-b49c-40ab-91b0-67c4fa07778e None None] PATH_INFO: `/` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:38.238225 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 515/1049] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:08:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 19:08:38.243802 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236af8f1-f8af-4bce-abb8-279ce5f6e791 None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:38.244111 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236af8f1-f8af-4bce-abb8-279ce5f6e791 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:38.244351 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236af8f1-f8af-4bce-abb8-279ce5f6e791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:38.262819 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-236af8f1-f8af-4bce-abb8-279ce5f6e791 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:08:38.264024 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-236af8f1-f8af-4bce-abb8-279ce5f6e791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:08:38.329994 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13969510-c831-48f3-8f57-612c4c1758fd None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:38.332462 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 516/1050] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:08:38 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 19:08:38.355315 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236af8f1-f8af-4bce-abb8-279ce5f6e791 None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:38.365568 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f7828d-0fa9-4119-bd66-551a66bed511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:38.366247 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f7828d-0fa9-4119-bd66-551a66bed511 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:38.366525 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f7828d-0fa9-4119-bd66-551a66bed511 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:38.366800 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f7828d-0fa9-4119-bd66-551a66bed511 None admin] PATH_INFO: `/v3/services` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:38.367508 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f7828d-0fa9-4119-bd66-551a66bed511 None admin] RBAC: Adding query filter params (name=image) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:08:38.367814 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f7828d-0fa9-4119-bd66-551a66bed511 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:38.369227 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f7828d-0fa9-4119-bd66-551a66bed511 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:38.374233 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 535/1051] 10.222.0.70 () {56 vars in 1108 bytes} [Tue May 10 19:08:38 2022] GET /identity/v3/services?name=image => generated 122 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:08:38.380758 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f7828d-0fa9-4119-bd66-551a66bed511 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:38.454947 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236af8f1-f8af-4bce-abb8-279ce5f6e791 None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:38.480110 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f7828d-0fa9-4119-bd66-551a66bed511 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:38.488679 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4efc155-9210-4164-a830-18d1aafb8bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:38.489433 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4efc155-9210-4164-a830-18d1aafb8bcb None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:38.489717 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4efc155-9210-4164-a830-18d1aafb8bcb None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:38.489991 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4efc155-9210-4164-a830-18d1aafb8bcb None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:38.499951 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4efc155-9210-4164-a830-18d1aafb8bcb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:08:38.508229 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application [None req-f4efc155-9210-4164-a830-18d1aafb8bcb None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 10 19:08:38.508229 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:08:38.508229 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:08:38.508229 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:08:38.508229 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:08:38.508229 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:08:38.508229 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:08:38.508229 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:08:38.508229 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:08:38.508229 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:08:38.508229 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:08:38.508229 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:08:38.508229 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:08:38.508229 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:08:38.508229 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:08:38.508229 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:08:38.509255 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:08:38.509255 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:08:38.509255 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:08:38.509255 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:08:38.509255 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:08:38.509255 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:08:38.509255 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:08:38.509255 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:08:38.509255 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:08:38.509255 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:08:38.509255 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:08:38.509255 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application with Lock( May 10 19:08:38.509255 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:08:38.509255 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._enter() May 10 19:08:38.509255 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:08:38.509255 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:08:38.510126 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:08:38.510126 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.creator() May 10 19:08:38.510126 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:08:38.510126 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application created_value = creator( May 10 19:08:38.510126 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:08:38.510126 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:08:38.510126 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:08:38.510126 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:08:38.510126 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:08:38.510126 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:08:38.510126 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 10 19:08:38.510126 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application May 10 19:08:38.510126 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 517/1052] 10.222.0.70 () {56 vars in 1120 bytes} [Tue May 10 19:08:38 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 19:08:38.515188 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4efc155-9210-4164-a830-18d1aafb8bcb None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:38.515735 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685ed9df-a4e0-4cc3-9ab5-5dd4f5832b30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:38.516938 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685ed9df-a4e0-4cc3-9ab5-5dd4f5832b30 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:38.517218 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685ed9df-a4e0-4cc3-9ab5-5dd4f5832b30 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:38.517488 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685ed9df-a4e0-4cc3-9ab5-5dd4f5832b30 None admin] PATH_INFO: `/v3/services` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:38.518196 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685ed9df-a4e0-4cc3-9ab5-5dd4f5832b30 None admin] RBAC: Adding query filter params (type=image) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:08:38.518499 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685ed9df-a4e0-4cc3-9ab5-5dd4f5832b30 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:38.519897 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685ed9df-a4e0-4cc3-9ab5-5dd4f5832b30 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:38.524778 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 536/1053] 10.222.0.70 () {56 vars in 1108 bytes} [Tue May 10 19:08:38 2022] GET /identity/v3/services?type=image => generated 350 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:08:38.531401 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685ed9df-a4e0-4cc3-9ab5-5dd4f5832b30 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:38.616704 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4efc155-9210-4164-a830-18d1aafb8bcb None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:38.633358 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685ed9df-a4e0-4cc3-9ab5-5dd4f5832b30 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:38.649170 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d3a013-bd34-4bf2-9834-9dcc36a658e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:38.649865 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d3a013-bd34-4bf2-9834-9dcc36a658e1 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:38.650144 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d3a013-bd34-4bf2-9834-9dcc36a658e1 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:38.650420 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d3a013-bd34-4bf2-9834-9dcc36a658e1 None admin] PATH_INFO: `/v3/roles` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:38.651160 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d3a013-bd34-4bf2-9834-9dcc36a658e1 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:08:38.651466 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d3a013-bd34-4bf2-9834-9dcc36a658e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:38.652868 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d3a013-bd34-4bf2-9834-9dcc36a658e1 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:38.661629 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 518/1054] 10.222.0.70 () {56 vars in 1115 bytes} [Tue May 10 19:08:38 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:08:38.666998 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228bf6b9-b122-4a03-8c1d-ceb8fad9db76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:38.667139 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d3a013-bd34-4bf2-9834-9dcc36a658e1 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:38.667661 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228bf6b9-b122-4a03-8c1d-ceb8fad9db76 None admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:38.667944 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228bf6b9-b122-4a03-8c1d-ceb8fad9db76 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:38.668220 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228bf6b9-b122-4a03-8c1d-ceb8fad9db76 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:38.668985 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228bf6b9-b122-4a03-8c1d-ceb8fad9db76 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:38.670353 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228bf6b9-b122-4a03-8c1d-ceb8fad9db76 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:38.696615 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 537/1055] 10.222.0.70 () {60 vars in 1144 bytes} [Tue May 10 19:08:38 2022] POST /identity/v3/endpoints => generated 327 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:08:38.776192 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d3a013-bd34-4bf2-9834-9dcc36a658e1 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:38.818418 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7758e11-571d-40a0-982a-3cd808bd8743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:38.819234 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7758e11-571d-40a0-982a-3cd808bd8743 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:38.819521 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7758e11-571d-40a0-982a-3cd808bd8743 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:38.819797 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7758e11-571d-40a0-982a-3cd808bd8743 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:38.832471 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7758e11-571d-40a0-982a-3cd808bd8743 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:38.833954 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7758e11-571d-40a0-982a-3cd808bd8743 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:38.851606 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application [None req-b7758e11-571d-40a0-982a-3cd808bd8743 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:08:38.851606 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:08:38.851606 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:08:38.851606 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:08:38.851606 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:08:38.851606 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:08:38.851606 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:08:38.851606 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:08:38.851606 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:08:38.851606 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:08:38.851606 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:08:38.851606 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:08:38.851606 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 19:08:38.851606 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 19:08:38.851606 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 19:08:38.852889 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 19:08:38.852889 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:08:38.852889 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:08:38.852889 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:08:38.852889 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:08:38.852889 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:08:38.852889 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:08:38.852889 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:08:38.852889 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application with Lock( May 10 19:08:38.852889 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:08:38.852889 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._enter() May 10 19:08:38.852889 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:08:38.852889 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:08:38.852889 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:08:38.852889 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.creator() May 10 19:08:38.852889 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:08:38.852889 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application created_value = creator( May 10 19:08:38.853879 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 19:08:38.853879 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 19:08:38.853879 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:08:38.853879 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application May 10 19:08:38.856788 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 519/1056] 10.222.0.70 () {56 vars in 1108 bytes} [Tue May 10 19:08:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 19:08:38.858650 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228bf6b9-b122-4a03-8c1d-ceb8fad9db76 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:38.958657 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228bf6b9-b122-4a03-8c1d-ceb8fad9db76 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:38.991639 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6188da3-8ea3-4770-a465-9d4d30867fd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:38.992307 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6188da3-8ea3-4770-a465-9d4d30867fd7 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:38.992619 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6188da3-8ea3-4770-a465-9d4d30867fd7 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:38.992896 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6188da3-8ea3-4770-a465-9d4d30867fd7 None admin] PATH_INFO: `/v3/domains` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:38.993618 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6188da3-8ea3-4770-a465-9d4d30867fd7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:08:38.993925 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6188da3-8ea3-4770-a465-9d4d30867fd7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:38.995289 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6188da3-8ea3-4770-a465-9d4d30867fd7 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:39.011276 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 538/1057] 10.222.0.70 () {56 vars in 1109 bytes} [Tue May 10 19:08:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:08:39.013005 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7758e11-571d-40a0-982a-3cd808bd8743 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:39.114244 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7758e11-571d-40a0-982a-3cd808bd8743 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:39.146442 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3c6e73-4399-4ede-8a6c-5986fc787724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:39.147236 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3c6e73-4399-4ede-8a6c-5986fc787724 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:39.147524 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3c6e73-4399-4ede-8a6c-5986fc787724 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:39.147802 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3c6e73-4399-4ede-8a6c-5986fc787724 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:39.154947 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3c6e73-4399-4ede-8a6c-5986fc787724 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:39.156385 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3c6e73-4399-4ede-8a6c-5986fc787724 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:39.170059 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application [None req-3f3c6e73-4399-4ede-8a6c-5986fc787724 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 10 19:08:39.170059 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:08:39.170059 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:08:39.170059 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:08:39.170059 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:08:39.170059 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:08:39.170059 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:08:39.170059 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:08:39.170059 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:08:39.170059 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:08:39.170059 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:08:39.170059 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:08:39.170059 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 19:08:39.170059 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 19:08:39.170059 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 19:08:39.170059 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 19:08:39.171084 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:08:39.171084 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:08:39.171084 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 19:08:39.171084 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 19:08:39.171084 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 19:08:39.171084 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 19:08:39.171084 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:08:39.171084 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:08:39.171084 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:08:39.171084 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:08:39.171084 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:08:39.171084 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application with Lock( May 10 19:08:39.171084 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:08:39.171084 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._enter() May 10 19:08:39.171084 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:08:39.171084 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:08:39.171084 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:08:39.171084 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.creator() May 10 19:08:39.177379 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:08:39.177379 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application created_value = creator( May 10 19:08:39.177379 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 19:08:39.177379 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 19:08:39.177379 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 19:08:39.177379 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 19:08:39.177379 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 19:08:39.177379 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 19:08:39.177379 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 10 19:08:39.177379 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application May 10 19:08:39.177379 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 520/1058] 10.222.0.70 () {56 vars in 1093 bytes} [Tue May 10 19:08:39 2022] GET /identity/v3/users/nova => generated 82 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 19:08:39.179545 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6188da3-8ea3-4770-a465-9d4d30867fd7 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:39.276386 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6188da3-8ea3-4770-a465-9d4d30867fd7 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:39.310349 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081c3010-e65f-422e-a38c-b812cd39c206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:39.311021 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081c3010-e65f-422e-a38c-b812cd39c206 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:39.311303 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081c3010-e65f-422e-a38c-b812cd39c206 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:39.311578 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081c3010-e65f-422e-a38c-b812cd39c206 None admin] PATH_INFO: `/v3/users` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:39.312402 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081c3010-e65f-422e-a38c-b812cd39c206 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:08:39.312736 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081c3010-e65f-422e-a38c-b812cd39c206 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:39.314727 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081c3010-e65f-422e-a38c-b812cd39c206 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:39.337752 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 539/1059] 10.222.0.70 () {56 vars in 1133 bytes} [Tue May 10 19:08:39 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:08:39.339570 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3c6e73-4399-4ede-8a6c-5986fc787724 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:39.437381 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3c6e73-4399-4ede-8a6c-5986fc787724 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:39.470637 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9898a76-c4f2-407f-b1b3-f8e8a05846ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:39.471441 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9898a76-c4f2-407f-b1b3-f8e8a05846ec None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:39.471725 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9898a76-c4f2-407f-b1b3-f8e8a05846ec None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:39.472001 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9898a76-c4f2-407f-b1b3-f8e8a05846ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:39.482356 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9898a76-c4f2-407f-b1b3-f8e8a05846ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:39.483810 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9898a76-c4f2-407f-b1b3-f8e8a05846ec None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:39.500078 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application [None req-b9898a76-c4f2-407f-b1b3-f8e8a05846ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:08:39.500078 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:08:39.500078 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:08:39.500078 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:08:39.500078 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:08:39.500078 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:08:39.500078 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:08:39.500078 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:08:39.500078 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:08:39.500078 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:08:39.500078 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:08:39.500078 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:08:39.500078 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 19:08:39.500078 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 19:08:39.500078 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 19:08:39.501740 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 19:08:39.501740 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:08:39.501740 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:08:39.501740 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:08:39.501740 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:08:39.501740 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:08:39.501740 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:08:39.501740 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:08:39.501740 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application with Lock( May 10 19:08:39.501740 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:08:39.501740 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._enter() May 10 19:08:39.501740 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:08:39.501740 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:08:39.501740 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:08:39.501740 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.creator() May 10 19:08:39.501740 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:08:39.501740 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application created_value = creator( May 10 19:08:39.502708 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 19:08:39.502708 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 19:08:39.502708 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:08:39.502708 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application May 10 19:08:39.504725 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 521/1060] 10.222.0.70 () {56 vars in 1108 bytes} [Tue May 10 19:08:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 19:08:39.507806 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081c3010-e65f-422e-a38c-b812cd39c206 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:39.603886 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081c3010-e65f-422e-a38c-b812cd39c206 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:39.636055 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0e54c1-48a0-43b3-a424-d78937611433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:39.636873 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0e54c1-48a0-43b3-a424-d78937611433 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:39.637157 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0e54c1-48a0-43b3-a424-d78937611433 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:39.637428 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0e54c1-48a0-43b3-a424-d78937611433 None admin] PATH_INFO: `/v3/domains` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:39.638202 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0e54c1-48a0-43b3-a424-d78937611433 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:08:39.638449 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0e54c1-48a0-43b3-a424-d78937611433 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:39.639806 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0e54c1-48a0-43b3-a424-d78937611433 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:39.650727 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 540/1061] 10.222.0.70 () {56 vars in 1109 bytes} [Tue May 10 19:08:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:08:39.656475 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9898a76-c4f2-407f-b1b3-f8e8a05846ec None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:39.750181 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9898a76-c4f2-407f-b1b3-f8e8a05846ec None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:39.783071 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c9d366-7082-4c5a-8127-dcbe474ab1f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:39.783871 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c9d366-7082-4c5a-8127-dcbe474ab1f1 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:39.784152 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c9d366-7082-4c5a-8127-dcbe474ab1f1 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:39.784448 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c9d366-7082-4c5a-8127-dcbe474ab1f1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:39.790976 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c9d366-7082-4c5a-8127-dcbe474ab1f1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:39.792498 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c9d366-7082-4c5a-8127-dcbe474ab1f1 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:39.806309 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application [None req-f1c9d366-7082-4c5a-8127-dcbe474ab1f1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 19:08:39.806309 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:08:39.806309 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:08:39.806309 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:08:39.806309 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:08:39.806309 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:08:39.806309 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:08:39.806309 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:08:39.806309 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:08:39.806309 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:08:39.806309 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:08:39.806309 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:08:39.806309 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 19:08:39.806309 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 19:08:39.806309 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 19:08:39.807212 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 19:08:39.807212 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:08:39.807212 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:08:39.807212 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:08:39.807212 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:08:39.807212 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:08:39.807212 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:08:39.807212 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:08:39.807212 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application with Lock( May 10 19:08:39.807212 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:08:39.807212 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._enter() May 10 19:08:39.807212 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:08:39.807212 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:08:39.807212 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:08:39.807212 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.creator() May 10 19:08:39.807212 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:08:39.807212 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application created_value = creator( May 10 19:08:39.808154 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 19:08:39.808154 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 19:08:39.808154 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 19:08:39.808154 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 19:08:39.808154 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 19:08:39.808154 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 19:08:39.808154 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 19:08:39.808154 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application May 10 19:08:39.812177 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 522/1062] 10.222.0.70 () {56 vars in 1111 bytes} [Tue May 10 19:08:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:08:39.813453 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0e54c1-48a0-43b3-a424-d78937611433 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:39.913200 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0e54c1-48a0-43b3-a424-d78937611433 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:39.949227 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefab483-053e-4a7f-b478-473ab5ce732d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:39.949610 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefab483-053e-4a7f-b478-473ab5ce732d None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:39.949782 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefab483-053e-4a7f-b478-473ab5ce732d None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:39.950698 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefab483-053e-4a7f-b478-473ab5ce732d None admin] PATH_INFO: `/v3/projects` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:39.950868 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefab483-053e-4a7f-b478-473ab5ce732d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:08:39.952255 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefab483-053e-4a7f-b478-473ab5ce732d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:39.954718 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefab483-053e-4a7f-b478-473ab5ce732d None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:39.965889 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 541/1063] 10.222.0.70 () {56 vars in 1148 bytes} [Tue May 10 19:08:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:08:39.972043 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c9d366-7082-4c5a-8127-dcbe474ab1f1 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:40.068655 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c9d366-7082-4c5a-8127-dcbe474ab1f1 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:40.101582 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba65cc7-1e6b-45a5-8734-f232ba4bd928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:40.102468 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba65cc7-1e6b-45a5-8734-f232ba4bd928 None admin] REQUEST_METHOD: `PUT` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:40.102749 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba65cc7-1e6b-45a5-8734-f232ba4bd928 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:40.103019 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba65cc7-1e6b-45a5-8734-f232ba4bd928 None admin] PATH_INFO: `/v3/projects/2ee9ec5b515440fe9b39aedf3e339c79/users/b9f310a468ec4058b3c95356ea60ab4c/roles/128f76acc6c8422797401b4d627ca236` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:40.105217 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba65cc7-1e6b-45a5-8734-f232ba4bd928 None admin] RBAC: Authorizing `identity:create_grant(project_id=2ee9ec5b515440fe9b39aedf3e339c79, user_id=b9f310a468ec4058b3c95356ea60ab4c, role_id=128f76acc6c8422797401b4d627ca236)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:40.106642 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba65cc7-1e6b-45a5-8734-f232ba4bd928 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:40.126851 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 523/1064] 10.222.0.70 () {58 vars in 1439 bytes} [Tue May 10 19:08:39 2022] PUT /identity/v3/projects/2ee9ec5b515440fe9b39aedf3e339c79/users/b9f310a468ec4058b3c95356ea60ab4c/roles/128f76acc6c8422797401b4d627ca236 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:08:40.443614 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a367c7-46e8-4f3c-8d4c-d91242ca79a9 None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:40.443920 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a367c7-46e8-4f3c-8d4c-d91242ca79a9 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:40.444173 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a367c7-46e8-4f3c-8d4c-d91242ca79a9 None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:40.445822 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 542/1065] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:08:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:08:40.451007 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dd4870-6d10-4a68-96c8-010f80e1cee4 None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:40.451304 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dd4870-6d10-4a68-96c8-010f80e1cee4 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:40.451604 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dd4870-6d10-4a68-96c8-010f80e1cee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:40.469033 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-43dd4870-6d10-4a68-96c8-010f80e1cee4 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:08:40.470212 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-43dd4870-6d10-4a68-96c8-010f80e1cee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:08:40.534839 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 524/1066] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:08:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 19:08:40.557940 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a367c7-46e8-4f3c-8d4c-d91242ca79a9 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:40.659915 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a367c7-46e8-4f3c-8d4c-d91242ca79a9 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:40.692975 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ea2415-aedd-4508-9b0a-59030acd901a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:40.694204 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ea2415-aedd-4508-9b0a-59030acd901a None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:40.694689 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ea2415-aedd-4508-9b0a-59030acd901a None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:40.695161 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ea2415-aedd-4508-9b0a-59030acd901a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:40.705718 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ea2415-aedd-4508-9b0a-59030acd901a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:08:40.713847 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-52ea2415-aedd-4508-9b0a-59030acd901a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 19:08:40.713847 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:08:40.713847 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:08:40.713847 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:08:40.713847 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:08:40.713847 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:08:40.713847 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:08:40.713847 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:08:40.713847 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:08:40.713847 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:08:40.713847 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:08:40.713847 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:08:40.713847 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:08:40.713847 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:08:40.713847 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:08:40.713847 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:08:40.714782 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:08:40.714782 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:08:40.714782 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:08:40.714782 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:08:40.714782 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:08:40.714782 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:08:40.714782 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:08:40.714782 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:08:40.714782 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:08:40.714782 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:08:40.714782 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:08:40.714782 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( May 10 19:08:40.714782 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:08:40.714782 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() May 10 19:08:40.714782 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:08:40.714782 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:08:40.715664 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:08:40.715664 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() May 10 19:08:40.715664 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:08:40.715664 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( May 10 19:08:40.715664 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:08:40.715664 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:08:40.715664 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:08:40.715664 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:08:40.715664 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:08:40.715664 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:08:40.715664 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 19:08:40.715664 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:08:40.717035 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 543/1067] 10.222.0.70 () {56 vars in 1096 bytes} [Tue May 10 19:08:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:08:40.722812 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dd4870-6d10-4a68-96c8-010f80e1cee4 None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:40.822410 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dd4870-6d10-4a68-96c8-010f80e1cee4 None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:40.854762 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b322b3ba-0be9-4f38-9aaa-bcfabe45b93e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:40.855850 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b322b3ba-0be9-4f38-9aaa-bcfabe45b93e None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:40.856336 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b322b3ba-0be9-4f38-9aaa-bcfabe45b93e None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:40.856902 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b322b3ba-0be9-4f38-9aaa-bcfabe45b93e None admin] PATH_INFO: `/v3/roles` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:40.857907 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b322b3ba-0be9-4f38-9aaa-bcfabe45b93e None admin] RBAC: Adding query filter params (name=admin) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:08:40.858428 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b322b3ba-0be9-4f38-9aaa-bcfabe45b93e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:40.860624 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b322b3ba-0be9-4f38-9aaa-bcfabe45b93e None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:40.869465 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 525/1068] 10.222.0.70 () {56 vars in 1099 bytes} [Tue May 10 19:08:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:08:40.874863 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ea2415-aedd-4508-9b0a-59030acd901a None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:40.967309 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6f0fe1-978e-4f58-bc2c-a588ea3aafc1 None None] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:40.967616 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6f0fe1-978e-4f58-bc2c-a588ea3aafc1 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:40.967880 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6f0fe1-978e-4f58-bc2c-a588ea3aafc1 None None] PATH_INFO: `/` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:40.969294 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 526/1069] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:08:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 19:08:40.974229 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491258ad-eb90-47c5-8353-fbb1a84531ad None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:40.974526 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491258ad-eb90-47c5-8353-fbb1a84531ad None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:40.974805 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491258ad-eb90-47c5-8353-fbb1a84531ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:40.975285 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ea2415-aedd-4508-9b0a-59030acd901a None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:40.991595 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-491258ad-eb90-47c5-8353-fbb1a84531ad None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:08:40.992796 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-491258ad-eb90-47c5-8353-fbb1a84531ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:08:41.007196 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7df5d5-4353-4f7a-acdf-188b01bc3b55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:41.008124 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7df5d5-4353-4f7a-acdf-188b01bc3b55 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:41.008473 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7df5d5-4353-4f7a-acdf-188b01bc3b55 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:41.008749 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7df5d5-4353-4f7a-acdf-188b01bc3b55 None admin] PATH_INFO: `/v3/users/e749cfb99e9c4472a3096c9949795bda` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:41.022493 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7df5d5-4353-4f7a-acdf-188b01bc3b55 None admin] RBAC: Authorizing `identity:get_user(user_id=e749cfb99e9c4472a3096c9949795bda)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:41.023950 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7df5d5-4353-4f7a-acdf-188b01bc3b55 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:41.030322 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 544/1070] 10.222.0.70 () {56 vars in 1177 bytes} [Tue May 10 19:08:40 2022] GET /identity/v3/users/e749cfb99e9c4472a3096c9949795bda => generated 285 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:08:41.031729 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7df5d5-4353-4f7a-acdf-188b01bc3b55 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:41.057370 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 527/1071] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:08:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 19:08:41.079586 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491258ad-eb90-47c5-8353-fbb1a84531ad None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:41.134484 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7df5d5-4353-4f7a-acdf-188b01bc3b55 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:41.167253 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d8ac9b-77f8-4c4f-978a-4c14574239a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:41.167910 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d8ac9b-77f8-4c4f-978a-4c14574239a5 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:41.168189 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d8ac9b-77f8-4c4f-978a-4c14574239a5 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:41.168488 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d8ac9b-77f8-4c4f-978a-4c14574239a5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:41.186161 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491258ad-eb90-47c5-8353-fbb1a84531ad None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:41.220355 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30c2317-6599-469b-bd02-1d5f9893fa3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:41.220965 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30c2317-6599-469b-bd02-1d5f9893fa3a None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:41.221251 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30c2317-6599-469b-bd02-1d5f9893fa3a None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:41.221541 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30c2317-6599-469b-bd02-1d5f9893fa3a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:41.249183 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d8ac9b-77f8-4c4f-978a-4c14574239a5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:41.251714 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d8ac9b-77f8-4c4f-978a-4c14574239a5 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:41.288404 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30c2317-6599-469b-bd02-1d5f9893fa3a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:41.289889 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30c2317-6599-469b-bd02-1d5f9893fa3a None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:41.366498 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 545/1072] 10.222.0.70 () {58 vars in 1282 bytes} [Tue May 10 19:08:41 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 10 19:08:41.372405 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d8ac9b-77f8-4c4f-978a-4c14574239a5 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:41.386672 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 528/1073] 10.222.0.70 () {58 vars in 1282 bytes} [Tue May 10 19:08:41 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 10 19:08:41.393075 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30c2317-6599-469b-bd02-1d5f9893fa3a None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:41.473733 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d8ac9b-77f8-4c4f-978a-4c14574239a5 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:41.485830 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30c2317-6599-469b-bd02-1d5f9893fa3a None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:41.506783 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc62a3a-0f35-4133-966d-65bb8efb31e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:41.507637 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc62a3a-0f35-4133-966d-65bb8efb31e0 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:41.507913 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc62a3a-0f35-4133-966d-65bb8efb31e0 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:41.508184 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc62a3a-0f35-4133-966d-65bb8efb31e0 None admin] PATH_INFO: `/v3/projects/433f3f171b9249e8974c6f7627398aea` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:41.509374 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc62a3a-0f35-4133-966d-65bb8efb31e0 None admin] RBAC: Authorizing `identity:get_project(project_id=433f3f171b9249e8974c6f7627398aea)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:41.510794 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc62a3a-0f35-4133-966d-65bb8efb31e0 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:41.517880 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 546/1074] 10.222.0.70 () {56 vars in 1186 bytes} [Tue May 10 19:08:41 2022] GET /identity/v3/projects/433f3f171b9249e8974c6f7627398aea => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:08:41.518932 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc62a3a-0f35-4133-966d-65bb8efb31e0 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:41.519337 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a352efd-a409-4696-9812-baa74a60e6e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:41.520247 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a352efd-a409-4696-9812-baa74a60e6e4 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:41.520565 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a352efd-a409-4696-9812-baa74a60e6e4 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:41.520844 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a352efd-a409-4696-9812-baa74a60e6e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:41.530744 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a352efd-a409-4696-9812-baa74a60e6e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:41.532761 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a352efd-a409-4696-9812-baa74a60e6e4 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:41.549891 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application [None req-2a352efd-a409-4696-9812-baa74a60e6e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:08:41.549891 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:08:41.549891 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:08:41.549891 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:08:41.549891 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:08:41.549891 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:08:41.549891 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:08:41.549891 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:08:41.549891 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:08:41.549891 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:08:41.549891 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:08:41.549891 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:08:41.549891 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 19:08:41.549891 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 19:08:41.549891 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 19:08:41.550820 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 19:08:41.550820 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:08:41.550820 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:08:41.550820 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:08:41.550820 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:08:41.550820 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:08:41.550820 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:08:41.550820 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:08:41.550820 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application with Lock( May 10 19:08:41.550820 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:08:41.550820 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._enter() May 10 19:08:41.550820 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:08:41.550820 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:08:41.550820 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:08:41.550820 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.creator() May 10 19:08:41.550820 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:08:41.550820 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application created_value = creator( May 10 19:08:41.551889 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 19:08:41.551889 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 19:08:41.551889 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:08:41.551889 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application May 10 19:08:41.551889 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 529/1075] 10.222.0.70 () {56 vars in 1108 bytes} [Tue May 10 19:08:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 19:08:41.556753 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a352efd-a409-4696-9812-baa74a60e6e4 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:41.619255 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc62a3a-0f35-4133-966d-65bb8efb31e0 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:41.653497 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a352efd-a409-4696-9812-baa74a60e6e4 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:41.654180 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2648a0-c1b4-4de5-b87b-f608f5a2b3b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:41.654845 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2648a0-c1b4-4de5-b87b-f608f5a2b3b4 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:41.655124 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2648a0-c1b4-4de5-b87b-f608f5a2b3b4 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:41.655396 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2648a0-c1b4-4de5-b87b-f608f5a2b3b4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:41.656220 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2648a0-c1b4-4de5-b87b-f608f5a2b3b4 None admin] RBAC: Adding query filter params (role.id=634ba284303b4626b5a0402772c68f5c, scope.project.id=433f3f171b9249e8974c6f7627398aea, user.id=e749cfb99e9c4472a3096c9949795bda) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:08:41.656620 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2648a0-c1b4-4de5-b87b-f608f5a2b3b4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:41.658185 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2648a0-c1b4-4de5-b87b-f608f5a2b3b4 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:41.672455 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 547/1076] 10.222.0.70 () {56 vars in 1374 bytes} [Tue May 10 19:08:41 2022] GET /identity/v3/role_assignments?user.id=e749cfb99e9c4472a3096c9949795bda&scope.project.id=433f3f171b9249e8974c6f7627398aea&role.id=634ba284303b4626b5a0402772c68f5c => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:08:41.691821 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d372e6e-dc17-4d9d-9a6b-b8795e893136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:41.692566 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d372e6e-dc17-4d9d-9a6b-b8795e893136 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:41.692853 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d372e6e-dc17-4d9d-9a6b-b8795e893136 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:41.693129 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d372e6e-dc17-4d9d-9a6b-b8795e893136 None admin] PATH_INFO: `/v3/domains` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:41.694242 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d372e6e-dc17-4d9d-9a6b-b8795e893136 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:08:41.694583 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d372e6e-dc17-4d9d-9a6b-b8795e893136 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:41.696086 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d372e6e-dc17-4d9d-9a6b-b8795e893136 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:41.720451 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 530/1077] 10.222.0.70 () {56 vars in 1109 bytes} [Tue May 10 19:08:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:08:42.386068 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13023b9c-1ee6-409a-8c0e-fae71397dff6 None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:42.386586 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13023b9c-1ee6-409a-8c0e-fae71397dff6 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:42.386586 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13023b9c-1ee6-409a-8c0e-fae71397dff6 None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:42.387892 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 548/1078] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:08:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:08:42.393714 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3039a84f-1e8e-48ba-b15f-7710924b620c None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:42.394129 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3039a84f-1e8e-48ba-b15f-7710924b620c None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:42.394283 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3039a84f-1e8e-48ba-b15f-7710924b620c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:42.412291 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-3039a84f-1e8e-48ba-b15f-7710924b620c None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:08:42.413502 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-3039a84f-1e8e-48ba-b15f-7710924b620c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:08:42.476183 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 531/1079] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:08:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 19:08:42.499312 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13023b9c-1ee6-409a-8c0e-fae71397dff6 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:42.595226 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13023b9c-1ee6-409a-8c0e-fae71397dff6 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:42.627854 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f00eb4f-fa3c-4486-a2ec-bbe0ba11691c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:42.628677 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f00eb4f-fa3c-4486-a2ec-bbe0ba11691c None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:42.628963 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f00eb4f-fa3c-4486-a2ec-bbe0ba11691c None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:42.629239 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f00eb4f-fa3c-4486-a2ec-bbe0ba11691c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:42.638965 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f00eb4f-fa3c-4486-a2ec-bbe0ba11691c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:08:42.647524 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-0f00eb4f-fa3c-4486-a2ec-bbe0ba11691c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 10 19:08:42.647524 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:08:42.647524 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:08:42.647524 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:08:42.647524 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:08:42.647524 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:08:42.647524 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:08:42.647524 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:08:42.647524 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:08:42.647524 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:08:42.647524 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:08:42.647524 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:08:42.647524 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:08:42.647524 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:08:42.647524 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:08:42.647524 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:08:42.648772 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:08:42.648772 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:08:42.648772 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:08:42.648772 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:08:42.648772 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:08:42.648772 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:08:42.648772 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:08:42.648772 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:08:42.648772 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:08:42.648772 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:08:42.648772 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:08:42.648772 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( May 10 19:08:42.648772 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:08:42.648772 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() May 10 19:08:42.648772 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:08:42.648772 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:08:42.649888 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:08:42.649888 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() May 10 19:08:42.649888 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:08:42.649888 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( May 10 19:08:42.649888 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:08:42.649888 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:08:42.649888 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:08:42.649888 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:08:42.649888 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:08:42.649888 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:08:42.649888 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 10 19:08:42.649888 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:08:42.652728 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 549/1080] 10.222.0.70 () {56 vars in 1120 bytes} [Tue May 10 19:08:42 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:08:42.654570 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3039a84f-1e8e-48ba-b15f-7710924b620c None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:42.746687 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3039a84f-1e8e-48ba-b15f-7710924b620c None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:42.780520 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bc0bba-9984-4caf-a4d2-2e838d9d230c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:42.781196 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bc0bba-9984-4caf-a4d2-2e838d9d230c None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:42.781509 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bc0bba-9984-4caf-a4d2-2e838d9d230c None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:42.781786 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bc0bba-9984-4caf-a4d2-2e838d9d230c None admin] PATH_INFO: `/v3/roles` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:42.782533 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bc0bba-9984-4caf-a4d2-2e838d9d230c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:08:42.782841 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bc0bba-9984-4caf-a4d2-2e838d9d230c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:42.784208 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bc0bba-9984-4caf-a4d2-2e838d9d230c None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:42.792027 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 532/1081] 10.222.0.70 () {56 vars in 1115 bytes} [Tue May 10 19:08:42 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:08:42.798238 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f00eb4f-fa3c-4486-a2ec-bbe0ba11691c None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:42.892284 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f00eb4f-fa3c-4486-a2ec-bbe0ba11691c None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:42.923596 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d08382-437f-42ea-ad57-42772addc508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:42.924381 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d08382-437f-42ea-ad57-42772addc508 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:42.924699 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d08382-437f-42ea-ad57-42772addc508 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:42.924970 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d08382-437f-42ea-ad57-42772addc508 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:42.934933 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d08382-437f-42ea-ad57-42772addc508 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:42.936358 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d08382-437f-42ea-ad57-42772addc508 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:42.955820 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-a2d08382-437f-42ea-ad57-42772addc508 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:08:42.955820 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:08:42.955820 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:08:42.955820 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:08:42.955820 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:08:42.955820 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:08:42.955820 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:08:42.955820 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:08:42.955820 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:08:42.955820 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:08:42.955820 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:08:42.955820 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:08:42.955820 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 19:08:42.955820 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 19:08:42.955820 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 19:08:42.957050 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 19:08:42.957050 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:08:42.957050 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:08:42.957050 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:08:42.957050 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:08:42.957050 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:08:42.957050 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:08:42.957050 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:08:42.957050 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( May 10 19:08:42.957050 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:08:42.957050 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() May 10 19:08:42.957050 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:08:42.957050 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:08:42.957050 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:08:42.957050 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() May 10 19:08:42.957050 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:08:42.957050 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( May 10 19:08:42.957978 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 19:08:42.957978 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 19:08:42.957978 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:08:42.957978 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:08:42.957978 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 550/1082] 10.222.0.70 () {56 vars in 1108 bytes} [Tue May 10 19:08:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:08:42.963166 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bc0bba-9984-4caf-a4d2-2e838d9d230c None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:43.055088 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bc0bba-9984-4caf-a4d2-2e838d9d230c None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:43.086240 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bee840e-77b8-4829-8414-74280b2da273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:43.086888 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bee840e-77b8-4829-8414-74280b2da273 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:43.087170 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bee840e-77b8-4829-8414-74280b2da273 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:43.087444 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bee840e-77b8-4829-8414-74280b2da273 None admin] PATH_INFO: `/v3/domains` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:43.088146 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bee840e-77b8-4829-8414-74280b2da273 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:08:43.088469 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bee840e-77b8-4829-8414-74280b2da273 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:43.089837 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bee840e-77b8-4829-8414-74280b2da273 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:43.100951 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 533/1083] 10.222.0.70 () {56 vars in 1109 bytes} [Tue May 10 19:08:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:08:43.106568 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d08382-437f-42ea-ad57-42772addc508 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:43.200735 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d08382-437f-42ea-ad57-42772addc508 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:43.232327 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5201ea03-b7a1-4c43-947a-7721b969c5f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:43.233143 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5201ea03-b7a1-4c43-947a-7721b969c5f8 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:43.233427 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5201ea03-b7a1-4c43-947a-7721b969c5f8 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:43.233703 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5201ea03-b7a1-4c43-947a-7721b969c5f8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:43.241441 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5201ea03-b7a1-4c43-947a-7721b969c5f8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:43.242877 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5201ea03-b7a1-4c43-947a-7721b969c5f8 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:43.256362 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-5201ea03-b7a1-4c43-947a-7721b969c5f8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 10 19:08:43.256362 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:08:43.256362 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:08:43.256362 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:08:43.256362 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:08:43.256362 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:08:43.256362 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:08:43.256362 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:08:43.256362 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:08:43.256362 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:08:43.256362 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:08:43.256362 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:08:43.256362 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 19:08:43.256362 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 19:08:43.256362 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 19:08:43.256362 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 19:08:43.257539 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:08:43.257539 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:08:43.257539 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 19:08:43.257539 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 19:08:43.257539 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 19:08:43.257539 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 19:08:43.257539 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:08:43.257539 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:08:43.257539 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:08:43.257539 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:08:43.257539 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:08:43.257539 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( May 10 19:08:43.257539 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:08:43.257539 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() May 10 19:08:43.257539 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:08:43.257539 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:08:43.257539 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:08:43.257539 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() May 10 19:08:43.258566 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:08:43.258566 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( May 10 19:08:43.258566 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 19:08:43.258566 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 19:08:43.258566 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 19:08:43.258566 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 19:08:43.258566 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 19:08:43.258566 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 19:08:43.258566 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 10 19:08:43.258566 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:08:43.258566 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 551/1084] 10.222.0.70 () {56 vars in 1093 bytes} [Tue May 10 19:08:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 19:08:43.263231 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bee840e-77b8-4829-8414-74280b2da273 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:43.360529 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bee840e-77b8-4829-8414-74280b2da273 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:43.399702 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c224e2-600b-4273-b28e-2326845d86a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:43.400363 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c224e2-600b-4273-b28e-2326845d86a3 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:43.400673 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c224e2-600b-4273-b28e-2326845d86a3 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:43.400950 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c224e2-600b-4273-b28e-2326845d86a3 None admin] PATH_INFO: `/v3/users` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:43.401778 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c224e2-600b-4273-b28e-2326845d86a3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:08:43.402087 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c224e2-600b-4273-b28e-2326845d86a3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:43.403518 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c224e2-600b-4273-b28e-2326845d86a3 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:43.420091 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 534/1085] 10.222.0.70 () {56 vars in 1133 bytes} [Tue May 10 19:08:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:08:43.425924 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5201ea03-b7a1-4c43-947a-7721b969c5f8 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:43.527744 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5201ea03-b7a1-4c43-947a-7721b969c5f8 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:43.558828 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49633090-dda6-4229-a3b0-fb9b2356429e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:43.559462 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49633090-dda6-4229-a3b0-fb9b2356429e None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:43.559739 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49633090-dda6-4229-a3b0-fb9b2356429e None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:43.560011 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49633090-dda6-4229-a3b0-fb9b2356429e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:43.622548 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49633090-dda6-4229-a3b0-fb9b2356429e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:43.623991 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49633090-dda6-4229-a3b0-fb9b2356429e None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:43.719857 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 552/1086] 10.222.0.70 () {58 vars in 1282 bytes} [Tue May 10 19:08:43 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 19:08:43.725576 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c224e2-600b-4273-b28e-2326845d86a3 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:43.826868 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c224e2-600b-4273-b28e-2326845d86a3 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:43.859016 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33149f8-2cd0-46ac-ba24-20a989e3e62a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:43.860326 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33149f8-2cd0-46ac-ba24-20a989e3e62a None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:43.860634 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33149f8-2cd0-46ac-ba24-20a989e3e62a None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:43.860909 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33149f8-2cd0-46ac-ba24-20a989e3e62a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:43.863004 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1733d252-1732-4e82-94e0-d33fa6eb2fce None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:43.863280 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1733d252-1732-4e82-94e0-d33fa6eb2fce None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:43.863561 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1733d252-1732-4e82-94e0-d33fa6eb2fce None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:43.864955 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 553/1087] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:08:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 19:08:43.869891 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c45ebf-7397-4a75-ad0a-0aa7aef021d0 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:43.870177 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c45ebf-7397-4a75-ad0a-0aa7aef021d0 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:43.870453 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c45ebf-7397-4a75-ad0a-0aa7aef021d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:43.871020 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33149f8-2cd0-46ac-ba24-20a989e3e62a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:43.872503 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33149f8-2cd0-46ac-ba24-20a989e3e62a None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:43.886810 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-f2c45ebf-7397-4a75-ad0a-0aa7aef021d0 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:08:43.887988 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-f2c45ebf-7397-4a75-ad0a-0aa7aef021d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:08:43.890527 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application [None req-a33149f8-2cd0-46ac-ba24-20a989e3e62a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:08:43.890527 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:08:43.890527 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:08:43.890527 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:08:43.890527 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:08:43.890527 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:08:43.890527 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:08:43.890527 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:08:43.890527 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:08:43.890527 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:08:43.890527 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:08:43.890527 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:08:43.890527 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 19:08:43.890527 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 19:08:43.890527 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 19:08:43.892020 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 19:08:43.892020 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:08:43.892020 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:08:43.892020 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:08:43.892020 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:08:43.892020 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:08:43.892020 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:08:43.892020 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:08:43.892020 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application with Lock( May 10 19:08:43.892020 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:08:43.892020 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._enter() May 10 19:08:43.892020 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:08:43.892020 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:08:43.892020 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:08:43.892020 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.creator() May 10 19:08:43.892020 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:08:43.892020 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application created_value = creator( May 10 19:08:43.892993 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 19:08:43.892993 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 19:08:43.892993 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:08:43.892993 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application May 10 19:08:43.892993 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 535/1088] 10.222.0.70 () {56 vars in 1108 bytes} [Tue May 10 19:08:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 19:08:43.897622 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33149f8-2cd0-46ac-ba24-20a989e3e62a None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:43.952694 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 554/1089] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:08:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 19:08:43.974789 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c45ebf-7397-4a75-ad0a-0aa7aef021d0 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:43.990250 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33149f8-2cd0-46ac-ba24-20a989e3e62a None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:44.022105 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5550c9c-f6a6-42ac-a6c2-d4312405898f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:44.022759 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5550c9c-f6a6-42ac-a6c2-d4312405898f None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:44.023038 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5550c9c-f6a6-42ac-a6c2-d4312405898f None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:44.023310 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5550c9c-f6a6-42ac-a6c2-d4312405898f None admin] PATH_INFO: `/v3/domains` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:44.024009 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5550c9c-f6a6-42ac-a6c2-d4312405898f None admin] RBAC: Adding query filter params (name=Default) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:08:44.024306 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5550c9c-f6a6-42ac-a6c2-d4312405898f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:44.025700 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5550c9c-f6a6-42ac-a6c2-d4312405898f None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:44.036160 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 536/1090] 10.222.0.70 () {56 vars in 1109 bytes} [Tue May 10 19:08:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:08:44.041653 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5550c9c-f6a6-42ac-a6c2-d4312405898f None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:44.067354 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c45ebf-7397-4a75-ad0a-0aa7aef021d0 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:44.099121 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dfea52-a04b-43ff-ac63-fd45c32dd885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:44.099856 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dfea52-a04b-43ff-ac63-fd45c32dd885 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:44.100136 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dfea52-a04b-43ff-ac63-fd45c32dd885 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:44.100411 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dfea52-a04b-43ff-ac63-fd45c32dd885 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:44.110129 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dfea52-a04b-43ff-ac63-fd45c32dd885 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:08:44.117605 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-95dfea52-a04b-43ff-ac63-fd45c32dd885 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 19:08:44.117605 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:08:44.117605 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:08:44.117605 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:08:44.117605 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:08:44.117605 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:08:44.117605 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:08:44.117605 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:08:44.117605 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:08:44.117605 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:08:44.117605 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:08:44.117605 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:08:44.117605 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:08:44.117605 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:08:44.117605 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:08:44.117605 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:08:44.118685 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:08:44.118685 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:08:44.118685 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:08:44.118685 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:08:44.118685 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:08:44.118685 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:08:44.118685 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:08:44.118685 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:08:44.118685 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:08:44.118685 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:08:44.118685 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:08:44.118685 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( May 10 19:08:44.118685 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:08:44.118685 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() May 10 19:08:44.118685 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:08:44.118685 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:08:44.119988 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:08:44.119988 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() May 10 19:08:44.119988 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:08:44.119988 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( May 10 19:08:44.119988 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:08:44.119988 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:08:44.119988 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:08:44.119988 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:08:44.119988 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:08:44.119988 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:08:44.119988 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 19:08:44.119988 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:08:44.119988 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 555/1091] 10.222.0.70 () {56 vars in 1096 bytes} [Tue May 10 19:08:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:08:44.124601 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dfea52-a04b-43ff-ac63-fd45c32dd885 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:44.134062 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5550c9c-f6a6-42ac-a6c2-d4312405898f None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:44.165236 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3691e69-bc47-474b-9a2e-d71f97a88a3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:44.166024 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3691e69-bc47-474b-9a2e-d71f97a88a3e None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:44.166297 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3691e69-bc47-474b-9a2e-d71f97a88a3e None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:44.166564 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3691e69-bc47-474b-9a2e-d71f97a88a3e None admin] PATH_INFO: `/v3/projects/service` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:44.173548 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3691e69-bc47-474b-9a2e-d71f97a88a3e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:44.175000 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3691e69-bc47-474b-9a2e-d71f97a88a3e None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:44.189357 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application [None req-e3691e69-bc47-474b-9a2e-d71f97a88a3e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 19:08:44.189357 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:08:44.189357 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:08:44.189357 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:08:44.189357 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:08:44.189357 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:08:44.189357 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:08:44.189357 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:08:44.189357 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:08:44.189357 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:08:44.189357 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:08:44.189357 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:08:44.189357 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 19:08:44.189357 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 19:08:44.189357 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 19:08:44.190721 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 19:08:44.190721 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:08:44.190721 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:08:44.190721 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:08:44.190721 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:08:44.190721 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:08:44.190721 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:08:44.190721 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:08:44.190721 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application with Lock( May 10 19:08:44.190721 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:08:44.190721 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._enter() May 10 19:08:44.190721 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:08:44.190721 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:08:44.190721 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:08:44.190721 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.creator() May 10 19:08:44.190721 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:08:44.190721 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application created_value = creator( May 10 19:08:44.191641 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 19:08:44.191641 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 19:08:44.191641 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 19:08:44.191641 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 19:08:44.191641 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 19:08:44.191641 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 19:08:44.191641 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 19:08:44.191641 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application May 10 19:08:44.191641 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 537/1092] 10.222.0.70 () {56 vars in 1111 bytes} [Tue May 10 19:08:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 19:08:44.197212 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3691e69-bc47-474b-9a2e-d71f97a88a3e None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:44.222582 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dfea52-a04b-43ff-ac63-fd45c32dd885 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:44.254602 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64217f8-e9b2-4785-b957-c51d32156571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:44.255264 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64217f8-e9b2-4785-b957-c51d32156571 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:44.255548 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64217f8-e9b2-4785-b957-c51d32156571 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:44.255822 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64217f8-e9b2-4785-b957-c51d32156571 None admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:44.256597 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64217f8-e9b2-4785-b957-c51d32156571 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:08:44.256902 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64217f8-e9b2-4785-b957-c51d32156571 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:44.258275 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64217f8-e9b2-4785-b957-c51d32156571 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:44.266591 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 556/1093] 10.222.0.70 () {56 vars in 1099 bytes} [Tue May 10 19:08:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:08:44.272370 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64217f8-e9b2-4785-b957-c51d32156571 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:44.293537 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3691e69-bc47-474b-9a2e-d71f97a88a3e None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:44.325146 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5ccf37-fb73-445e-9e67-25b56f7d8f09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:44.325800 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5ccf37-fb73-445e-9e67-25b56f7d8f09 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:44.326085 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5ccf37-fb73-445e-9e67-25b56f7d8f09 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:44.326360 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5ccf37-fb73-445e-9e67-25b56f7d8f09 None admin] PATH_INFO: `/v3/projects` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:44.327132 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5ccf37-fb73-445e-9e67-25b56f7d8f09 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:08:44.327439 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5ccf37-fb73-445e-9e67-25b56f7d8f09 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:44.329423 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5ccf37-fb73-445e-9e67-25b56f7d8f09 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:44.340561 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 538/1094] 10.222.0.70 () {56 vars in 1148 bytes} [Tue May 10 19:08:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:08:44.347197 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5ccf37-fb73-445e-9e67-25b56f7d8f09 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:44.366452 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64217f8-e9b2-4785-b957-c51d32156571 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:44.398078 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaadffba-dbef-48e4-87d3-8878455e9b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:44.398946 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaadffba-dbef-48e4-87d3-8878455e9b62 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:44.399225 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaadffba-dbef-48e4-87d3-8878455e9b62 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:44.399493 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaadffba-dbef-48e4-87d3-8878455e9b62 None admin] PATH_INFO: `/v3/users/e749cfb99e9c4472a3096c9949795bda` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:44.400704 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaadffba-dbef-48e4-87d3-8878455e9b62 None admin] RBAC: Authorizing `identity:get_user(user_id=e749cfb99e9c4472a3096c9949795bda)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:44.402118 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaadffba-dbef-48e4-87d3-8878455e9b62 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:44.403739 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 557/1095] 10.222.0.70 () {56 vars in 1177 bytes} [Tue May 10 19:08:44 2022] GET /identity/v3/users/e749cfb99e9c4472a3096c9949795bda => generated 285 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:08:44.409870 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaadffba-dbef-48e4-87d3-8878455e9b62 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:44.438137 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5ccf37-fb73-445e-9e67-25b56f7d8f09 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:44.470194 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec72959-d98c-4892-be1d-c9ffe0c4efab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:44.470854 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec72959-d98c-4892-be1d-c9ffe0c4efab None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:44.471137 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec72959-d98c-4892-be1d-c9ffe0c4efab None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:44.471415 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec72959-d98c-4892-be1d-c9ffe0c4efab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:44.472232 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec72959-d98c-4892-be1d-c9ffe0c4efab None admin] RBAC: Adding query filter params (role.id=128f76acc6c8422797401b4d627ca236, scope.project.id=2ee9ec5b515440fe9b39aedf3e339c79, user.id=b9f310a468ec4058b3c95356ea60ab4c) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:08:44.472700 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec72959-d98c-4892-be1d-c9ffe0c4efab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:44.474129 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec72959-d98c-4892-be1d-c9ffe0c4efab None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:44.479689 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 539/1096] 10.222.0.70 () {56 vars in 1374 bytes} [Tue May 10 19:08:44 2022] GET /identity/v3/role_assignments?user.id=b9f310a468ec4058b3c95356ea60ab4c&scope.project.id=2ee9ec5b515440fe9b39aedf3e339c79&role.id=128f76acc6c8422797401b4d627ca236 => generated 608 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:08:44.504796 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaadffba-dbef-48e4-87d3-8878455e9b62 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:44.541916 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6efd641-649b-4786-9152-ddc87477a8e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:44.542807 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6efd641-649b-4786-9152-ddc87477a8e6 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:44.543081 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6efd641-649b-4786-9152-ddc87477a8e6 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:44.543347 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6efd641-649b-4786-9152-ddc87477a8e6 None admin] PATH_INFO: `/v3/projects/433f3f171b9249e8974c6f7627398aea` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:44.544647 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6efd641-649b-4786-9152-ddc87477a8e6 None admin] RBAC: Authorizing `identity:get_project(project_id=433f3f171b9249e8974c6f7627398aea)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:44.546121 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6efd641-649b-4786-9152-ddc87477a8e6 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:44.548412 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 558/1097] 10.222.0.70 () {56 vars in 1186 bytes} [Tue May 10 19:08:44 2022] GET /identity/v3/projects/433f3f171b9249e8974c6f7627398aea => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:08:44.554405 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec72959-d98c-4892-be1d-c9ffe0c4efab None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:44.653667 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec72959-d98c-4892-be1d-c9ffe0c4efab None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:44.685848 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee7b443-8bcd-48b1-86a1-7dfa4b026206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:44.686748 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee7b443-8bcd-48b1-86a1-7dfa4b026206 None admin] REQUEST_METHOD: `PUT` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:44.687033 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee7b443-8bcd-48b1-86a1-7dfa4b026206 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:44.687309 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee7b443-8bcd-48b1-86a1-7dfa4b026206 None admin] PATH_INFO: `/v3/projects/433f3f171b9249e8974c6f7627398aea/users/e749cfb99e9c4472a3096c9949795bda/roles/634ba284303b4626b5a0402772c68f5c` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:44.690680 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee7b443-8bcd-48b1-86a1-7dfa4b026206 None admin] RBAC: Authorizing `identity:create_grant(project_id=433f3f171b9249e8974c6f7627398aea, user_id=e749cfb99e9c4472a3096c9949795bda, role_id=634ba284303b4626b5a0402772c68f5c)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:44.691376 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee7b443-8bcd-48b1-86a1-7dfa4b026206 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:44.705453 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 540/1098] 10.222.0.70 () {58 vars in 1439 bytes} [Tue May 10 19:08:44 2022] PUT /identity/v3/projects/433f3f171b9249e8974c6f7627398aea/users/e749cfb99e9c4472a3096c9949795bda/roles/634ba284303b4626b5a0402772c68f5c => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 19:08:46.912636 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb062da2-9307-4e2f-970a-021c51a8cba0 None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:46.913190 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb062da2-9307-4e2f-970a-021c51a8cba0 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:46.913190 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb062da2-9307-4e2f-970a-021c51a8cba0 None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:46.914552 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 559/1099] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:08:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:08:46.919771 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99d5f3d-fd4e-4032-8501-95d030442a2d None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:46.920188 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99d5f3d-fd4e-4032-8501-95d030442a2d None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:46.920328 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99d5f3d-fd4e-4032-8501-95d030442a2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:46.937110 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-f99d5f3d-fd4e-4032-8501-95d030442a2d None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:08:46.938759 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-f99d5f3d-fd4e-4032-8501-95d030442a2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:08:47.001154 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 541/1100] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:08:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 19:08:47.024529 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb062da2-9307-4e2f-970a-021c51a8cba0 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:47.118557 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb062da2-9307-4e2f-970a-021c51a8cba0 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:47.150463 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cd57f1-fd37-4628-99f8-f8bc85d32c18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:47.151248 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cd57f1-fd37-4628-99f8-f8bc85d32c18 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:47.151531 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cd57f1-fd37-4628-99f8-f8bc85d32c18 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:47.151805 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cd57f1-fd37-4628-99f8-f8bc85d32c18 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:47.161291 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cd57f1-fd37-4628-99f8-f8bc85d32c18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:08:47.168924 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-57cd57f1-fd37-4628-99f8-f8bc85d32c18 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 19:08:47.168924 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:08:47.168924 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:08:47.168924 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:08:47.168924 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:08:47.168924 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:08:47.168924 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:08:47.168924 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:08:47.168924 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:08:47.168924 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:08:47.168924 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:08:47.168924 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:08:47.168924 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:08:47.168924 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:08:47.168924 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:08:47.168924 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:08:47.170010 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:08:47.170010 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:08:47.170010 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:08:47.170010 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:08:47.170010 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:08:47.170010 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:08:47.170010 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:08:47.170010 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:08:47.170010 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:08:47.170010 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:08:47.170010 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:08:47.170010 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( May 10 19:08:47.170010 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:08:47.170010 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() May 10 19:08:47.170010 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:08:47.170010 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:08:47.170944 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:08:47.170944 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() May 10 19:08:47.170944 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:08:47.170944 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( May 10 19:08:47.170944 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:08:47.170944 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:08:47.170944 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:08:47.170944 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:08:47.170944 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:08:47.170944 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:08:47.170944 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 19:08:47.170944 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:08:47.170944 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 560/1101] 10.222.0.70 () {56 vars in 1096 bytes} [Tue May 10 19:08:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:08:47.175812 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99d5f3d-fd4e-4032-8501-95d030442a2d None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:47.267492 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99d5f3d-fd4e-4032-8501-95d030442a2d None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:47.298699 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046661c2-4bd7-4694-8751-1e9e6db9572c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:47.299350 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046661c2-4bd7-4694-8751-1e9e6db9572c None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:47.299631 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046661c2-4bd7-4694-8751-1e9e6db9572c None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:47.299903 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046661c2-4bd7-4694-8751-1e9e6db9572c None admin] PATH_INFO: `/v3/roles` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:47.300655 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046661c2-4bd7-4694-8751-1e9e6db9572c None admin] RBAC: Adding query filter params (name=admin) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:08:47.300963 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046661c2-4bd7-4694-8751-1e9e6db9572c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:47.302314 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046661c2-4bd7-4694-8751-1e9e6db9572c None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:47.309797 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 542/1102] 10.222.0.70 () {56 vars in 1099 bytes} [Tue May 10 19:08:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:08:47.316034 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cd57f1-fd37-4628-99f8-f8bc85d32c18 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:47.411270 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cd57f1-fd37-4628-99f8-f8bc85d32c18 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:47.441788 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57f0407-4c29-4590-ac02-68d7beedf368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:47.442638 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57f0407-4c29-4590-ac02-68d7beedf368 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:47.442915 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57f0407-4c29-4590-ac02-68d7beedf368 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:47.443181 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57f0407-4c29-4590-ac02-68d7beedf368 None admin] PATH_INFO: `/v3/users/e749cfb99e9c4472a3096c9949795bda` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:47.444342 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57f0407-4c29-4590-ac02-68d7beedf368 None admin] RBAC: Authorizing `identity:get_user(user_id=e749cfb99e9c4472a3096c9949795bda)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:47.445778 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57f0407-4c29-4590-ac02-68d7beedf368 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:47.447377 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 561/1103] 10.222.0.70 () {56 vars in 1177 bytes} [Tue May 10 19:08:47 2022] GET /identity/v3/users/e749cfb99e9c4472a3096c9949795bda => generated 285 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:08:47.453017 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046661c2-4bd7-4694-8751-1e9e6db9572c None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:47.546005 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046661c2-4bd7-4694-8751-1e9e6db9572c None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:47.576315 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06415286-4a19-478a-87d6-70f11de59e37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:47.576967 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06415286-4a19-478a-87d6-70f11de59e37 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:47.577249 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06415286-4a19-478a-87d6-70f11de59e37 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:47.577518 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06415286-4a19-478a-87d6-70f11de59e37 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:47.639987 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06415286-4a19-478a-87d6-70f11de59e37 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:47.641963 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06415286-4a19-478a-87d6-70f11de59e37 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:47.731409 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 543/1104] 10.222.0.70 () {58 vars in 1282 bytes} [Tue May 10 19:08:47 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 19:08:47.737122 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57f0407-4c29-4590-ac02-68d7beedf368 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:47.828152 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57f0407-4c29-4590-ac02-68d7beedf368 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:47.860319 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59053b2d-9abb-42c3-b274-206b9f76373d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:47.861550 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59053b2d-9abb-42c3-b274-206b9f76373d None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:47.861825 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59053b2d-9abb-42c3-b274-206b9f76373d None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:47.862090 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59053b2d-9abb-42c3-b274-206b9f76373d None admin] PATH_INFO: `/v3/projects/433f3f171b9249e8974c6f7627398aea` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:47.863248 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59053b2d-9abb-42c3-b274-206b9f76373d None admin] RBAC: Authorizing `identity:get_project(project_id=433f3f171b9249e8974c6f7627398aea)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:47.864684 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59053b2d-9abb-42c3-b274-206b9f76373d None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:47.866340 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 562/1105] 10.222.0.70 () {56 vars in 1186 bytes} [Tue May 10 19:08:47 2022] GET /identity/v3/projects/433f3f171b9249e8974c6f7627398aea => generated 311 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:08:47.872337 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06415286-4a19-478a-87d6-70f11de59e37 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:47.964240 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06415286-4a19-478a-87d6-70f11de59e37 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:47.996580 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689108cf-d5a6-429b-b070-3d395c491197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:47.997158 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689108cf-d5a6-429b-b070-3d395c491197 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:47.997441 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689108cf-d5a6-429b-b070-3d395c491197 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:47.997716 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689108cf-d5a6-429b-b070-3d395c491197 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:47.998528 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689108cf-d5a6-429b-b070-3d395c491197 None admin] RBAC: Adding query filter params (role.id=634ba284303b4626b5a0402772c68f5c, scope.project.id=433f3f171b9249e8974c6f7627398aea, user.id=e749cfb99e9c4472a3096c9949795bda) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:08:47.998839 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689108cf-d5a6-429b-b070-3d395c491197 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:48.000287 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689108cf-d5a6-429b-b070-3d395c491197 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:48.005831 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 544/1106] 10.222.0.70 () {56 vars in 1374 bytes} [Tue May 10 19:08:47 2022] GET /identity/v3/role_assignments?user.id=e749cfb99e9c4472a3096c9949795bda&scope.project.id=433f3f171b9249e8974c6f7627398aea&role.id=634ba284303b4626b5a0402772c68f5c => generated 608 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:08:50.202368 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6163e22-505f-4434-93e3-3ac00a019530 None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:50.202994 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6163e22-505f-4434-93e3-3ac00a019530 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:50.202994 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6163e22-505f-4434-93e3-3ac00a019530 None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:50.204881 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 563/1107] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:08:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:08:50.210420 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e6b7c7-11b4-4807-85be-9b6e9eb77029 None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:50.210856 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e6b7c7-11b4-4807-85be-9b6e9eb77029 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:50.210954 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e6b7c7-11b4-4807-85be-9b6e9eb77029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:50.227022 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-96e6b7c7-11b4-4807-85be-9b6e9eb77029 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:08:50.228183 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-96e6b7c7-11b4-4807-85be-9b6e9eb77029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:08:50.290613 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 545/1108] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:08:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 19:08:50.315879 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6163e22-505f-4434-93e3-3ac00a019530 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:50.411605 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6163e22-505f-4434-93e3-3ac00a019530 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:50.442217 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c921919-8a4f-41f2-8133-5b0475c24057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:50.442992 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c921919-8a4f-41f2-8133-5b0475c24057 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:50.443273 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c921919-8a4f-41f2-8133-5b0475c24057 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:50.443546 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c921919-8a4f-41f2-8133-5b0475c24057 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:50.444719 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c921919-8a4f-41f2-8133-5b0475c24057 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:50.446133 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c921919-8a4f-41f2-8133-5b0475c24057 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:50.447708 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 564/1109] 10.222.0.70 () {56 vars in 1108 bytes} [Tue May 10 19:08:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:08:50.453838 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e6b7c7-11b4-4807-85be-9b6e9eb77029 None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:50.545681 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e6b7c7-11b4-4807-85be-9b6e9eb77029 None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:50.577501 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56fdd4c-f4a1-489b-a036-6269082731c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:50.578218 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56fdd4c-f4a1-489b-a036-6269082731c0 None admin] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:50.578540 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56fdd4c-f4a1-489b-a036-6269082731c0 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:50.578853 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56fdd4c-f4a1-489b-a036-6269082731c0 None admin] PATH_INFO: `/v3/users` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:50.579758 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56fdd4c-f4a1-489b-a036-6269082731c0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:50.581737 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56fdd4c-f4a1-489b-a036-6269082731c0 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:50.600287 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 546/1110] 10.222.0.70 () {60 vars in 1132 bytes} [Tue May 10 19:08:50 2022] POST /identity/v3/users => generated 286 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:08:52.834647 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc4a4d3-3a87-40c8-a335-dddd8e7b67d0 None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:52.835175 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc4a4d3-3a87-40c8-a335-dddd8e7b67d0 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:52.835175 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc4a4d3-3a87-40c8-a335-dddd8e7b67d0 None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:52.836561 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 565/1111] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:08:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:08:52.841844 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d1bda0-623b-40a2-b569-2fb03f0e077f None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:52.842248 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d1bda0-623b-40a2-b569-2fb03f0e077f None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:52.842405 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d1bda0-623b-40a2-b569-2fb03f0e077f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:52.858981 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-37d1bda0-623b-40a2-b569-2fb03f0e077f None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:08:52.860224 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-37d1bda0-623b-40a2-b569-2fb03f0e077f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:08:52.922237 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 547/1112] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:08:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 19:08:52.945682 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc4a4d3-3a87-40c8-a335-dddd8e7b67d0 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:53.042327 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc4a4d3-3a87-40c8-a335-dddd8e7b67d0 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:53.073524 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05345fe5-295f-4a1c-bf76-a7a06bba7dbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:53.074367 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05345fe5-295f-4a1c-bf76-a7a06bba7dbc None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:53.074648 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05345fe5-295f-4a1c-bf76-a7a06bba7dbc None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:53.074921 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05345fe5-295f-4a1c-bf76-a7a06bba7dbc None admin] PATH_INFO: `/v3/roles/49187695e1bf4c15980bb68c83ca61de` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:53.076369 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05345fe5-295f-4a1c-bf76-a7a06bba7dbc None admin] RBAC: Authorizing `identity:get_role(role_id=49187695e1bf4c15980bb68c83ca61de)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:53.077756 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05345fe5-295f-4a1c-bf76-a7a06bba7dbc None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:53.079161 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 566/1113] 10.222.0.70 () {56 vars in 1177 bytes} [Tue May 10 19:08:52 2022] GET /identity/v3/roles/49187695e1bf4c15980bb68c83ca61de => generated 223 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:08:53.085257 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d1bda0-623b-40a2-b569-2fb03f0e077f None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:53.175260 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d1bda0-623b-40a2-b569-2fb03f0e077f None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:53.206506 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a84dabd-e196-4f1a-b501-c5931681c943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:53.207357 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a84dabd-e196-4f1a-b501-c5931681c943 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:53.207632 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a84dabd-e196-4f1a-b501-c5931681c943 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:53.207901 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a84dabd-e196-4f1a-b501-c5931681c943 None admin] PATH_INFO: `/v3/users/2a73b8ee041f424488461b95257fcf6b` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:53.220365 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a84dabd-e196-4f1a-b501-c5931681c943 None admin] RBAC: Authorizing `identity:get_user(user_id=2a73b8ee041f424488461b95257fcf6b)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:53.221813 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a84dabd-e196-4f1a-b501-c5931681c943 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:53.223382 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 548/1114] 10.222.0.70 () {56 vars in 1177 bytes} [Tue May 10 19:08:53 2022] GET /identity/v3/users/2a73b8ee041f424488461b95257fcf6b => generated 286 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:08:53.228892 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05345fe5-295f-4a1c-bf76-a7a06bba7dbc None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:53.321490 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05345fe5-295f-4a1c-bf76-a7a06bba7dbc None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:53.353055 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44ed8f7-4a83-42c5-99bc-71d62403ffc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:53.353634 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44ed8f7-4a83-42c5-99bc-71d62403ffc0 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:53.353916 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44ed8f7-4a83-42c5-99bc-71d62403ffc0 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:53.354189 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44ed8f7-4a83-42c5-99bc-71d62403ffc0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:53.415896 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44ed8f7-4a83-42c5-99bc-71d62403ffc0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:53.417354 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44ed8f7-4a83-42c5-99bc-71d62403ffc0 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:53.516257 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 567/1115] 10.222.0.70 () {58 vars in 1282 bytes} [Tue May 10 19:08:53 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 19:08:53.522183 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a84dabd-e196-4f1a-b501-c5931681c943 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:53.615130 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a84dabd-e196-4f1a-b501-c5931681c943 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:53.646322 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b52910-048c-46aa-8020-f87d4a083531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:53.647164 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b52910-048c-46aa-8020-f87d4a083531 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:53.647442 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b52910-048c-46aa-8020-f87d4a083531 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:53.647715 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b52910-048c-46aa-8020-f87d4a083531 None admin] PATH_INFO: `/v3/projects/433f3f171b9249e8974c6f7627398aea` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:53.648885 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b52910-048c-46aa-8020-f87d4a083531 None admin] RBAC: Authorizing `identity:get_project(project_id=433f3f171b9249e8974c6f7627398aea)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:53.650298 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b52910-048c-46aa-8020-f87d4a083531 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:53.651921 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 549/1116] 10.222.0.70 () {56 vars in 1186 bytes} [Tue May 10 19:08:53 2022] GET /identity/v3/projects/433f3f171b9249e8974c6f7627398aea => generated 311 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:08:53.658450 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44ed8f7-4a83-42c5-99bc-71d62403ffc0 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:53.750546 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44ed8f7-4a83-42c5-99bc-71d62403ffc0 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:53.782010 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62946604-ef75-4843-a158-cd51d32d9490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:53.782646 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62946604-ef75-4843-a158-cd51d32d9490 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:53.782927 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62946604-ef75-4843-a158-cd51d32d9490 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:53.783201 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62946604-ef75-4843-a158-cd51d32d9490 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:53.784013 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62946604-ef75-4843-a158-cd51d32d9490 None admin] RBAC: Adding query filter params (role.id=49187695e1bf4c15980bb68c83ca61de, scope.project.id=433f3f171b9249e8974c6f7627398aea, user.id=2a73b8ee041f424488461b95257fcf6b) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:08:53.784322 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62946604-ef75-4843-a158-cd51d32d9490 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:53.785760 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62946604-ef75-4843-a158-cd51d32d9490 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:53.790854 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 568/1117] 10.222.0.70 () {56 vars in 1374 bytes} [Tue May 10 19:08:53 2022] GET /identity/v3/role_assignments?user.id=2a73b8ee041f424488461b95257fcf6b&scope.project.id=433f3f171b9249e8974c6f7627398aea&role.id=49187695e1bf4c15980bb68c83ca61de => generated 259 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:08:55.966989 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74583448-affb-4dab-a991-df7f86c4f4e0 None None] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:55.967473 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74583448-affb-4dab-a991-df7f86c4f4e0 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:55.967585 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74583448-affb-4dab-a991-df7f86c4f4e0 None None] PATH_INFO: `/` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:55.969660 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 550/1118] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:08:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:08:55.974707 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd86fc5b-1e72-46c9-98ee-8115f03c89f2 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:55.975135 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd86fc5b-1e72-46c9-98ee-8115f03c89f2 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:55.976877 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd86fc5b-1e72-46c9-98ee-8115f03c89f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:55.991966 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-fd86fc5b-1e72-46c9-98ee-8115f03c89f2 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:08:55.993161 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-fd86fc5b-1e72-46c9-98ee-8115f03c89f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:08:56.054803 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 569/1119] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:08:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 19:08:56.076854 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74583448-affb-4dab-a991-df7f86c4f4e0 None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:56.172796 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74583448-affb-4dab-a991-df7f86c4f4e0 None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:56.204739 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bdb779-e7fb-49b1-a47d-904db93d5da6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:56.205521 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bdb779-e7fb-49b1-a47d-904db93d5da6 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:56.206054 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bdb779-e7fb-49b1-a47d-904db93d5da6 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:56.206333 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bdb779-e7fb-49b1-a47d-904db93d5da6 None admin] PATH_INFO: `/v3/roles/49187695e1bf4c15980bb68c83ca61de` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:56.207796 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bdb779-e7fb-49b1-a47d-904db93d5da6 None admin] RBAC: Authorizing `identity:get_role(role_id=49187695e1bf4c15980bb68c83ca61de)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:56.209193 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bdb779-e7fb-49b1-a47d-904db93d5da6 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:56.210533 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 551/1120] 10.222.0.70 () {56 vars in 1177 bytes} [Tue May 10 19:08:56 2022] GET /identity/v3/roles/49187695e1bf4c15980bb68c83ca61de => generated 223 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:08:56.216334 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd86fc5b-1e72-46c9-98ee-8115f03c89f2 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:56.307639 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd86fc5b-1e72-46c9-98ee-8115f03c89f2 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:56.339845 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a87924b-52f7-40bb-b0d7-e356a2975d34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:56.340731 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a87924b-52f7-40bb-b0d7-e356a2975d34 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:56.341014 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a87924b-52f7-40bb-b0d7-e356a2975d34 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:56.341294 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a87924b-52f7-40bb-b0d7-e356a2975d34 None admin] PATH_INFO: `/v3/users/2a73b8ee041f424488461b95257fcf6b` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:56.342460 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a87924b-52f7-40bb-b0d7-e356a2975d34 None admin] RBAC: Authorizing `identity:get_user(user_id=2a73b8ee041f424488461b95257fcf6b)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:56.343886 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a87924b-52f7-40bb-b0d7-e356a2975d34 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:56.345618 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 570/1121] 10.222.0.70 () {56 vars in 1177 bytes} [Tue May 10 19:08:56 2022] GET /identity/v3/users/2a73b8ee041f424488461b95257fcf6b => generated 286 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:08:56.351048 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bdb779-e7fb-49b1-a47d-904db93d5da6 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:56.444489 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bdb779-e7fb-49b1-a47d-904db93d5da6 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:56.476590 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42228d3c-7946-4a56-84f9-f018b8c4e746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:56.477357 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42228d3c-7946-4a56-84f9-f018b8c4e746 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:56.477637 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42228d3c-7946-4a56-84f9-f018b8c4e746 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:56.477908 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42228d3c-7946-4a56-84f9-f018b8c4e746 None admin] PATH_INFO: `/v3/projects/433f3f171b9249e8974c6f7627398aea` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:56.479071 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42228d3c-7946-4a56-84f9-f018b8c4e746 None admin] RBAC: Authorizing `identity:get_project(project_id=433f3f171b9249e8974c6f7627398aea)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:56.480507 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42228d3c-7946-4a56-84f9-f018b8c4e746 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:56.482142 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 552/1122] 10.222.0.70 () {56 vars in 1186 bytes} [Tue May 10 19:08:56 2022] GET /identity/v3/projects/433f3f171b9249e8974c6f7627398aea => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:08:56.488266 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a87924b-52f7-40bb-b0d7-e356a2975d34 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:56.579120 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a87924b-52f7-40bb-b0d7-e356a2975d34 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:56.610326 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68acfb6-88ab-45f2-b58a-f43872f9c41e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:56.611183 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68acfb6-88ab-45f2-b58a-f43872f9c41e None admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:56.611457 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68acfb6-88ab-45f2-b58a-f43872f9c41e None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:56.611720 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68acfb6-88ab-45f2-b58a-f43872f9c41e None admin] PATH_INFO: `/v3/projects/433f3f171b9249e8974c6f7627398aea/users/2a73b8ee041f424488461b95257fcf6b/roles/49187695e1bf4c15980bb68c83ca61de` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:56.613870 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68acfb6-88ab-45f2-b58a-f43872f9c41e None admin] RBAC: Authorizing `identity:create_grant(project_id=433f3f171b9249e8974c6f7627398aea, user_id=2a73b8ee041f424488461b95257fcf6b, role_id=49187695e1bf4c15980bb68c83ca61de)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:56.615265 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68acfb6-88ab-45f2-b58a-f43872f9c41e None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:56.627146 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 571/1123] 10.222.0.70 () {58 vars in 1439 bytes} [Tue May 10 19:08:56 2022] PUT /identity/v3/projects/433f3f171b9249e8974c6f7627398aea/users/2a73b8ee041f424488461b95257fcf6b/roles/49187695e1bf4c15980bb68c83ca61de => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 19:08:58.871400 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ce6a24-bf15-4120-aeef-563f0fb58af1 None None] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:58.871922 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ce6a24-bf15-4120-aeef-563f0fb58af1 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:58.871922 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ce6a24-bf15-4120-aeef-563f0fb58af1 None None] PATH_INFO: `/` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:58.873329 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 553/1124] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:08:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:08:58.878666 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3e04d2-1a32-4d52-a845-bb570997a74e None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:58.879074 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3e04d2-1a32-4d52-a845-bb570997a74e None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:58.879213 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3e04d2-1a32-4d52-a845-bb570997a74e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:58.895761 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-da3e04d2-1a32-4d52-a845-bb570997a74e None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:08:58.896954 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-da3e04d2-1a32-4d52-a845-bb570997a74e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:08:58.960526 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 572/1125] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:08:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 19:08:58.983721 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ce6a24-bf15-4120-aeef-563f0fb58af1 None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:59.077524 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ce6a24-bf15-4120-aeef-563f0fb58af1 None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:59.109270 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd9f1e1-e85a-4152-8f5b-b6eb89a11af3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:59.110112 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd9f1e1-e85a-4152-8f5b-b6eb89a11af3 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:59.110397 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd9f1e1-e85a-4152-8f5b-b6eb89a11af3 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:59.110730 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd9f1e1-e85a-4152-8f5b-b6eb89a11af3 None admin] PATH_INFO: `/v3/roles/49187695e1bf4c15980bb68c83ca61de` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:59.112133 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd9f1e1-e85a-4152-8f5b-b6eb89a11af3 None admin] RBAC: Authorizing `identity:get_role(role_id=49187695e1bf4c15980bb68c83ca61de)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:59.113527 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd9f1e1-e85a-4152-8f5b-b6eb89a11af3 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:59.114846 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 554/1126] 10.222.0.70 () {56 vars in 1177 bytes} [Tue May 10 19:08:58 2022] GET /identity/v3/roles/49187695e1bf4c15980bb68c83ca61de => generated 223 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:08:59.120481 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3e04d2-1a32-4d52-a845-bb570997a74e None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:59.211641 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3e04d2-1a32-4d52-a845-bb570997a74e None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:59.243554 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9df275-db41-4fbe-8924-d9f6cc513c8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:59.244424 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9df275-db41-4fbe-8924-d9f6cc513c8e None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:59.244733 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9df275-db41-4fbe-8924-d9f6cc513c8e None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:59.245007 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9df275-db41-4fbe-8924-d9f6cc513c8e None admin] PATH_INFO: `/v3/users/2a73b8ee041f424488461b95257fcf6b` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:59.246178 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9df275-db41-4fbe-8924-d9f6cc513c8e None admin] RBAC: Authorizing `identity:get_user(user_id=2a73b8ee041f424488461b95257fcf6b)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:59.247597 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9df275-db41-4fbe-8924-d9f6cc513c8e None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:59.249213 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 573/1127] 10.222.0.70 () {56 vars in 1177 bytes} [Tue May 10 19:08:59 2022] GET /identity/v3/users/2a73b8ee041f424488461b95257fcf6b => generated 286 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:08:59.254728 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd9f1e1-e85a-4152-8f5b-b6eb89a11af3 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:59.348274 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd9f1e1-e85a-4152-8f5b-b6eb89a11af3 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:59.383171 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aada7358-c28a-499d-ad2b-9474e2211d24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:59.383818 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aada7358-c28a-499d-ad2b-9474e2211d24 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:59.384104 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aada7358-c28a-499d-ad2b-9474e2211d24 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:59.384381 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aada7358-c28a-499d-ad2b-9474e2211d24 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:59.446810 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aada7358-c28a-499d-ad2b-9474e2211d24 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:59.448253 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aada7358-c28a-499d-ad2b-9474e2211d24 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:59.543866 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 555/1128] 10.222.0.70 () {58 vars in 1282 bytes} [Tue May 10 19:08:59 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 19:08:59.549839 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9df275-db41-4fbe-8924-d9f6cc513c8e None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:59.641735 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9df275-db41-4fbe-8924-d9f6cc513c8e None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:59.673061 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ef8519-c157-435e-9041-81150819fa48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:59.673901 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ef8519-c157-435e-9041-81150819fa48 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:59.674181 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ef8519-c157-435e-9041-81150819fa48 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:59.674452 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ef8519-c157-435e-9041-81150819fa48 None admin] PATH_INFO: `/v3/projects/433f3f171b9249e8974c6f7627398aea` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:59.675604 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ef8519-c157-435e-9041-81150819fa48 None admin] RBAC: Authorizing `identity:get_project(project_id=433f3f171b9249e8974c6f7627398aea)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:59.677049 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ef8519-c157-435e-9041-81150819fa48 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:59.678699 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 574/1129] 10.222.0.70 () {56 vars in 1186 bytes} [Tue May 10 19:08:59 2022] GET /identity/v3/projects/433f3f171b9249e8974c6f7627398aea => generated 311 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:08:59.684676 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aada7358-c28a-499d-ad2b-9474e2211d24 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:59.780005 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aada7358-c28a-499d-ad2b-9474e2211d24 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:59.810797 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183744c3-6081-40dc-aee6-36fc661247bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:59.811378 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183744c3-6081-40dc-aee6-36fc661247bf None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:59.811659 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183744c3-6081-40dc-aee6-36fc661247bf None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:59.812469 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183744c3-6081-40dc-aee6-36fc661247bf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:59.813282 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183744c3-6081-40dc-aee6-36fc661247bf None admin] RBAC: Adding query filter params (role.id=49187695e1bf4c15980bb68c83ca61de, scope.project.id=433f3f171b9249e8974c6f7627398aea, user.id=2a73b8ee041f424488461b95257fcf6b) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:08:59.813591 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183744c3-6081-40dc-aee6-36fc661247bf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:59.815026 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183744c3-6081-40dc-aee6-36fc661247bf None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:59.820495 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 556/1130] 10.222.0.70 () {56 vars in 1374 bytes} [Tue May 10 19:08:59 2022] GET /identity/v3/role_assignments?user.id=2a73b8ee041f424488461b95257fcf6b&scope.project.id=433f3f171b9249e8974c6f7627398aea&role.id=49187695e1bf4c15980bb68c83ca61de => generated 608 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:09:02.021301 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd47364-384a-4fec-9c87-bc3f25b822f3 None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:09:02.021808 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd47364-384a-4fec-9c87-bc3f25b822f3 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:09:02.021902 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd47364-384a-4fec-9c87-bc3f25b822f3 None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:09:02.023209 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 575/1131] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:09:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:09:02.028326 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f5fd8c-f0ce-4e62-9540-35e2aac3fa7e None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:09:02.028754 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f5fd8c-f0ce-4e62-9540-35e2aac3fa7e None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:09:02.028911 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f5fd8c-f0ce-4e62-9540-35e2aac3fa7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:09:02.044966 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-c1f5fd8c-f0ce-4e62-9540-35e2aac3fa7e None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:09:02.046123 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-c1f5fd8c-f0ce-4e62-9540-35e2aac3fa7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:09:02.108322 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 557/1132] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:09:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 19:09:02.131497 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd47364-384a-4fec-9c87-bc3f25b822f3 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:09:02.225683 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd47364-384a-4fec-9c87-bc3f25b822f3 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:09:02.256888 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c5e8ff-0aa5-4385-9705-df6ef341b498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:09:02.257667 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c5e8ff-0aa5-4385-9705-df6ef341b498 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:09:02.257949 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c5e8ff-0aa5-4385-9705-df6ef341b498 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:09:02.258222 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c5e8ff-0aa5-4385-9705-df6ef341b498 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:09:02.259383 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c5e8ff-0aa5-4385-9705-df6ef341b498 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:09:02.260835 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c5e8ff-0aa5-4385-9705-df6ef341b498 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:09:02.262413 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 576/1133] 10.222.0.70 () {56 vars in 1108 bytes} [Tue May 10 19:09:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:09:02.268104 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f5fd8c-f0ce-4e62-9540-35e2aac3fa7e None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:09:02.357937 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f5fd8c-f0ce-4e62-9540-35e2aac3fa7e None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:09:02.388807 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a3a4b7-1152-4487-a6d1-589913b4b527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:09:02.389441 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a3a4b7-1152-4487-a6d1-589913b4b527 None admin] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:09:02.389718 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a3a4b7-1152-4487-a6d1-589913b4b527 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:09:02.390577 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a3a4b7-1152-4487-a6d1-589913b4b527 None admin] PATH_INFO: `/v3/projects` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:09:02.391789 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a3a4b7-1152-4487-a6d1-589913b4b527 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:09:02.394377 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a3a4b7-1152-4487-a6d1-589913b4b527 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:09:02.425085 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 558/1134] 10.222.0.70 () {60 vars in 1141 bytes} [Tue May 10 19:09:02 2022] POST /identity/v3/projects => generated 311 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 19:09:04.649098 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a287e330-6f3a-4d26-894a-82d0be0f0574 None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:09:04.649619 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a287e330-6f3a-4d26-894a-82d0be0f0574 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:09:04.649725 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a287e330-6f3a-4d26-894a-82d0be0f0574 None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:09:04.651006 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 577/1135] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:09:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:09:04.656888 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410ec658-4310-487f-8957-0b9421fca0dd None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:09:04.657317 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410ec658-4310-487f-8957-0b9421fca0dd None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:09:04.657444 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410ec658-4310-487f-8957-0b9421fca0dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:09:04.674081 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-410ec658-4310-487f-8957-0b9421fca0dd None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:09:04.675662 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-410ec658-4310-487f-8957-0b9421fca0dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:09:04.738221 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 559/1136] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:09:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 19:09:04.762436 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a287e330-6f3a-4d26-894a-82d0be0f0574 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:09:04.858523 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a287e330-6f3a-4d26-894a-82d0be0f0574 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:09:04.890965 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773523c9-2414-4bc6-a1a4-c7dd3f94008c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:09:04.891743 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773523c9-2414-4bc6-a1a4-c7dd3f94008c None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:09:04.892031 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773523c9-2414-4bc6-a1a4-c7dd3f94008c None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:09:04.892303 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773523c9-2414-4bc6-a1a4-c7dd3f94008c None admin] PATH_INFO: `/v3/domains/default` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:09:04.893494 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773523c9-2414-4bc6-a1a4-c7dd3f94008c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:09:04.894927 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773523c9-2414-4bc6-a1a4-c7dd3f94008c None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:09:04.896527 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 578/1137] 10.222.0.70 () {56 vars in 1108 bytes} [Tue May 10 19:09:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:09:04.902067 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410ec658-4310-487f-8957-0b9421fca0dd None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:09:04.992945 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410ec658-4310-487f-8957-0b9421fca0dd None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:09:05.025077 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6c1584-d622-4563-bebb-0146546977a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:09:05.025734 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6c1584-d622-4563-bebb-0146546977a0 None admin] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:09:05.026017 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6c1584-d622-4563-bebb-0146546977a0 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:09:05.026290 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6c1584-d622-4563-bebb-0146546977a0 None admin] PATH_INFO: `/v3/users` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:09:05.027006 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6c1584-d622-4563-bebb-0146546977a0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:09:05.028461 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6c1584-d622-4563-bebb-0146546977a0 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:09:05.046905 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 560/1138] 10.222.0.70 () {60 vars in 1132 bytes} [Tue May 10 19:09:04 2022] POST /identity/v3/users => generated 286 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 19:09:07.285537 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb0309a-5da2-42d0-810a-294417a24c53 None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:09:07.286045 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb0309a-5da2-42d0-810a-294417a24c53 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:09:07.286045 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb0309a-5da2-42d0-810a-294417a24c53 None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:09:07.287356 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 579/1139] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:09:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:09:07.292622 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb20dfb1-0c15-44c1-a5e0-8ef40a866aaf None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:09:07.293008 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb20dfb1-0c15-44c1-a5e0-8ef40a866aaf None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:09:07.293169 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb20dfb1-0c15-44c1-a5e0-8ef40a866aaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:09:07.309063 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-fb20dfb1-0c15-44c1-a5e0-8ef40a866aaf None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:09:07.310210 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-fb20dfb1-0c15-44c1-a5e0-8ef40a866aaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:09:07.371360 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 561/1140] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:09:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 19:09:07.394570 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb0309a-5da2-42d0-810a-294417a24c53 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:09:07.488227 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb0309a-5da2-42d0-810a-294417a24c53 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:09:07.519664 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6e50f4-99fc-4942-98ce-712b3f096964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:09:07.520454 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6e50f4-99fc-4942-98ce-712b3f096964 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:09:07.520740 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6e50f4-99fc-4942-98ce-712b3f096964 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:09:07.521011 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6e50f4-99fc-4942-98ce-712b3f096964 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:09:07.531047 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6e50f4-99fc-4942-98ce-712b3f096964 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:09:07.538595 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-5b6e50f4-99fc-4942-98ce-712b3f096964 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 19:09:07.538595 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:09:07.538595 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:09:07.538595 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:09:07.538595 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:09:07.538595 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:09:07.538595 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:09:07.538595 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:09:07.538595 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:09:07.538595 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:09:07.538595 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:09:07.538595 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:09:07.538595 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:09:07.538595 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:09:07.538595 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:09:07.538595 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:09:07.539780 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:09:07.539780 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:09:07.539780 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:09:07.539780 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:09:07.539780 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:09:07.539780 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:09:07.539780 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:09:07.539780 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:09:07.539780 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:09:07.539780 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:09:07.539780 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:09:07.539780 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( May 10 19:09:07.539780 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:09:07.539780 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() May 10 19:09:07.539780 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:09:07.539780 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:09:07.540871 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:09:07.540871 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() May 10 19:09:07.540871 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:09:07.540871 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( May 10 19:09:07.540871 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:09:07.540871 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:09:07.540871 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:09:07.540871 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:09:07.540871 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:09:07.540871 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:09:07.540871 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 19:09:07.540871 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:09:07.540871 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 580/1141] 10.222.0.70 () {56 vars in 1096 bytes} [Tue May 10 19:09:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:09:07.545451 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb20dfb1-0c15-44c1-a5e0-8ef40a866aaf None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:09:07.640553 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb20dfb1-0c15-44c1-a5e0-8ef40a866aaf None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:09:07.671547 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e89102-926a-4b2f-8622-b2603bbccf84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:09:07.672193 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e89102-926a-4b2f-8622-b2603bbccf84 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:09:07.672498 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e89102-926a-4b2f-8622-b2603bbccf84 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:09:07.672770 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e89102-926a-4b2f-8622-b2603bbccf84 None admin] PATH_INFO: `/v3/roles` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:09:07.673495 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e89102-926a-4b2f-8622-b2603bbccf84 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:09:07.673792 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e89102-926a-4b2f-8622-b2603bbccf84 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:09:07.675145 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e89102-926a-4b2f-8622-b2603bbccf84 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:09:07.682609 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 562/1142] 10.222.0.70 () {56 vars in 1099 bytes} [Tue May 10 19:09:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:09:07.688357 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6e50f4-99fc-4942-98ce-712b3f096964 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:09:07.781547 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6e50f4-99fc-4942-98ce-712b3f096964 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:09:07.811928 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0cb76e-bb5f-476f-910d-2ca986f0f29b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:09:07.812744 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0cb76e-bb5f-476f-910d-2ca986f0f29b None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:09:07.813027 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0cb76e-bb5f-476f-910d-2ca986f0f29b None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:09:07.813298 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0cb76e-bb5f-476f-910d-2ca986f0f29b None admin] PATH_INFO: `/v3/users/ad5b693e3187482d99e297862d4ab82e` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:09:07.825432 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0cb76e-bb5f-476f-910d-2ca986f0f29b None admin] RBAC: Authorizing `identity:get_user(user_id=ad5b693e3187482d99e297862d4ab82e)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:09:07.826852 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0cb76e-bb5f-476f-910d-2ca986f0f29b None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:09:07.829009 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 581/1143] 10.222.0.70 () {56 vars in 1177 bytes} [Tue May 10 19:09:07 2022] GET /identity/v3/users/ad5b693e3187482d99e297862d4ab82e => generated 286 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:09:07.834901 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e89102-926a-4b2f-8622-b2603bbccf84 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:09:07.928442 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e89102-926a-4b2f-8622-b2603bbccf84 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:09:07.960292 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f663e975-2422-4167-95bc-111c9a971830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:09:07.960962 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f663e975-2422-4167-95bc-111c9a971830 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:09:07.961244 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f663e975-2422-4167-95bc-111c9a971830 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:09:07.961517 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f663e975-2422-4167-95bc-111c9a971830 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:09:08.023094 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f663e975-2422-4167-95bc-111c9a971830 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:09:08.024556 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f663e975-2422-4167-95bc-111c9a971830 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:09:08.115342 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 563/1144] 10.222.0.70 () {58 vars in 1282 bytes} [Tue May 10 19:09:07 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 10 19:09:08.121143 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0cb76e-bb5f-476f-910d-2ca986f0f29b None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:09:08.214262 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0cb76e-bb5f-476f-910d-2ca986f0f29b None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:09:08.245374 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b3bda4-a9fd-47c6-b6da-528bfd81ebb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:09:08.246217 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b3bda4-a9fd-47c6-b6da-528bfd81ebb4 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:09:08.246499 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b3bda4-a9fd-47c6-b6da-528bfd81ebb4 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:09:08.246776 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b3bda4-a9fd-47c6-b6da-528bfd81ebb4 None admin] PATH_INFO: `/v3/projects/73b337693a1143f1889f1246ec302b87` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:09:08.247942 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b3bda4-a9fd-47c6-b6da-528bfd81ebb4 None admin] RBAC: Authorizing `identity:get_project(project_id=73b337693a1143f1889f1246ec302b87)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:09:08.249914 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b3bda4-a9fd-47c6-b6da-528bfd81ebb4 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:09:08.251566 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 582/1145] 10.222.0.70 () {56 vars in 1186 bytes} [Tue May 10 19:09:08 2022] GET /identity/v3/projects/73b337693a1143f1889f1246ec302b87 => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:09:08.257415 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f663e975-2422-4167-95bc-111c9a971830 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:09:08.348235 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f663e975-2422-4167-95bc-111c9a971830 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:09:08.379724 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d77973-d090-45c5-be3e-20ca7b8f8e06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:09:08.380305 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d77973-d090-45c5-be3e-20ca7b8f8e06 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:09:08.380610 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d77973-d090-45c5-be3e-20ca7b8f8e06 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:09:08.380882 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d77973-d090-45c5-be3e-20ca7b8f8e06 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:09:08.381692 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d77973-d090-45c5-be3e-20ca7b8f8e06 None admin] RBAC: Adding query filter params (role.id=634ba284303b4626b5a0402772c68f5c, scope.project.id=73b337693a1143f1889f1246ec302b87, user.id=ad5b693e3187482d99e297862d4ab82e) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:09:08.381997 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d77973-d090-45c5-be3e-20ca7b8f8e06 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:09:08.383409 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d77973-d090-45c5-be3e-20ca7b8f8e06 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:09:08.388518 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 564/1146] 10.222.0.70 () {56 vars in 1374 bytes} [Tue May 10 19:09:08 2022] GET /identity/v3/role_assignments?user.id=ad5b693e3187482d99e297862d4ab82e&scope.project.id=73b337693a1143f1889f1246ec302b87&role.id=634ba284303b4626b5a0402772c68f5c => generated 259 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:09:10.575460 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2dcdd9-7eeb-4318-a728-61a675389f9e None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:09:10.576005 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2dcdd9-7eeb-4318-a728-61a675389f9e None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:09:10.576005 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2dcdd9-7eeb-4318-a728-61a675389f9e None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:09:10.577883 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 583/1147] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:09:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:09:10.583358 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e59aea4-a430-4213-8674-3641b4634a9c None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:09:10.583751 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e59aea4-a430-4213-8674-3641b4634a9c None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:09:10.583919 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e59aea4-a430-4213-8674-3641b4634a9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:09:10.600663 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-7e59aea4-a430-4213-8674-3641b4634a9c None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:09:10.601853 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-7e59aea4-a430-4213-8674-3641b4634a9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:09:10.663222 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 565/1148] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:09:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 19:09:10.685032 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2dcdd9-7eeb-4318-a728-61a675389f9e None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:09:10.777864 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2dcdd9-7eeb-4318-a728-61a675389f9e None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:09:10.808821 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd78269c-aebe-4664-b809-ba1b54bdd808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:09:10.809592 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd78269c-aebe-4664-b809-ba1b54bdd808 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:09:10.809868 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd78269c-aebe-4664-b809-ba1b54bdd808 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:09:10.810136 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd78269c-aebe-4664-b809-ba1b54bdd808 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:09:10.819546 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd78269c-aebe-4664-b809-ba1b54bdd808 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:09:10.827481 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-fd78269c-aebe-4664-b809-ba1b54bdd808 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 19:09:10.827481 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:09:10.827481 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:09:10.827481 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:09:10.827481 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:09:10.827481 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:09:10.827481 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:09:10.827481 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:09:10.827481 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:09:10.827481 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:09:10.827481 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:09:10.827481 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:09:10.827481 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:09:10.827481 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:09:10.827481 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:09:10.827481 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:09:10.828665 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:09:10.828665 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:09:10.828665 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:09:10.828665 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:09:10.828665 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:09:10.828665 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:09:10.828665 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:09:10.828665 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:09:10.828665 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:09:10.828665 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:09:10.828665 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:09:10.828665 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( May 10 19:09:10.828665 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:09:10.828665 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() May 10 19:09:10.828665 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:09:10.828665 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:09:10.829823 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:09:10.829823 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() May 10 19:09:10.829823 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:09:10.829823 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( May 10 19:09:10.829823 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:09:10.829823 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:09:10.829823 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:09:10.829823 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:09:10.829823 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:09:10.829823 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:09:10.829823 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 19:09:10.829823 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:09:10.829823 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 584/1149] 10.222.0.70 () {56 vars in 1096 bytes} [Tue May 10 19:09:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:09:10.834745 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e59aea4-a430-4213-8674-3641b4634a9c None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:09:10.926670 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e59aea4-a430-4213-8674-3641b4634a9c None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:09:10.958418 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6270aa-17aa-4478-bc01-2b30593410fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:09:10.959083 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6270aa-17aa-4478-bc01-2b30593410fd None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:09:10.959362 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6270aa-17aa-4478-bc01-2b30593410fd None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:09:10.959633 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6270aa-17aa-4478-bc01-2b30593410fd None admin] PATH_INFO: `/v3/roles` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:09:10.960362 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6270aa-17aa-4478-bc01-2b30593410fd None admin] RBAC: Adding query filter params (name=admin) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:09:10.960691 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6270aa-17aa-4478-bc01-2b30593410fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:09:10.962046 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6270aa-17aa-4478-bc01-2b30593410fd None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:09:10.970143 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 566/1150] 10.222.0.70 () {56 vars in 1099 bytes} [Tue May 10 19:09:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:09:10.975873 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd78269c-aebe-4664-b809-ba1b54bdd808 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:09:11.068252 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd78269c-aebe-4664-b809-ba1b54bdd808 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:09:11.099477 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d31117-e342-4698-b572-b7a711a79477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:09:11.100273 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d31117-e342-4698-b572-b7a711a79477 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:09:11.100595 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d31117-e342-4698-b572-b7a711a79477 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:09:11.100869 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d31117-e342-4698-b572-b7a711a79477 None admin] PATH_INFO: `/v3/users/ad5b693e3187482d99e297862d4ab82e` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:09:11.102024 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d31117-e342-4698-b572-b7a711a79477 None admin] RBAC: Authorizing `identity:get_user(user_id=ad5b693e3187482d99e297862d4ab82e)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:09:11.103437 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d31117-e342-4698-b572-b7a711a79477 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:09:11.105061 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 585/1151] 10.222.0.70 () {56 vars in 1177 bytes} [Tue May 10 19:09:10 2022] GET /identity/v3/users/ad5b693e3187482d99e297862d4ab82e => generated 286 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:09:11.111283 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6270aa-17aa-4478-bc01-2b30593410fd None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:09:11.203632 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6270aa-17aa-4478-bc01-2b30593410fd None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:09:11.235256 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98672fe-a989-48ae-aa26-44f360448edf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:09:11.236101 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98672fe-a989-48ae-aa26-44f360448edf None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:09:11.236381 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98672fe-a989-48ae-aa26-44f360448edf None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:09:11.236678 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98672fe-a989-48ae-aa26-44f360448edf None admin] PATH_INFO: `/v3/projects/73b337693a1143f1889f1246ec302b87` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:09:11.237830 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98672fe-a989-48ae-aa26-44f360448edf None admin] RBAC: Authorizing `identity:get_project(project_id=73b337693a1143f1889f1246ec302b87)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:09:11.239239 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98672fe-a989-48ae-aa26-44f360448edf None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:09:11.240906 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 567/1152] 10.222.0.70 () {56 vars in 1186 bytes} [Tue May 10 19:09:11 2022] GET /identity/v3/projects/73b337693a1143f1889f1246ec302b87 => generated 311 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:09:11.246503 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d31117-e342-4698-b572-b7a711a79477 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:09:11.339222 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d31117-e342-4698-b572-b7a711a79477 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:09:11.370014 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd020c80-071e-49db-a47d-a60b9751ab29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:09:11.370822 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd020c80-071e-49db-a47d-a60b9751ab29 None admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:09:11.371101 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd020c80-071e-49db-a47d-a60b9751ab29 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:09:11.371371 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd020c80-071e-49db-a47d-a60b9751ab29 None admin] PATH_INFO: `/v3/projects/73b337693a1143f1889f1246ec302b87/users/ad5b693e3187482d99e297862d4ab82e/roles/634ba284303b4626b5a0402772c68f5c` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:09:11.373312 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd020c80-071e-49db-a47d-a60b9751ab29 None admin] RBAC: Authorizing `identity:create_grant(project_id=73b337693a1143f1889f1246ec302b87, user_id=ad5b693e3187482d99e297862d4ab82e, role_id=634ba284303b4626b5a0402772c68f5c)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:09:11.374769 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd020c80-071e-49db-a47d-a60b9751ab29 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:09:11.387039 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 586/1153] 10.222.0.70 () {58 vars in 1439 bytes} [Tue May 10 19:09:11 2022] PUT /identity/v3/projects/73b337693a1143f1889f1246ec302b87/users/ad5b693e3187482d99e297862d4ab82e/roles/634ba284303b4626b5a0402772c68f5c => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:09:13.572609 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a71562-181a-4712-ae66-216a40127e04 None None] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:09:13.573136 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a71562-181a-4712-ae66-216a40127e04 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:09:13.573136 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a71562-181a-4712-ae66-216a40127e04 None None] PATH_INFO: `/` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:09:13.574497 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 568/1154] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:09:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:09:13.580310 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623c4b5f-29df-4428-aeb8-66e955eecc90 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:09:13.581001 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623c4b5f-29df-4428-aeb8-66e955eecc90 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:09:13.581141 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623c4b5f-29df-4428-aeb8-66e955eecc90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:09:13.597839 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-623c4b5f-29df-4428-aeb8-66e955eecc90 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:09:13.599022 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-623c4b5f-29df-4428-aeb8-66e955eecc90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:09:13.661219 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 587/1155] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:09:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 19:09:13.683746 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a71562-181a-4712-ae66-216a40127e04 None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:09:13.778972 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a71562-181a-4712-ae66-216a40127e04 None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:09:13.809924 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ebac79-7304-49bb-beae-0b043a022720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:09:13.810704 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ebac79-7304-49bb-beae-0b043a022720 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:09:13.810985 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ebac79-7304-49bb-beae-0b043a022720 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:09:13.811286 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ebac79-7304-49bb-beae-0b043a022720 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:09:13.821157 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ebac79-7304-49bb-beae-0b043a022720 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:09:13.829583 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application [None req-a9ebac79-7304-49bb-beae-0b043a022720 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 19:09:13.829583 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:09:13.829583 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:09:13.829583 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:09:13.829583 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:09:13.829583 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:09:13.829583 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:09:13.829583 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:09:13.829583 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:09:13.829583 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:09:13.829583 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:09:13.829583 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:09:13.829583 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:09:13.829583 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:09:13.829583 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:09:13.829583 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:09:13.830955 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:09:13.830955 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:09:13.830955 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:09:13.830955 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:09:13.830955 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:09:13.830955 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:09:13.830955 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:09:13.830955 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:09:13.830955 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:09:13.830955 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:09:13.830955 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:09:13.830955 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application with Lock( May 10 19:09:13.830955 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:09:13.830955 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._enter() May 10 19:09:13.830955 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:09:13.830955 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:09:13.832118 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:09:13.832118 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.creator() May 10 19:09:13.832118 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:09:13.832118 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application created_value = creator( May 10 19:09:13.832118 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:09:13.832118 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:09:13.832118 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:09:13.832118 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:09:13.832118 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:09:13.832118 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:09:13.832118 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 19:09:13.832118 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application May 10 19:09:13.832118 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 569/1156] 10.222.0.70 () {56 vars in 1096 bytes} [Tue May 10 19:09:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:09:13.836977 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623c4b5f-29df-4428-aeb8-66e955eecc90 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:09:13.928508 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623c4b5f-29df-4428-aeb8-66e955eecc90 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:09:13.963102 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26923145-6986-4fc3-ac94-07b6e136d23b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:09:13.963767 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26923145-6986-4fc3-ac94-07b6e136d23b None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:09:13.964051 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26923145-6986-4fc3-ac94-07b6e136d23b None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:09:13.964327 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26923145-6986-4fc3-ac94-07b6e136d23b None admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:09:13.965099 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26923145-6986-4fc3-ac94-07b6e136d23b None admin] RBAC: Adding query filter params (name=admin) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:09:13.965405 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26923145-6986-4fc3-ac94-07b6e136d23b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:09:13.966758 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26923145-6986-4fc3-ac94-07b6e136d23b None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:09:13.974922 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 588/1157] 10.222.0.70 () {56 vars in 1099 bytes} [Tue May 10 19:09:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:09:13.980748 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ebac79-7304-49bb-beae-0b043a022720 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:09:14.072900 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ebac79-7304-49bb-beae-0b043a022720 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:09:14.104329 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8cae88-e482-4b21-8f8f-e0477fbcbfa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:09:14.105288 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8cae88-e482-4b21-8f8f-e0477fbcbfa4 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:09:14.105569 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8cae88-e482-4b21-8f8f-e0477fbcbfa4 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:09:14.105841 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8cae88-e482-4b21-8f8f-e0477fbcbfa4 None admin] PATH_INFO: `/v3/users/ad5b693e3187482d99e297862d4ab82e` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:09:14.107097 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8cae88-e482-4b21-8f8f-e0477fbcbfa4 None admin] RBAC: Authorizing `identity:get_user(user_id=ad5b693e3187482d99e297862d4ab82e)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:09:14.108701 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8cae88-e482-4b21-8f8f-e0477fbcbfa4 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:09:14.110321 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 570/1158] 10.222.0.70 () {56 vars in 1177 bytes} [Tue May 10 19:09:13 2022] GET /identity/v3/users/ad5b693e3187482d99e297862d4ab82e => generated 286 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:09:14.115813 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26923145-6986-4fc3-ac94-07b6e136d23b None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:09:14.209989 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26923145-6986-4fc3-ac94-07b6e136d23b None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:09:14.240516 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a279ec6a-9587-4474-b1d2-a571f32d91ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:09:14.241147 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a279ec6a-9587-4474-b1d2-a571f32d91ba None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:09:14.241427 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a279ec6a-9587-4474-b1d2-a571f32d91ba None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:09:14.241699 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a279ec6a-9587-4474-b1d2-a571f32d91ba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:09:14.303582 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a279ec6a-9587-4474-b1d2-a571f32d91ba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:09:14.305049 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a279ec6a-9587-4474-b1d2-a571f32d91ba None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:09:14.395760 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 589/1159] 10.222.0.70 () {58 vars in 1282 bytes} [Tue May 10 19:09:14 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 19:09:14.401498 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8cae88-e482-4b21-8f8f-e0477fbcbfa4 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:09:14.492802 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8cae88-e482-4b21-8f8f-e0477fbcbfa4 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:09:14.523773 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5b1576-224e-4941-976a-5e38278f7d4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:09:14.524630 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5b1576-224e-4941-976a-5e38278f7d4e None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:09:14.524905 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5b1576-224e-4941-976a-5e38278f7d4e None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:09:14.525171 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5b1576-224e-4941-976a-5e38278f7d4e None admin] PATH_INFO: `/v3/projects/73b337693a1143f1889f1246ec302b87` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:09:14.526314 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5b1576-224e-4941-976a-5e38278f7d4e None admin] RBAC: Authorizing `identity:get_project(project_id=73b337693a1143f1889f1246ec302b87)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:09:14.527724 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5b1576-224e-4941-976a-5e38278f7d4e None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:09:14.529366 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 571/1160] 10.222.0.70 () {56 vars in 1186 bytes} [Tue May 10 19:09:14 2022] GET /identity/v3/projects/73b337693a1143f1889f1246ec302b87 => generated 311 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:09:14.535840 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a279ec6a-9587-4474-b1d2-a571f32d91ba None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:09:14.627350 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a279ec6a-9587-4474-b1d2-a571f32d91ba None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:09:14.659586 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f5457e-1788-4547-9860-00d5ab048f40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:09:14.660169 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f5457e-1788-4547-9860-00d5ab048f40 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:09:14.660482 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f5457e-1788-4547-9860-00d5ab048f40 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:09:14.660755 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f5457e-1788-4547-9860-00d5ab048f40 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:09:14.661564 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f5457e-1788-4547-9860-00d5ab048f40 None admin] RBAC: Adding query filter params (role.id=634ba284303b4626b5a0402772c68f5c, scope.project.id=73b337693a1143f1889f1246ec302b87, user.id=ad5b693e3187482d99e297862d4ab82e) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:09:14.661869 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f5457e-1788-4547-9860-00d5ab048f40 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:09:14.663280 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f5457e-1788-4547-9860-00d5ab048f40 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:09:14.668763 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 590/1161] 10.222.0.70 () {56 vars in 1374 bytes} [Tue May 10 19:09:14 2022] GET /identity/v3/role_assignments?user.id=ad5b693e3187482d99e297862d4ab82e&scope.project.id=73b337693a1143f1889f1246ec302b87&role.id=634ba284303b4626b5a0402772c68f5c => generated 608 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:09:16.879753 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27153e1a-ef22-41e4-bcb3-4a13a51adbf4 None None] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:09:16.880276 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27153e1a-ef22-41e4-bcb3-4a13a51adbf4 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:09:16.880276 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27153e1a-ef22-41e4-bcb3-4a13a51adbf4 None None] PATH_INFO: `/` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:09:16.881664 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 572/1162] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:09:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:09:16.886804 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db8d11d-b105-4f0e-9374-9c599b946eac None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:09:16.887539 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db8d11d-b105-4f0e-9374-9c599b946eac None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:09:16.887816 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db8d11d-b105-4f0e-9374-9c599b946eac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:09:16.904371 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-4db8d11d-b105-4f0e-9374-9c599b946eac None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:09:16.905608 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-4db8d11d-b105-4f0e-9374-9c599b946eac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:09:16.967803 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 591/1163] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:09:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 19:09:16.990939 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27153e1a-ef22-41e4-bcb3-4a13a51adbf4 None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:09:17.085406 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27153e1a-ef22-41e4-bcb3-4a13a51adbf4 None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:09:17.116719 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8ae2f0-e7bd-4a45-9b36-e2e309aca4ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:09:17.117343 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8ae2f0-e7bd-4a45-9b36-e2e309aca4ce None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:09:17.117627 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8ae2f0-e7bd-4a45-9b36-e2e309aca4ce None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:09:17.117900 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8ae2f0-e7bd-4a45-9b36-e2e309aca4ce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:09:17.179441 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8ae2f0-e7bd-4a45-9b36-e2e309aca4ce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:09:17.180839 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8ae2f0-e7bd-4a45-9b36-e2e309aca4ce None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:09:17.271111 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 573/1164] 10.222.0.70 () {58 vars in 1282 bytes} [Tue May 10 19:09:16 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 19:09:17.277109 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db8d11d-b105-4f0e-9374-9c599b946eac None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:09:17.368988 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db8d11d-b105-4f0e-9374-9c599b946eac None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:09:17.400921 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1378cf2c-e6a9-43ff-b7ed-659ec05f12fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:09:17.401706 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1378cf2c-e6a9-43ff-b7ed-659ec05f12fd None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:09:17.401992 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1378cf2c-e6a9-43ff-b7ed-659ec05f12fd None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:09:17.402268 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1378cf2c-e6a9-43ff-b7ed-659ec05f12fd None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:09:17.408621 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1378cf2c-e6a9-43ff-b7ed-659ec05f12fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:09:17.410045 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1378cf2c-e6a9-43ff-b7ed-659ec05f12fd None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:09:17.423661 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-1378cf2c-e6a9-43ff-b7ed-659ec05f12fd None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. May 10 19:09:17.423661 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:09:17.423661 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 10 19:09:17.423661 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 10 19:09:17.423661 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 19:09:17.423661 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 19:09:17.423661 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 19:09:17.423661 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 19:09:17.423661 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. May 10 19:09:17.423661 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:09:17.423661 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 19:09:17.423661 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:09:17.423661 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:09:17.423661 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:09:17.423661 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:09:17.423661 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:09:17.423661 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:09:17.424886 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:09:17.424886 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:09:17.424886 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:09:17.424886 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:09:17.424886 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:09:17.424886 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:09:17.424886 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 19:09:17.424886 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 19:09:17.424886 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 19:09:17.424886 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 19:09:17.424886 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:09:17.424886 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:09:17.424886 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:09:17.424886 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:09:17.424886 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:09:17.424886 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:09:17.426133 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:09:17.426133 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( May 10 19:09:17.426133 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:09:17.426133 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() May 10 19:09:17.426133 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:09:17.426133 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:09:17.426133 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:09:17.426133 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() May 10 19:09:17.426133 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:09:17.426133 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( May 10 19:09:17.426133 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 10 19:09:17.426133 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 19:09:17.426133 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. May 10 19:09:17.426133 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:09:17.426133 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 592/1165] 10.222.0.70 () {56 vars in 1117 bytes} [Tue May 10 19:09:17 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:09:17.430590 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8ae2f0-e7bd-4a45-9b36-e2e309aca4ce None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:09:17.521936 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8ae2f0-e7bd-4a45-9b36-e2e309aca4ce None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:09:17.552995 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cea581-8450-4e99-ab7c-3dabedb5aa7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:09:17.553635 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cea581-8450-4e99-ab7c-3dabedb5aa7b None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:09:17.553922 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cea581-8450-4e99-ab7c-3dabedb5aa7b None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:09:17.554192 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cea581-8450-4e99-ab7c-3dabedb5aa7b None admin] PATH_INFO: `/v3/domains` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:09:17.554888 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cea581-8450-4e99-ab7c-3dabedb5aa7b None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:09:17.555188 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cea581-8450-4e99-ab7c-3dabedb5aa7b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:09:17.556562 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cea581-8450-4e99-ab7c-3dabedb5aa7b None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:09:17.563731 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 574/1166] 10.222.0.70 () {56 vars in 1115 bytes} [Tue May 10 19:09:17 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:09:19.727077 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d32318-23f4-4da3-8d48-205289f2b9b0 None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:09:19.727704 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d32318-23f4-4da3-8d48-205289f2b9b0 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:09:19.727704 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d32318-23f4-4da3-8d48-205289f2b9b0 None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:09:19.728996 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 593/1167] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:09:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:09:19.734183 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d1502a-804a-4c7f-8757-d84a4c6458f6 None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:09:19.734615 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d1502a-804a-4c7f-8757-d84a4c6458f6 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:09:19.734747 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d1502a-804a-4c7f-8757-d84a4c6458f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:09:19.751299 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-f8d1502a-804a-4c7f-8757-d84a4c6458f6 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:09:19.752485 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-f8d1502a-804a-4c7f-8757-d84a4c6458f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:09:19.821107 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 575/1168] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:09:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 19:09:19.843918 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d32318-23f4-4da3-8d48-205289f2b9b0 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:09:19.952116 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d32318-23f4-4da3-8d48-205289f2b9b0 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:09:19.983752 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6251898c-5eaa-4b4f-a3ff-2bac5b073ba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:09:19.984340 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6251898c-5eaa-4b4f-a3ff-2bac5b073ba1 None admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:09:19.984768 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6251898c-5eaa-4b4f-a3ff-2bac5b073ba1 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:09:19.985040 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6251898c-5eaa-4b4f-a3ff-2bac5b073ba1 None admin] PATH_INFO: `/v3/domains` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:09:19.985777 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6251898c-5eaa-4b4f-a3ff-2bac5b073ba1 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:09:19.987126 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6251898c-5eaa-4b4f-a3ff-2bac5b073ba1 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:09:20.001649 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 594/1169] 10.222.0.70 () {60 vars in 1138 bytes} [Tue May 10 19:09:19 2022] POST /identity/v3/domains => generated 267 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:09:22.236252 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5948da97-5ab0-4005-85d8-373405b124cf None None] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:09:22.236834 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5948da97-5ab0-4005-85d8-373405b124cf None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:09:22.236834 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5948da97-5ab0-4005-85d8-373405b124cf None None] PATH_INFO: `/` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:09:22.238112 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 576/1170] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:09:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:09:22.243323 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263ac2ea-5774-40fc-8da4-e84593ebcabc None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:09:22.243744 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263ac2ea-5774-40fc-8da4-e84593ebcabc None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:09:22.243886 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263ac2ea-5774-40fc-8da4-e84593ebcabc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:09:22.259980 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-263ac2ea-5774-40fc-8da4-e84593ebcabc None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:09:22.261207 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-263ac2ea-5774-40fc-8da4-e84593ebcabc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:09:22.322787 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 595/1171] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:09:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 19:09:22.346767 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5948da97-5ab0-4005-85d8-373405b124cf None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:09:22.439863 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5948da97-5ab0-4005-85d8-373405b124cf None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:09:22.471187 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac12593-fc88-4b18-ba7e-538f2df1cc92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:09:22.472022 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac12593-fc88-4b18-ba7e-538f2df1cc92 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:09:22.472305 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac12593-fc88-4b18-ba7e-538f2df1cc92 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:09:22.472606 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac12593-fc88-4b18-ba7e-538f2df1cc92 None admin] PATH_INFO: `/v3/domains/a99b8942c8784f899236c4f6e1528871` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:09:22.482222 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac12593-fc88-4b18-ba7e-538f2df1cc92 None admin] RBAC: Authorizing `identity:get_domain(domain_id=a99b8942c8784f899236c4f6e1528871)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:09:22.484196 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac12593-fc88-4b18-ba7e-538f2df1cc92 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:09:22.485803 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 577/1172] 10.222.0.70 () {56 vars in 1183 bytes} [Tue May 10 19:09:22 2022] GET /identity/v3/domains/a99b8942c8784f899236c4f6e1528871 => generated 267 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:09:22.491418 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263ac2ea-5774-40fc-8da4-e84593ebcabc None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:09:22.583801 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263ac2ea-5774-40fc-8da4-e84593ebcabc None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:09:22.615162 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25665135-72ef-4f39-bea4-8aedc5cb3288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:09:22.615807 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25665135-72ef-4f39-bea4-8aedc5cb3288 None admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:09:22.616090 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25665135-72ef-4f39-bea4-8aedc5cb3288 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:09:22.616364 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25665135-72ef-4f39-bea4-8aedc5cb3288 None admin] PATH_INFO: `/v3/projects` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:09:22.617089 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25665135-72ef-4f39-bea4-8aedc5cb3288 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:09:22.618494 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25665135-72ef-4f39-bea4-8aedc5cb3288 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:09:22.643510 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 596/1173] 10.222.0.70 () {60 vars in 1141 bytes} [Tue May 10 19:09:22 2022] POST /identity/v3/projects => generated 361 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:09:24.852594 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4aba9c-60f9-43ef-be43-c07eeda765a6 None None] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:09:24.853142 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4aba9c-60f9-43ef-be43-c07eeda765a6 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:09:24.853142 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4aba9c-60f9-43ef-be43-c07eeda765a6 None None] PATH_INFO: `/` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:09:24.854490 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 578/1174] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:09:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:09:24.859662 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1087e823-2df8-4af2-bf27-cf35fd207125 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:09:24.860075 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1087e823-2df8-4af2-bf27-cf35fd207125 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:09:24.860222 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1087e823-2df8-4af2-bf27-cf35fd207125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:09:24.876857 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-1087e823-2df8-4af2-bf27-cf35fd207125 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:09:24.878019 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-1087e823-2df8-4af2-bf27-cf35fd207125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:09:24.939288 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 597/1175] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:09:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 19:09:24.965121 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4aba9c-60f9-43ef-be43-c07eeda765a6 None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:09:25.059138 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4aba9c-60f9-43ef-be43-c07eeda765a6 None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:09:25.090827 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f472104b-923d-4fb5-a910-676a799ddc26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:09:25.091676 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f472104b-923d-4fb5-a910-676a799ddc26 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:09:25.091987 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f472104b-923d-4fb5-a910-676a799ddc26 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:09:25.092283 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f472104b-923d-4fb5-a910-676a799ddc26 None admin] PATH_INFO: `/v3/domains/a99b8942c8784f899236c4f6e1528871` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:09:25.093465 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f472104b-923d-4fb5-a910-676a799ddc26 None admin] RBAC: Authorizing `identity:get_domain(domain_id=a99b8942c8784f899236c4f6e1528871)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:09:25.094883 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f472104b-923d-4fb5-a910-676a799ddc26 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:09:25.096450 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 579/1176] 10.222.0.70 () {56 vars in 1183 bytes} [Tue May 10 19:09:24 2022] GET /identity/v3/domains/a99b8942c8784f899236c4f6e1528871 => generated 267 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:09:25.102042 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1087e823-2df8-4af2-bf27-cf35fd207125 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:09:25.193001 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1087e823-2df8-4af2-bf27-cf35fd207125 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:09:25.224721 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5cf3de-46a5-411e-904d-d89268fc3909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:09:25.225373 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5cf3de-46a5-411e-904d-d89268fc3909 None admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:09:25.225650 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5cf3de-46a5-411e-904d-d89268fc3909 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:09:25.225919 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5cf3de-46a5-411e-904d-d89268fc3909 None admin] PATH_INFO: `/v3/users` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:09:25.226609 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5cf3de-46a5-411e-904d-d89268fc3909 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:09:25.228023 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5cf3de-46a5-411e-904d-d89268fc3909 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:09:25.246498 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 598/1177] 10.222.0.70 () {60 vars in 1132 bytes} [Tue May 10 19:09:25 2022] POST /identity/v3/users => generated 311 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:09:27.507404 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b66bf20-0d68-468a-be6a-a06f446e902f None None] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:09:27.507938 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b66bf20-0d68-468a-be6a-a06f446e902f None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:09:27.507938 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b66bf20-0d68-468a-be6a-a06f446e902f None None] PATH_INFO: `/` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:09:27.509327 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 580/1178] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:09:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:09:27.514435 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b18b1a0-10ec-403f-af47-603a9fbdebe8 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:09:27.514866 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b18b1a0-10ec-403f-af47-603a9fbdebe8 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:09:27.514999 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b18b1a0-10ec-403f-af47-603a9fbdebe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:09:27.531136 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-8b18b1a0-10ec-403f-af47-603a9fbdebe8 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:09:27.532306 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-8b18b1a0-10ec-403f-af47-603a9fbdebe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:09:27.595200 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 599/1179] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:09:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 19:09:27.619028 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b66bf20-0d68-468a-be6a-a06f446e902f None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:09:27.713782 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b66bf20-0d68-468a-be6a-a06f446e902f None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:09:27.745858 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420b4f24-43d7-4f3c-87d0-57bba09ce6a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:09:27.746637 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420b4f24-43d7-4f3c-87d0-57bba09ce6a8 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:09:27.746917 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420b4f24-43d7-4f3c-87d0-57bba09ce6a8 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:09:27.747186 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420b4f24-43d7-4f3c-87d0-57bba09ce6a8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:09:27.757663 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420b4f24-43d7-4f3c-87d0-57bba09ce6a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:09:27.765046 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application [None req-420b4f24-43d7-4f3c-87d0-57bba09ce6a8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 19:09:27.765046 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:09:27.765046 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:09:27.765046 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:09:27.765046 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:09:27.765046 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:09:27.765046 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:09:27.765046 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:09:27.765046 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:09:27.765046 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:09:27.765046 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:09:27.765046 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:09:27.765046 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:09:27.765046 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:09:27.765046 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:09:27.765046 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:09:27.766207 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:09:27.766207 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:09:27.766207 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:09:27.766207 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:09:27.766207 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:09:27.766207 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:09:27.766207 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:09:27.766207 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:09:27.766207 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:09:27.766207 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:09:27.766207 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:09:27.766207 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application with Lock( May 10 19:09:27.766207 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:09:27.766207 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._enter() May 10 19:09:27.766207 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:09:27.766207 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:09:27.767301 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:09:27.767301 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.creator() May 10 19:09:27.767301 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:09:27.767301 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application created_value = creator( May 10 19:09:27.767301 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:09:27.767301 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:09:27.767301 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:09:27.767301 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:09:27.767301 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:09:27.767301 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:09:27.767301 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 19:09:27.767301 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application May 10 19:09:27.767301 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 581/1180] 10.222.0.70 () {56 vars in 1096 bytes} [Tue May 10 19:09:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:09:27.771927 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b18b1a0-10ec-403f-af47-603a9fbdebe8 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:09:27.866313 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b18b1a0-10ec-403f-af47-603a9fbdebe8 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:09:27.899533 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd3f367-309d-406e-ba86-20a88d1c7891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:09:27.900190 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd3f367-309d-406e-ba86-20a88d1c7891 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:09:27.900497 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd3f367-309d-406e-ba86-20a88d1c7891 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:09:27.900773 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd3f367-309d-406e-ba86-20a88d1c7891 None admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:09:27.901507 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd3f367-309d-406e-ba86-20a88d1c7891 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:09:27.901820 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd3f367-309d-406e-ba86-20a88d1c7891 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:09:27.903165 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd3f367-309d-406e-ba86-20a88d1c7891 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:09:27.911224 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 600/1181] 10.222.0.70 () {56 vars in 1099 bytes} [Tue May 10 19:09:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:09:27.916915 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420b4f24-43d7-4f3c-87d0-57bba09ce6a8 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:09:28.010312 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420b4f24-43d7-4f3c-87d0-57bba09ce6a8 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:09:28.042461 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bc34e1-8690-4df5-8761-1de097465f63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:09:28.043310 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bc34e1-8690-4df5-8761-1de097465f63 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:09:28.043589 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bc34e1-8690-4df5-8761-1de097465f63 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:09:28.043858 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bc34e1-8690-4df5-8761-1de097465f63 None admin] PATH_INFO: `/v3/users/82f97949316c4326ab088b3464f1366e` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:09:28.056538 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bc34e1-8690-4df5-8761-1de097465f63 None admin] RBAC: Authorizing `identity:get_user(user_id=82f97949316c4326ab088b3464f1366e)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:09:28.057968 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bc34e1-8690-4df5-8761-1de097465f63 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:09:28.059561 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 582/1182] 10.222.0.70 () {56 vars in 1177 bytes} [Tue May 10 19:09:27 2022] GET /identity/v3/users/82f97949316c4326ab088b3464f1366e => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:09:28.065184 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd3f367-309d-406e-ba86-20a88d1c7891 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:09:28.157606 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd3f367-309d-406e-ba86-20a88d1c7891 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:09:28.188657 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c925db61-bbb8-498c-8e5b-c4a27d1f469b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:09:28.189290 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c925db61-bbb8-498c-8e5b-c4a27d1f469b None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:09:28.189570 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c925db61-bbb8-498c-8e5b-c4a27d1f469b None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:09:28.189842 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c925db61-bbb8-498c-8e5b-c4a27d1f469b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:09:28.251476 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c925db61-bbb8-498c-8e5b-c4a27d1f469b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:09:28.252946 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c925db61-bbb8-498c-8e5b-c4a27d1f469b None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:09:28.349879 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 601/1183] 10.222.0.70 () {58 vars in 1282 bytes} [Tue May 10 19:09:28 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 19:09:28.355650 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bc34e1-8690-4df5-8761-1de097465f63 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:09:28.446521 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bc34e1-8690-4df5-8761-1de097465f63 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:09:28.478313 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d4d04b-0919-402f-b112-9b0c8aa044d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:09:28.479152 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d4d04b-0919-402f-b112-9b0c8aa044d6 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:09:28.479429 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d4d04b-0919-402f-b112-9b0c8aa044d6 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:09:28.479697 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d4d04b-0919-402f-b112-9b0c8aa044d6 None admin] PATH_INFO: `/v3/projects/f796a27b151c41258e83896371ff83e7` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:09:28.480855 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d4d04b-0919-402f-b112-9b0c8aa044d6 None admin] RBAC: Authorizing `identity:get_project(project_id=f796a27b151c41258e83896371ff83e7)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:09:28.482292 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d4d04b-0919-402f-b112-9b0c8aa044d6 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:09:28.483916 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 583/1184] 10.222.0.70 () {56 vars in 1186 bytes} [Tue May 10 19:09:28 2022] GET /identity/v3/projects/f796a27b151c41258e83896371ff83e7 => generated 361 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:09:28.490071 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c925db61-bbb8-498c-8e5b-c4a27d1f469b None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:09:28.583204 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c925db61-bbb8-498c-8e5b-c4a27d1f469b None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:09:28.615006 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29727348-4138-45c2-a389-ac9747e66def None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:09:28.615586 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29727348-4138-45c2-a389-ac9747e66def None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:09:28.615868 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29727348-4138-45c2-a389-ac9747e66def None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:09:28.616142 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29727348-4138-45c2-a389-ac9747e66def None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:09:28.616991 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29727348-4138-45c2-a389-ac9747e66def None admin] RBAC: Adding query filter params (role.id=634ba284303b4626b5a0402772c68f5c, scope.project.id=f796a27b151c41258e83896371ff83e7, user.id=82f97949316c4326ab088b3464f1366e) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:09:28.617302 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29727348-4138-45c2-a389-ac9747e66def None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:09:28.618723 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29727348-4138-45c2-a389-ac9747e66def None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:09:28.624360 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 602/1185] 10.222.0.70 () {56 vars in 1374 bytes} [Tue May 10 19:09:28 2022] GET /identity/v3/role_assignments?user.id=82f97949316c4326ab088b3464f1366e&scope.project.id=f796a27b151c41258e83896371ff83e7&role.id=634ba284303b4626b5a0402772c68f5c => generated 259 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:09:30.826478 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586b3d61-c54b-436f-97d0-729e9d4e88a0 None None] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:09:30.827006 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586b3d61-c54b-436f-97d0-729e9d4e88a0 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:09:30.827006 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586b3d61-c54b-436f-97d0-729e9d4e88a0 None None] PATH_INFO: `/` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:09:30.828337 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 584/1186] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:09:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:09:30.833808 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bab48c8-3305-408b-90fe-1fb80c2a4a73 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:09:30.834230 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bab48c8-3305-408b-90fe-1fb80c2a4a73 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:09:30.834360 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bab48c8-3305-408b-90fe-1fb80c2a4a73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:09:30.850904 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-9bab48c8-3305-408b-90fe-1fb80c2a4a73 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:09:30.852065 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-9bab48c8-3305-408b-90fe-1fb80c2a4a73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:09:30.912829 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 603/1187] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:09:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 19:09:30.934444 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586b3d61-c54b-436f-97d0-729e9d4e88a0 None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:09:31.029754 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586b3d61-c54b-436f-97d0-729e9d4e88a0 None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:09:31.060949 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1d59b3-de37-450a-80ec-ac07d7e407d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:09:31.061736 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1d59b3-de37-450a-80ec-ac07d7e407d7 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:09:31.062019 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1d59b3-de37-450a-80ec-ac07d7e407d7 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:09:31.062291 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1d59b3-de37-450a-80ec-ac07d7e407d7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:09:31.071979 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1d59b3-de37-450a-80ec-ac07d7e407d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:09:31.083739 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application [None req-0d1d59b3-de37-450a-80ec-ac07d7e407d7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 19:09:31.083739 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:09:31.083739 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:09:31.083739 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:09:31.083739 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:09:31.083739 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:09:31.083739 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:09:31.083739 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:09:31.083739 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:09:31.083739 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:09:31.083739 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:09:31.083739 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:09:31.083739 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:09:31.083739 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:09:31.083739 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:09:31.083739 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:09:31.084925 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:09:31.084925 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:09:31.084925 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:09:31.084925 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:09:31.084925 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:09:31.084925 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:09:31.084925 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:09:31.084925 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:09:31.084925 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:09:31.084925 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:09:31.084925 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:09:31.084925 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application with Lock( May 10 19:09:31.084925 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:09:31.084925 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._enter() May 10 19:09:31.084925 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:09:31.084925 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:09:31.085787 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:09:31.085787 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.creator() May 10 19:09:31.085787 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:09:31.085787 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application created_value = creator( May 10 19:09:31.085787 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:09:31.085787 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:09:31.085787 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:09:31.085787 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:09:31.085787 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:09:31.085787 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:09:31.085787 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 19:09:31.085787 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application May 10 19:09:31.085787 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 585/1188] 10.222.0.70 () {56 vars in 1096 bytes} [Tue May 10 19:09:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:09:31.091811 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bab48c8-3305-408b-90fe-1fb80c2a4a73 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:09:31.183605 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bab48c8-3305-408b-90fe-1fb80c2a4a73 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:09:31.216051 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1816ed3a-0599-4efe-926b-a4c031ecfb62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:09:31.216810 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1816ed3a-0599-4efe-926b-a4c031ecfb62 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:09:31.217093 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1816ed3a-0599-4efe-926b-a4c031ecfb62 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:09:31.217370 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1816ed3a-0599-4efe-926b-a4c031ecfb62 None admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:09:31.218104 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1816ed3a-0599-4efe-926b-a4c031ecfb62 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:09:31.218410 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1816ed3a-0599-4efe-926b-a4c031ecfb62 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:09:31.219773 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1816ed3a-0599-4efe-926b-a4c031ecfb62 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:09:31.227346 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 604/1189] 10.222.0.70 () {56 vars in 1099 bytes} [Tue May 10 19:09:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:09:31.233596 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1d59b3-de37-450a-80ec-ac07d7e407d7 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:09:31.326113 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1d59b3-de37-450a-80ec-ac07d7e407d7 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:09:31.356744 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab3e88e-49dc-408d-b700-4685496edbe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:09:31.358025 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab3e88e-49dc-408d-b700-4685496edbe8 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:09:31.358301 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab3e88e-49dc-408d-b700-4685496edbe8 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:09:31.358636 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab3e88e-49dc-408d-b700-4685496edbe8 None admin] PATH_INFO: `/v3/users/82f97949316c4326ab088b3464f1366e` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:09:31.359913 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab3e88e-49dc-408d-b700-4685496edbe8 None admin] RBAC: Authorizing `identity:get_user(user_id=82f97949316c4326ab088b3464f1366e)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:09:31.361361 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab3e88e-49dc-408d-b700-4685496edbe8 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:09:31.362934 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 586/1190] 10.222.0.70 () {56 vars in 1177 bytes} [Tue May 10 19:09:31 2022] GET /identity/v3/users/82f97949316c4326ab088b3464f1366e => generated 311 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:09:31.369096 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1816ed3a-0599-4efe-926b-a4c031ecfb62 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:09:31.470835 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1816ed3a-0599-4efe-926b-a4c031ecfb62 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:09:31.501646 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83cae99-7d5a-4802-b21e-08ffd7813b57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:09:31.502496 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83cae99-7d5a-4802-b21e-08ffd7813b57 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:09:31.502777 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83cae99-7d5a-4802-b21e-08ffd7813b57 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:09:31.503051 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83cae99-7d5a-4802-b21e-08ffd7813b57 None admin] PATH_INFO: `/v3/projects/f796a27b151c41258e83896371ff83e7` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:09:31.504218 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83cae99-7d5a-4802-b21e-08ffd7813b57 None admin] RBAC: Authorizing `identity:get_project(project_id=f796a27b151c41258e83896371ff83e7)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:09:31.505680 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83cae99-7d5a-4802-b21e-08ffd7813b57 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:09:31.507354 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 605/1191] 10.222.0.70 () {56 vars in 1186 bytes} [Tue May 10 19:09:31 2022] GET /identity/v3/projects/f796a27b151c41258e83896371ff83e7 => generated 361 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:09:31.513282 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab3e88e-49dc-408d-b700-4685496edbe8 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:09:31.606511 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab3e88e-49dc-408d-b700-4685496edbe8 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:09:31.637599 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d961c1-a205-480e-aa1f-fffe9cd88eb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:09:31.638467 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d961c1-a205-480e-aa1f-fffe9cd88eb2 None admin] REQUEST_METHOD: `PUT` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:09:31.638755 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d961c1-a205-480e-aa1f-fffe9cd88eb2 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:09:31.639033 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d961c1-a205-480e-aa1f-fffe9cd88eb2 None admin] PATH_INFO: `/v3/projects/f796a27b151c41258e83896371ff83e7/users/82f97949316c4326ab088b3464f1366e/roles/634ba284303b4626b5a0402772c68f5c` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:09:31.640978 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d961c1-a205-480e-aa1f-fffe9cd88eb2 None admin] RBAC: Authorizing `identity:create_grant(project_id=f796a27b151c41258e83896371ff83e7, user_id=82f97949316c4326ab088b3464f1366e, role_id=634ba284303b4626b5a0402772c68f5c)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:09:31.642408 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d961c1-a205-480e-aa1f-fffe9cd88eb2 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:09:31.656265 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 587/1192] 10.222.0.70 () {58 vars in 1439 bytes} [Tue May 10 19:09:31 2022] PUT /identity/v3/projects/f796a27b151c41258e83896371ff83e7/users/82f97949316c4326ab088b3464f1366e/roles/634ba284303b4626b5a0402772c68f5c => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:09:33.844991 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59197518-34be-4e57-a4b1-39e825114f94 None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:09:33.845535 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59197518-34be-4e57-a4b1-39e825114f94 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:09:33.845535 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59197518-34be-4e57-a4b1-39e825114f94 None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:09:33.846928 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 606/1193] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:09:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:09:33.852135 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738e0c9a-9943-475e-a14a-e2a01cc5df5d None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:09:33.852569 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738e0c9a-9943-475e-a14a-e2a01cc5df5d None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:09:33.852719 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738e0c9a-9943-475e-a14a-e2a01cc5df5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:09:33.869274 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-738e0c9a-9943-475e-a14a-e2a01cc5df5d None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:09:33.870427 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-738e0c9a-9943-475e-a14a-e2a01cc5df5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:09:33.931436 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 588/1194] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:09:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 19:09:33.955008 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59197518-34be-4e57-a4b1-39e825114f94 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:09:34.054620 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59197518-34be-4e57-a4b1-39e825114f94 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:09:34.086048 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d58429d-326d-47a4-94b1-b3ac488b987e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:09:34.086828 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d58429d-326d-47a4-94b1-b3ac488b987e None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:09:34.087113 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d58429d-326d-47a4-94b1-b3ac488b987e None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:09:34.087387 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d58429d-326d-47a4-94b1-b3ac488b987e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:09:34.097930 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d58429d-326d-47a4-94b1-b3ac488b987e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:09:34.105340 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-8d58429d-326d-47a4-94b1-b3ac488b987e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 19:09:34.105340 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:09:34.105340 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:09:34.105340 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:09:34.105340 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:09:34.105340 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:09:34.105340 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:09:34.105340 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:09:34.105340 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:09:34.105340 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:09:34.105340 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:09:34.105340 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:09:34.105340 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:09:34.105340 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:09:34.105340 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:09:34.105340 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:09:34.106441 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:09:34.106441 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:09:34.106441 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:09:34.106441 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:09:34.106441 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:09:34.106441 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:09:34.106441 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:09:34.106441 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:09:34.106441 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:09:34.106441 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:09:34.106441 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:09:34.106441 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( May 10 19:09:34.106441 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:09:34.106441 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() May 10 19:09:34.106441 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:09:34.106441 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:09:34.107894 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:09:34.107894 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() May 10 19:09:34.107894 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:09:34.107894 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( May 10 19:09:34.107894 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:09:34.107894 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:09:34.107894 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:09:34.107894 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:09:34.107894 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:09:34.107894 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:09:34.107894 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 19:09:34.107894 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:09:34.107894 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 607/1195] 10.222.0.70 () {56 vars in 1096 bytes} [Tue May 10 19:09:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:09:34.113040 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738e0c9a-9943-475e-a14a-e2a01cc5df5d None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:09:34.203338 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738e0c9a-9943-475e-a14a-e2a01cc5df5d None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:09:34.234616 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf39297-7f46-43b0-bebc-88a22dec2ed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:09:34.235258 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf39297-7f46-43b0-bebc-88a22dec2ed0 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:09:34.235535 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf39297-7f46-43b0-bebc-88a22dec2ed0 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:09:34.235805 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf39297-7f46-43b0-bebc-88a22dec2ed0 None admin] PATH_INFO: `/v3/roles` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:09:34.236555 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf39297-7f46-43b0-bebc-88a22dec2ed0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:09:34.236856 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf39297-7f46-43b0-bebc-88a22dec2ed0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:09:34.238191 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf39297-7f46-43b0-bebc-88a22dec2ed0 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:09:34.245634 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 589/1196] 10.222.0.70 () {56 vars in 1099 bytes} [Tue May 10 19:09:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:09:34.251255 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d58429d-326d-47a4-94b1-b3ac488b987e None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:09:34.344155 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d58429d-326d-47a4-94b1-b3ac488b987e None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:09:34.375911 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f2dfd0-8470-4723-b692-919399baa986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:09:34.376733 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f2dfd0-8470-4723-b692-919399baa986 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:09:34.377013 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f2dfd0-8470-4723-b692-919399baa986 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:09:34.377285 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f2dfd0-8470-4723-b692-919399baa986 None admin] PATH_INFO: `/v3/users/82f97949316c4326ab088b3464f1366e` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:09:34.378441 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f2dfd0-8470-4723-b692-919399baa986 None admin] RBAC: Authorizing `identity:get_user(user_id=82f97949316c4326ab088b3464f1366e)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:09:34.379859 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f2dfd0-8470-4723-b692-919399baa986 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:09:34.381464 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 608/1197] 10.222.0.70 () {56 vars in 1177 bytes} [Tue May 10 19:09:34 2022] GET /identity/v3/users/82f97949316c4326ab088b3464f1366e => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:09:34.387046 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf39297-7f46-43b0-bebc-88a22dec2ed0 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:09:34.480380 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf39297-7f46-43b0-bebc-88a22dec2ed0 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:09:34.512721 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5a5eda-467d-414b-9497-ec1476c51695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:09:34.513381 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5a5eda-467d-414b-9497-ec1476c51695 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:09:34.513664 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5a5eda-467d-414b-9497-ec1476c51695 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:09:34.513938 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5a5eda-467d-414b-9497-ec1476c51695 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:09:34.575594 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5a5eda-467d-414b-9497-ec1476c51695 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:09:34.577088 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5a5eda-467d-414b-9497-ec1476c51695 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:09:34.667815 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 590/1198] 10.222.0.70 () {58 vars in 1282 bytes} [Tue May 10 19:09:34 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 19:09:34.673571 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f2dfd0-8470-4723-b692-919399baa986 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:09:34.765657 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f2dfd0-8470-4723-b692-919399baa986 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:09:34.796181 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84afd90c-68bc-42ea-8f85-276dc5c2406b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:09:34.797039 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84afd90c-68bc-42ea-8f85-276dc5c2406b None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:09:34.797316 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84afd90c-68bc-42ea-8f85-276dc5c2406b None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:09:34.797591 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84afd90c-68bc-42ea-8f85-276dc5c2406b None admin] PATH_INFO: `/v3/projects/f796a27b151c41258e83896371ff83e7` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:09:34.798745 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84afd90c-68bc-42ea-8f85-276dc5c2406b None admin] RBAC: Authorizing `identity:get_project(project_id=f796a27b151c41258e83896371ff83e7)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:09:34.800156 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84afd90c-68bc-42ea-8f85-276dc5c2406b None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:09:34.801822 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 609/1199] 10.222.0.70 () {56 vars in 1186 bytes} [Tue May 10 19:09:34 2022] GET /identity/v3/projects/f796a27b151c41258e83896371ff83e7 => generated 361 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:09:34.807545 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5a5eda-467d-414b-9497-ec1476c51695 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:09:34.898894 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5a5eda-467d-414b-9497-ec1476c51695 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:09:34.930682 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49f3d56-4bdb-4ae8-a859-d913d3176e20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:09:34.931265 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49f3d56-4bdb-4ae8-a859-d913d3176e20 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:09:34.931547 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49f3d56-4bdb-4ae8-a859-d913d3176e20 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:09:34.931823 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49f3d56-4bdb-4ae8-a859-d913d3176e20 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:09:34.932657 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49f3d56-4bdb-4ae8-a859-d913d3176e20 None admin] RBAC: Adding query filter params (role.id=634ba284303b4626b5a0402772c68f5c, scope.project.id=f796a27b151c41258e83896371ff83e7, user.id=82f97949316c4326ab088b3464f1366e) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:09:34.932967 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49f3d56-4bdb-4ae8-a859-d913d3176e20 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:09:34.934374 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49f3d56-4bdb-4ae8-a859-d913d3176e20 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:09:34.939829 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 591/1200] 10.222.0.70 () {56 vars in 1374 bytes} [Tue May 10 19:09:34 2022] GET /identity/v3/role_assignments?user.id=82f97949316c4326ab088b3464f1366e&scope.project.id=f796a27b151c41258e83896371ff83e7&role.id=634ba284303b4626b5a0402772c68f5c => generated 608 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:10:35.290047 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77285eb4-68fe-451d-8df1-8cae2e93e5c9 None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:10:35.291027 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77285eb4-68fe-451d-8df1-8cae2e93e5c9 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:10:35.291027 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77285eb4-68fe-451d-8df1-8cae2e93e5c9 None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:10:35.291885 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 610/1201] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:10:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:10:35.299053 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a88b85d-f39a-4380-8576-3b97d64f19b0 None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:10:35.299547 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a88b85d-f39a-4380-8576-3b97d64f19b0 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:10:35.299864 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a88b85d-f39a-4380-8576-3b97d64f19b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:10:35.323827 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-1a88b85d-f39a-4380-8576-3b97d64f19b0 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:10:35.325455 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-1a88b85d-f39a-4380-8576-3b97d64f19b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:10:35.413490 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 592/1202] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:10:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 19:10:35.438666 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77285eb4-68fe-451d-8df1-8cae2e93e5c9 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:10:35.562815 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77285eb4-68fe-451d-8df1-8cae2e93e5c9 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:10:35.607025 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543f162d-4b63-4e5d-9c85-810d07e925d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:10:35.608446 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543f162d-4b63-4e5d-9c85-810d07e925d8 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:10:35.608780 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543f162d-4b63-4e5d-9c85-810d07e925d8 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:10:35.609253 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543f162d-4b63-4e5d-9c85-810d07e925d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:10:35.622902 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543f162d-4b63-4e5d-9c85-810d07e925d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:10:35.625462 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543f162d-4b63-4e5d-9c85-810d07e925d8 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:10:35.649981 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-543f162d-4b63-4e5d-9c85-810d07e925d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:10:35.649981 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:10:35.649981 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:10:35.649981 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:10:35.649981 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:10:35.649981 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:10:35.649981 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:10:35.649981 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:10:35.649981 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:10:35.649981 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:10:35.649981 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:10:35.649981 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:10:35.649981 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 19:10:35.649981 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 19:10:35.649981 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 19:10:35.651655 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 19:10:35.651655 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:10:35.651655 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:10:35.651655 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:10:35.651655 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:10:35.651655 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:10:35.651655 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:10:35.651655 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:10:35.651655 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( May 10 19:10:35.651655 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:10:35.651655 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() May 10 19:10:35.651655 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:10:35.651655 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:10:35.651655 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:10:35.651655 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() May 10 19:10:35.651655 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:10:35.651655 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( May 10 19:10:35.653000 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 19:10:35.653000 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 19:10:35.653000 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:10:35.653000 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:10:35.653000 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 611/1203] 10.222.0.70 () {56 vars in 1108 bytes} [Tue May 10 19:10:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:10:35.658253 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a88b85d-f39a-4380-8576-3b97d64f19b0 None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:10:35.775215 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a88b85d-f39a-4380-8576-3b97d64f19b0 None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:10:35.816258 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1e53a3-d21a-44d2-9efe-0149854612ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:10:35.817563 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1e53a3-d21a-44d2-9efe-0149854612ac None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:10:35.817943 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1e53a3-d21a-44d2-9efe-0149854612ac None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:10:35.818108 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1e53a3-d21a-44d2-9efe-0149854612ac None admin] PATH_INFO: `/v3/domains` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:10:35.818833 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1e53a3-d21a-44d2-9efe-0149854612ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:10:35.819183 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1e53a3-d21a-44d2-9efe-0149854612ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:10:35.820907 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1e53a3-d21a-44d2-9efe-0149854612ac None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:10:35.839330 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 593/1204] 10.222.0.70 () {56 vars in 1109 bytes} [Tue May 10 19:10:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:10:35.841110 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543f162d-4b63-4e5d-9c85-810d07e925d8 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:10:35.967314 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543f162d-4b63-4e5d-9c85-810d07e925d8 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:10:36.020611 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37735fb-39f5-4b34-b3e2-99d1cae73e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:10:36.021911 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37735fb-39f5-4b34-b3e2-99d1cae73e0d None admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:10:36.022799 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37735fb-39f5-4b34-b3e2-99d1cae73e0d None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:10:36.023536 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37735fb-39f5-4b34-b3e2-99d1cae73e0d None admin] PATH_INFO: `/v3/users` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:10:36.024862 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37735fb-39f5-4b34-b3e2-99d1cae73e0d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:10:36.027645 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37735fb-39f5-4b34-b3e2-99d1cae73e0d None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:10:36.052457 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 612/1205] 10.222.0.70 () {60 vars in 1132 bytes} [Tue May 10 19:10:35 2022] POST /identity/v3/users => generated 251 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:10:38.559959 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563a241e-6cf6-42d8-b93a-d90ac3fe403f None None] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:10:38.560510 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563a241e-6cf6-42d8-b93a-d90ac3fe403f None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:10:38.560593 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563a241e-6cf6-42d8-b93a-d90ac3fe403f None None] PATH_INFO: `/` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:10:38.562073 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 594/1206] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:10:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:10:38.567162 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d006e9d5-8771-4072-896e-0dd1ed27a1ee None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:10:38.567580 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d006e9d5-8771-4072-896e-0dd1ed27a1ee None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:10:38.567760 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d006e9d5-8771-4072-896e-0dd1ed27a1ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:10:38.586350 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-d006e9d5-8771-4072-896e-0dd1ed27a1ee None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:10:38.587784 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-d006e9d5-8771-4072-896e-0dd1ed27a1ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:10:38.672466 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 613/1207] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:10:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 19:10:38.696907 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563a241e-6cf6-42d8-b93a-d90ac3fe403f None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:10:38.814721 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563a241e-6cf6-42d8-b93a-d90ac3fe403f None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:10:38.855265 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beb0830-b13c-4178-95aa-274dc23bf109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:10:38.856171 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beb0830-b13c-4178-95aa-274dc23bf109 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:10:38.856503 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beb0830-b13c-4178-95aa-274dc23bf109 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:10:38.856778 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beb0830-b13c-4178-95aa-274dc23bf109 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:10:38.868591 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1beb0830-b13c-4178-95aa-274dc23bf109 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:10:38.877484 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application [None req-1beb0830-b13c-4178-95aa-274dc23bf109 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 19:10:38.877484 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:10:38.877484 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:10:38.877484 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:10:38.877484 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:10:38.877484 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:10:38.877484 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:10:38.877484 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:10:38.877484 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:10:38.877484 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:10:38.877484 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:10:38.877484 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:10:38.877484 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:10:38.877484 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:10:38.877484 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:10:38.877484 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:10:38.878547 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:10:38.878547 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:10:38.878547 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:10:38.878547 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:10:38.878547 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:10:38.878547 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:10:38.878547 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:10:38.878547 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:10:38.878547 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:10:38.878547 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:10:38.878547 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:10:38.878547 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application with Lock( May 10 19:10:38.878547 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:10:38.878547 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._enter() May 10 19:10:38.878547 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:10:38.878547 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:10:38.879974 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:10:38.879974 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.creator() May 10 19:10:38.879974 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:10:38.879974 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application created_value = creator( May 10 19:10:38.879974 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:10:38.879974 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:10:38.879974 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:10:38.879974 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:10:38.879974 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:10:38.879974 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:10:38.879974 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 19:10:38.879974 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application May 10 19:10:38.879974 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 595/1208] 10.222.0.70 () {56 vars in 1102 bytes} [Tue May 10 19:10:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:10:38.884657 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d006e9d5-8771-4072-896e-0dd1ed27a1ee None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:10:38.994769 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d006e9d5-8771-4072-896e-0dd1ed27a1ee None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:10:39.037989 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebd2365-791e-4562-9673-a834904e6a8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:10:39.038883 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebd2365-791e-4562-9673-a834904e6a8c None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:10:39.039307 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebd2365-791e-4562-9673-a834904e6a8c None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:10:39.039729 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebd2365-791e-4562-9673-a834904e6a8c None admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:10:39.040745 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebd2365-791e-4562-9673-a834904e6a8c None admin] RBAC: Adding query filter params (name=service) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:10:39.041055 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebd2365-791e-4562-9673-a834904e6a8c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:10:39.043552 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebd2365-791e-4562-9673-a834904e6a8c None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:10:39.052556 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 614/1209] 10.222.0.70 () {56 vars in 1103 bytes} [Tue May 10 19:10:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:10:39.058262 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beb0830-b13c-4178-95aa-274dc23bf109 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:10:39.175362 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beb0830-b13c-4178-95aa-274dc23bf109 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:10:39.219099 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a8e162-bc81-4118-9398-92f2a3968d62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:10:39.220222 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a8e162-bc81-4118-9398-92f2a3968d62 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:10:39.220652 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a8e162-bc81-4118-9398-92f2a3968d62 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:10:39.220931 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a8e162-bc81-4118-9398-92f2a3968d62 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:10:39.233758 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a8e162-bc81-4118-9398-92f2a3968d62 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:10:39.235701 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a8e162-bc81-4118-9398-92f2a3968d62 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:10:39.255540 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application [None req-07a8e162-bc81-4118-9398-92f2a3968d62 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:10:39.255540 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:10:39.255540 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:10:39.255540 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:10:39.255540 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:10:39.255540 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:10:39.255540 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:10:39.255540 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:10:39.255540 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:10:39.255540 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:10:39.255540 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:10:39.255540 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:10:39.255540 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 19:10:39.255540 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 19:10:39.255540 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 19:10:39.256588 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 19:10:39.256588 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:10:39.256588 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:10:39.256588 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:10:39.256588 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:10:39.256588 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:10:39.256588 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:10:39.256588 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:10:39.256588 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application with Lock( May 10 19:10:39.256588 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:10:39.256588 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._enter() May 10 19:10:39.256588 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:10:39.256588 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:10:39.256588 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:10:39.256588 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.creator() May 10 19:10:39.256588 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:10:39.256588 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application created_value = creator( May 10 19:10:39.257600 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 19:10:39.257600 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 19:10:39.257600 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:10:39.257600 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application May 10 19:10:39.257600 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 596/1210] 10.222.0.70 () {56 vars in 1108 bytes} [Tue May 10 19:10:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:10:39.262850 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebd2365-791e-4562-9673-a834904e6a8c None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:10:39.376881 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebd2365-791e-4562-9673-a834904e6a8c None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:10:39.417568 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211c0957-6e1e-4f5b-9419-692f04484d51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:10:39.418491 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211c0957-6e1e-4f5b-9419-692f04484d51 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:10:39.418809 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211c0957-6e1e-4f5b-9419-692f04484d51 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:10:39.419084 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211c0957-6e1e-4f5b-9419-692f04484d51 None admin] PATH_INFO: `/v3/domains` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:10:39.419899 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211c0957-6e1e-4f5b-9419-692f04484d51 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:10:39.420202 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211c0957-6e1e-4f5b-9419-692f04484d51 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:10:39.421940 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211c0957-6e1e-4f5b-9419-692f04484d51 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:10:39.441883 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 615/1211] 10.222.0.70 () {56 vars in 1109 bytes} [Tue May 10 19:10:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:10:39.443652 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a8e162-bc81-4118-9398-92f2a3968d62 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:10:39.558286 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a8e162-bc81-4118-9398-92f2a3968d62 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:10:39.597144 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2663c0b4-fd5f-4d43-9743-d890182a1c87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:10:39.598043 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2663c0b4-fd5f-4d43-9743-d890182a1c87 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:10:39.598437 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2663c0b4-fd5f-4d43-9743-d890182a1c87 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:10:39.598779 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2663c0b4-fd5f-4d43-9743-d890182a1c87 None admin] PATH_INFO: `/v3/users/placement` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:10:39.608578 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2663c0b4-fd5f-4d43-9743-d890182a1c87 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:10:39.610485 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2663c0b4-fd5f-4d43-9743-d890182a1c87 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:10:39.629619 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application [None req-2663c0b4-fd5f-4d43-9743-d890182a1c87 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 10 19:10:39.629619 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:10:39.629619 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:10:39.629619 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:10:39.629619 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:10:39.629619 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:10:39.629619 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:10:39.629619 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:10:39.629619 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:10:39.629619 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:10:39.629619 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:10:39.629619 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:10:39.629619 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 19:10:39.629619 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 19:10:39.629619 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 19:10:39.629619 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 19:10:39.630823 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:10:39.630823 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:10:39.630823 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 19:10:39.630823 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 19:10:39.630823 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 19:10:39.630823 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 19:10:39.630823 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:10:39.630823 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:10:39.630823 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:10:39.630823 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:10:39.630823 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:10:39.630823 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application with Lock( May 10 19:10:39.630823 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:10:39.630823 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._enter() May 10 19:10:39.630823 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:10:39.630823 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:10:39.630823 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:10:39.630823 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.creator() May 10 19:10:39.637452 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:10:39.637452 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application created_value = creator( May 10 19:10:39.637452 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 19:10:39.637452 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 19:10:39.637452 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 19:10:39.637452 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 19:10:39.637452 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 19:10:39.637452 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 19:10:39.637452 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 10 19:10:39.637452 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application May 10 19:10:39.637452 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 597/1212] 10.222.0.70 () {56 vars in 1108 bytes} [Tue May 10 19:10:39 2022] GET /identity/v3/users/placement => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:10:39.638216 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211c0957-6e1e-4f5b-9419-692f04484d51 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:10:39.747547 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211c0957-6e1e-4f5b-9419-692f04484d51 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:10:39.783843 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfc1d7a-c783-4efa-9b5e-f8da29f7b648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:10:39.784668 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfc1d7a-c783-4efa-9b5e-f8da29f7b648 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:10:39.785808 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfc1d7a-c783-4efa-9b5e-f8da29f7b648 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:10:39.785808 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfc1d7a-c783-4efa-9b5e-f8da29f7b648 None admin] PATH_INFO: `/v3/users` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:10:39.786052 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfc1d7a-c783-4efa-9b5e-f8da29f7b648 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:10:39.786354 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfc1d7a-c783-4efa-9b5e-f8da29f7b648 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:10:39.787783 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfc1d7a-c783-4efa-9b5e-f8da29f7b648 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:10:39.806273 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 616/1213] 10.222.0.70 () {56 vars in 1143 bytes} [Tue May 10 19:10:39 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:10:39.812489 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2663c0b4-fd5f-4d43-9743-d890182a1c87 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:10:39.923841 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2663c0b4-fd5f-4d43-9743-d890182a1c87 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:10:39.961283 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54a7c61-56ef-4bc0-9020-98bc044a6f88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:10:39.962245 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54a7c61-56ef-4bc0-9020-98bc044a6f88 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:10:39.962759 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54a7c61-56ef-4bc0-9020-98bc044a6f88 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:10:39.963060 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54a7c61-56ef-4bc0-9020-98bc044a6f88 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:10:40.036160 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54a7c61-56ef-4bc0-9020-98bc044a6f88 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:10:40.037969 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54a7c61-56ef-4bc0-9020-98bc044a6f88 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:10:40.148380 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 598/1214] 10.222.0.70 () {58 vars in 1282 bytes} [Tue May 10 19:10:39 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 19:10:40.149797 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfc1d7a-c783-4efa-9b5e-f8da29f7b648 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:10:40.257355 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfc1d7a-c783-4efa-9b5e-f8da29f7b648 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:10:40.294607 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3c60cb-0a2e-4a16-9cd0-ba561ab982b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:10:40.294607 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3c60cb-0a2e-4a16-9cd0-ba561ab982b6 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:10:40.294952 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3c60cb-0a2e-4a16-9cd0-ba561ab982b6 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:10:40.295039 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3c60cb-0a2e-4a16-9cd0-ba561ab982b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:10:40.306577 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3c60cb-0a2e-4a16-9cd0-ba561ab982b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:10:40.308303 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3c60cb-0a2e-4a16-9cd0-ba561ab982b6 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:10:40.328964 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-fa3c60cb-0a2e-4a16-9cd0-ba561ab982b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:10:40.328964 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:10:40.328964 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:10:40.328964 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:10:40.328964 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:10:40.328964 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:10:40.328964 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:10:40.328964 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:10:40.328964 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:10:40.328964 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:10:40.328964 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:10:40.328964 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:10:40.328964 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 19:10:40.328964 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 19:10:40.328964 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 19:10:40.330215 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 19:10:40.330215 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:10:40.330215 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:10:40.330215 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:10:40.330215 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:10:40.330215 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:10:40.330215 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:10:40.330215 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:10:40.330215 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( May 10 19:10:40.330215 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:10:40.330215 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() May 10 19:10:40.330215 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:10:40.330215 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:10:40.330215 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:10:40.330215 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() May 10 19:10:40.330215 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:10:40.330215 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( May 10 19:10:40.331186 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 19:10:40.331186 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 19:10:40.331186 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:10:40.331186 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:10:40.331186 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 617/1215] 10.222.0.70 () {56 vars in 1108 bytes} [Tue May 10 19:10:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:10:40.336943 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54a7c61-56ef-4bc0-9020-98bc044a6f88 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:10:40.441506 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54a7c61-56ef-4bc0-9020-98bc044a6f88 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:10:40.478549 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499fd2ca-6b63-4a8e-a7c7-4a1a85b36ca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:10:40.479252 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499fd2ca-6b63-4a8e-a7c7-4a1a85b36ca8 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:10:40.479569 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499fd2ca-6b63-4a8e-a7c7-4a1a85b36ca8 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:10:40.479843 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499fd2ca-6b63-4a8e-a7c7-4a1a85b36ca8 None admin] PATH_INFO: `/v3/domains` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:10:40.480594 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499fd2ca-6b63-4a8e-a7c7-4a1a85b36ca8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:10:40.480898 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499fd2ca-6b63-4a8e-a7c7-4a1a85b36ca8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:10:40.482267 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499fd2ca-6b63-4a8e-a7c7-4a1a85b36ca8 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:10:40.494108 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 599/1216] 10.222.0.70 () {56 vars in 1109 bytes} [Tue May 10 19:10:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:10:40.499893 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3c60cb-0a2e-4a16-9cd0-ba561ab982b6 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:10:40.609565 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3c60cb-0a2e-4a16-9cd0-ba561ab982b6 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:10:40.650717 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e172b33-8e6f-41e9-b803-ef3e666a4f3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:10:40.651700 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e172b33-8e6f-41e9-b803-ef3e666a4f3d None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:10:40.652020 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e172b33-8e6f-41e9-b803-ef3e666a4f3d None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:10:40.652444 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e172b33-8e6f-41e9-b803-ef3e666a4f3d None admin] PATH_INFO: `/v3/projects/service` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:10:40.661072 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e172b33-8e6f-41e9-b803-ef3e666a4f3d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:10:40.662665 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e172b33-8e6f-41e9-b803-ef3e666a4f3d None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:10:40.678329 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-7e172b33-8e6f-41e9-b803-ef3e666a4f3d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 19:10:40.678329 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:10:40.678329 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:10:40.678329 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:10:40.678329 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:10:40.678329 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:10:40.678329 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:10:40.678329 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:10:40.678329 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:10:40.678329 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:10:40.678329 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:10:40.678329 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:10:40.678329 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 19:10:40.678329 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 19:10:40.678329 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 19:10:40.679604 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 19:10:40.679604 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:10:40.679604 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:10:40.679604 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:10:40.679604 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:10:40.679604 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:10:40.679604 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:10:40.679604 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:10:40.679604 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( May 10 19:10:40.679604 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:10:40.679604 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() May 10 19:10:40.679604 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:10:40.679604 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:10:40.679604 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:10:40.679604 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() May 10 19:10:40.679604 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:10:40.679604 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( May 10 19:10:40.680812 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 19:10:40.680812 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 19:10:40.680812 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 19:10:40.680812 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 19:10:40.680812 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 19:10:40.680812 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 19:10:40.680812 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 19:10:40.680812 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:10:40.688534 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 618/1217] 10.222.0.70 () {56 vars in 1111 bytes} [Tue May 10 19:10:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:10:40.689875 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499fd2ca-6b63-4a8e-a7c7-4a1a85b36ca8 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:10:40.801524 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499fd2ca-6b63-4a8e-a7c7-4a1a85b36ca8 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:10:40.839187 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc84d02c-d9d6-4e29-881a-6ce9b20892bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:10:40.839947 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc84d02c-d9d6-4e29-881a-6ce9b20892bb None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:10:40.840302 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc84d02c-d9d6-4e29-881a-6ce9b20892bb None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:10:40.840612 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc84d02c-d9d6-4e29-881a-6ce9b20892bb None admin] PATH_INFO: `/v3/projects` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:10:40.841517 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc84d02c-d9d6-4e29-881a-6ce9b20892bb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:10:40.841865 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc84d02c-d9d6-4e29-881a-6ce9b20892bb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:10:40.843344 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc84d02c-d9d6-4e29-881a-6ce9b20892bb None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:10:40.855580 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 600/1218] 10.222.0.70 () {56 vars in 1148 bytes} [Tue May 10 19:10:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:10:40.862399 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e172b33-8e6f-41e9-b803-ef3e666a4f3d None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:10:40.976573 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e172b33-8e6f-41e9-b803-ef3e666a4f3d None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:10:41.011074 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4163be7-391e-4be9-9228-7f9850d72995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:10:41.011725 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4163be7-391e-4be9-9228-7f9850d72995 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:10:41.012005 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4163be7-391e-4be9-9228-7f9850d72995 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:10:41.012278 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4163be7-391e-4be9-9228-7f9850d72995 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:10:41.013131 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4163be7-391e-4be9-9228-7f9850d72995 None admin] RBAC: Adding query filter params (role.id=445805bec1e741c9b823495ae6e364f0, scope.project.id=2ee9ec5b515440fe9b39aedf3e339c79, user.id=11b95d3824f34cfcada6915ee57a7e08) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:10:41.013439 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4163be7-391e-4be9-9228-7f9850d72995 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:10:41.014883 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4163be7-391e-4be9-9228-7f9850d72995 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:10:41.021567 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 619/1219] 10.222.0.70 () {56 vars in 1374 bytes} [Tue May 10 19:10:40 2022] GET /identity/v3/role_assignments?user.id=11b95d3824f34cfcada6915ee57a7e08&scope.project.id=2ee9ec5b515440fe9b39aedf3e339c79&role.id=445805bec1e741c9b823495ae6e364f0 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:10:43.334880 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e408e8a-548a-4b70-9040-e3974012cca9 None None] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:10:43.334880 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e408e8a-548a-4b70-9040-e3974012cca9 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:10:43.334880 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e408e8a-548a-4b70-9040-e3974012cca9 None None] PATH_INFO: `/` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:10:43.336050 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 601/1220] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:10:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:10:43.339902 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020c8190-c14a-4fa8-8e7f-c5b0a00e381e None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:10:43.340328 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020c8190-c14a-4fa8-8e7f-c5b0a00e381e None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:10:43.340551 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020c8190-c14a-4fa8-8e7f-c5b0a00e381e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:10:43.357714 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-020c8190-c14a-4fa8-8e7f-c5b0a00e381e None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:10:43.358901 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-020c8190-c14a-4fa8-8e7f-c5b0a00e381e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:10:43.440960 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 620/1221] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:10:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 19:10:43.466285 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e408e8a-548a-4b70-9040-e3974012cca9 None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:10:43.582149 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e408e8a-548a-4b70-9040-e3974012cca9 None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:10:43.620478 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f9f7c8-932b-4597-86d4-e715c0cf5fda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:10:43.621221 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f9f7c8-932b-4597-86d4-e715c0cf5fda None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:10:43.621502 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f9f7c8-932b-4597-86d4-e715c0cf5fda None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:10:43.621741 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f9f7c8-932b-4597-86d4-e715c0cf5fda None admin] PATH_INFO: `/v3/roles/service` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:10:43.633261 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f9f7c8-932b-4597-86d4-e715c0cf5fda None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:10:43.642244 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application [None req-d8f9f7c8-932b-4597-86d4-e715c0cf5fda None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 19:10:43.642244 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:10:43.642244 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:10:43.642244 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:10:43.642244 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:10:43.642244 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:10:43.642244 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:10:43.642244 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:10:43.642244 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:10:43.642244 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:10:43.642244 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:10:43.642244 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:10:43.642244 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:10:43.642244 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:10:43.642244 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:10:43.642244 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:10:43.643440 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:10:43.643440 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:10:43.643440 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:10:43.643440 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:10:43.643440 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:10:43.643440 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:10:43.643440 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:10:43.643440 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:10:43.643440 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:10:43.643440 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:10:43.643440 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:10:43.643440 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application with Lock( May 10 19:10:43.643440 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:10:43.643440 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._enter() May 10 19:10:43.643440 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:10:43.643440 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:10:43.644570 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:10:43.644570 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.creator() May 10 19:10:43.644570 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:10:43.644570 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application created_value = creator( May 10 19:10:43.644570 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:10:43.644570 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:10:43.644570 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:10:43.644570 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:10:43.644570 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:10:43.644570 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:10:43.644570 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 19:10:43.644570 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application May 10 19:10:43.644570 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 602/1222] 10.222.0.70 () {56 vars in 1102 bytes} [Tue May 10 19:10:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:10:43.650189 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020c8190-c14a-4fa8-8e7f-c5b0a00e381e None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:10:43.749195 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020c8190-c14a-4fa8-8e7f-c5b0a00e381e None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:10:43.783913 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040a50b8-96b3-4d45-b499-fe16e940289f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:10:43.784589 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040a50b8-96b3-4d45-b499-fe16e940289f None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:10:43.784877 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040a50b8-96b3-4d45-b499-fe16e940289f None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:10:43.785182 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040a50b8-96b3-4d45-b499-fe16e940289f None admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:10:43.785886 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040a50b8-96b3-4d45-b499-fe16e940289f None admin] RBAC: Adding query filter params (name=service) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:10:43.786195 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040a50b8-96b3-4d45-b499-fe16e940289f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:10:43.787565 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040a50b8-96b3-4d45-b499-fe16e940289f None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:10:43.796037 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 621/1223] 10.222.0.70 () {56 vars in 1103 bytes} [Tue May 10 19:10:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:10:43.802117 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f9f7c8-932b-4597-86d4-e715c0cf5fda None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:10:43.901110 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f9f7c8-932b-4597-86d4-e715c0cf5fda None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:10:43.934804 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20daea2-e62c-4ceb-823d-83c88bf227f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:10:43.935642 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20daea2-e62c-4ceb-823d-83c88bf227f0 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:10:43.936483 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20daea2-e62c-4ceb-823d-83c88bf227f0 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:10:43.936483 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20daea2-e62c-4ceb-823d-83c88bf227f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:10:43.948486 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20daea2-e62c-4ceb-823d-83c88bf227f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:10:43.949817 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20daea2-e62c-4ceb-823d-83c88bf227f0 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:10:43.968972 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application [None req-c20daea2-e62c-4ceb-823d-83c88bf227f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:10:43.968972 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:10:43.968972 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:10:43.968972 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:10:43.968972 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:10:43.968972 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:10:43.968972 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:10:43.968972 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:10:43.968972 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:10:43.968972 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:10:43.968972 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:10:43.968972 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:10:43.968972 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 19:10:43.968972 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 19:10:43.968972 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 19:10:43.970339 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 19:10:43.970339 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:10:43.970339 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:10:43.970339 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:10:43.970339 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:10:43.970339 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:10:43.970339 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:10:43.970339 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:10:43.970339 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application with Lock( May 10 19:10:43.970339 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:10:43.970339 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._enter() May 10 19:10:43.970339 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:10:43.970339 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:10:43.970339 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:10:43.970339 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.creator() May 10 19:10:43.970339 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:10:43.970339 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application created_value = creator( May 10 19:10:43.971547 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 19:10:43.971547 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 19:10:43.971547 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:10:43.971547 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application May 10 19:10:43.971547 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 603/1224] 10.222.0.70 () {56 vars in 1108 bytes} [Tue May 10 19:10:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:10:43.976135 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040a50b8-96b3-4d45-b499-fe16e940289f None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:10:44.080765 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040a50b8-96b3-4d45-b499-fe16e940289f None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:10:44.115537 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a329f4d-33d0-4489-a79d-d528d50d257f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:10:44.116375 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a329f4d-33d0-4489-a79d-d528d50d257f None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:10:44.116788 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a329f4d-33d0-4489-a79d-d528d50d257f None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:10:44.117058 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a329f4d-33d0-4489-a79d-d528d50d257f None admin] PATH_INFO: `/v3/domains` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:10:44.117778 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a329f4d-33d0-4489-a79d-d528d50d257f None admin] RBAC: Adding query filter params (name=Default) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:10:44.118088 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a329f4d-33d0-4489-a79d-d528d50d257f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:10:44.119590 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a329f4d-33d0-4489-a79d-d528d50d257f None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:10:44.131514 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 622/1225] 10.222.0.70 () {56 vars in 1109 bytes} [Tue May 10 19:10:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:10:44.137976 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20daea2-e62c-4ceb-823d-83c88bf227f0 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:10:44.243480 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20daea2-e62c-4ceb-823d-83c88bf227f0 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:10:44.280222 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7445abe3-e0bf-4959-ac1c-b8bae3b8e2d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:10:44.281090 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7445abe3-e0bf-4959-ac1c-b8bae3b8e2d1 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:10:44.281375 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7445abe3-e0bf-4959-ac1c-b8bae3b8e2d1 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:10:44.281649 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7445abe3-e0bf-4959-ac1c-b8bae3b8e2d1 None admin] PATH_INFO: `/v3/users/placement` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:10:44.289613 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7445abe3-e0bf-4959-ac1c-b8bae3b8e2d1 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:10:44.291739 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7445abe3-e0bf-4959-ac1c-b8bae3b8e2d1 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:10:44.307392 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application [None req-7445abe3-e0bf-4959-ac1c-b8bae3b8e2d1 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 10 19:10:44.307392 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:10:44.307392 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:10:44.307392 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:10:44.307392 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:10:44.307392 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:10:44.307392 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:10:44.307392 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:10:44.307392 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:10:44.307392 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:10:44.307392 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:10:44.307392 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:10:44.307392 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 19:10:44.307392 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 19:10:44.307392 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 19:10:44.307392 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 19:10:44.308651 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:10:44.308651 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:10:44.308651 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 19:10:44.308651 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 19:10:44.308651 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 19:10:44.308651 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 19:10:44.308651 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:10:44.308651 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:10:44.308651 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:10:44.308651 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:10:44.308651 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:10:44.308651 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application with Lock( May 10 19:10:44.308651 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:10:44.308651 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._enter() May 10 19:10:44.308651 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:10:44.308651 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:10:44.308651 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:10:44.308651 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.creator() May 10 19:10:44.309848 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:10:44.309848 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application created_value = creator( May 10 19:10:44.309848 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 19:10:44.309848 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 19:10:44.309848 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 19:10:44.309848 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 19:10:44.309848 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 19:10:44.309848 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 19:10:44.309848 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 10 19:10:44.309848 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application May 10 19:10:44.309848 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 604/1226] 10.222.0.70 () {56 vars in 1108 bytes} [Tue May 10 19:10:44 2022] GET /identity/v3/users/placement => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:10:44.314563 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a329f4d-33d0-4489-a79d-d528d50d257f None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:10:44.417545 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a329f4d-33d0-4489-a79d-d528d50d257f None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:10:44.455092 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57812a19-2195-4ba3-b77a-fc2aa8e34ebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:10:44.455763 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57812a19-2195-4ba3-b77a-fc2aa8e34ebe None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:10:44.456044 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57812a19-2195-4ba3-b77a-fc2aa8e34ebe None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:10:44.456319 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57812a19-2195-4ba3-b77a-fc2aa8e34ebe None admin] PATH_INFO: `/v3/users` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:10:44.457184 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57812a19-2195-4ba3-b77a-fc2aa8e34ebe None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:10:44.457490 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57812a19-2195-4ba3-b77a-fc2aa8e34ebe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:10:44.458909 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57812a19-2195-4ba3-b77a-fc2aa8e34ebe None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:10:44.477048 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 623/1227] 10.222.0.70 () {56 vars in 1143 bytes} [Tue May 10 19:10:44 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:10:44.482733 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7445abe3-e0bf-4959-ac1c-b8bae3b8e2d1 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:10:44.587161 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7445abe3-e0bf-4959-ac1c-b8bae3b8e2d1 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:10:44.625900 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4b7db4-0805-4f3b-881a-2e45f3bef76e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:10:44.626832 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4b7db4-0805-4f3b-881a-2e45f3bef76e None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:10:44.627052 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4b7db4-0805-4f3b-881a-2e45f3bef76e None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:10:44.627349 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4b7db4-0805-4f3b-881a-2e45f3bef76e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:10:44.639676 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4b7db4-0805-4f3b-881a-2e45f3bef76e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:10:44.641256 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4b7db4-0805-4f3b-881a-2e45f3bef76e None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:10:44.659991 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application [None req-8c4b7db4-0805-4f3b-881a-2e45f3bef76e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:10:44.659991 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:10:44.659991 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:10:44.659991 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:10:44.659991 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:10:44.659991 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:10:44.659991 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:10:44.659991 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:10:44.659991 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:10:44.659991 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:10:44.659991 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:10:44.659991 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:10:44.659991 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 19:10:44.659991 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 19:10:44.659991 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 19:10:44.661175 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 19:10:44.661175 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:10:44.661175 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:10:44.661175 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:10:44.661175 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:10:44.661175 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:10:44.661175 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:10:44.661175 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:10:44.661175 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application with Lock( May 10 19:10:44.661175 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:10:44.661175 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._enter() May 10 19:10:44.661175 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:10:44.661175 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:10:44.661175 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:10:44.661175 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.creator() May 10 19:10:44.661175 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:10:44.661175 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application created_value = creator( May 10 19:10:44.662148 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 19:10:44.662148 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 19:10:44.662148 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:10:44.662148 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application May 10 19:10:44.662148 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 605/1228] 10.222.0.70 () {56 vars in 1108 bytes} [Tue May 10 19:10:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:10:44.668353 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57812a19-2195-4ba3-b77a-fc2aa8e34ebe None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:10:44.774068 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57812a19-2195-4ba3-b77a-fc2aa8e34ebe None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:10:44.809580 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921c0e2a-7224-4454-a5cb-4939f5c7e96e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:10:44.810302 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921c0e2a-7224-4454-a5cb-4939f5c7e96e None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:10:44.810554 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921c0e2a-7224-4454-a5cb-4939f5c7e96e None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:10:44.810835 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921c0e2a-7224-4454-a5cb-4939f5c7e96e None admin] PATH_INFO: `/v3/domains` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:10:44.811612 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921c0e2a-7224-4454-a5cb-4939f5c7e96e None admin] RBAC: Adding query filter params (name=Default) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:10:44.811916 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921c0e2a-7224-4454-a5cb-4939f5c7e96e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:10:44.813381 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921c0e2a-7224-4454-a5cb-4939f5c7e96e None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:10:44.825084 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 624/1229] 10.222.0.70 () {56 vars in 1109 bytes} [Tue May 10 19:10:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:10:44.831138 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4b7db4-0805-4f3b-881a-2e45f3bef76e None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:10:44.931008 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4b7db4-0805-4f3b-881a-2e45f3bef76e None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:10:44.968183 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06ddb76-69b5-452f-b098-3dbef621550e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:10:44.968995 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06ddb76-69b5-452f-b098-3dbef621550e None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:10:44.969279 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06ddb76-69b5-452f-b098-3dbef621550e None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:10:44.969551 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06ddb76-69b5-452f-b098-3dbef621550e None admin] PATH_INFO: `/v3/projects/service` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:10:44.976224 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06ddb76-69b5-452f-b098-3dbef621550e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:10:44.977726 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06ddb76-69b5-452f-b098-3dbef621550e None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:10:44.992095 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application [None req-f06ddb76-69b5-452f-b098-3dbef621550e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 19:10:44.992095 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:10:44.992095 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:10:44.992095 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:10:44.992095 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:10:44.992095 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:10:44.992095 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:10:44.992095 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:10:44.992095 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:10:44.992095 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:10:44.992095 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:10:44.992095 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:10:44.992095 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 19:10:44.992095 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 19:10:44.992095 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 19:10:44.993237 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 19:10:44.993237 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:10:44.993237 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:10:44.993237 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:10:44.993237 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:10:44.993237 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:10:44.993237 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:10:44.993237 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:10:44.993237 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application with Lock( May 10 19:10:44.993237 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:10:44.993237 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._enter() May 10 19:10:44.993237 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:10:44.993237 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:10:44.993237 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:10:44.993237 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.creator() May 10 19:10:44.993237 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:10:44.993237 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application created_value = creator( May 10 19:10:44.994443 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 19:10:44.994443 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 19:10:44.994443 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 19:10:44.994443 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 19:10:44.994443 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 19:10:44.994443 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 19:10:44.994443 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 19:10:44.994443 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application May 10 19:10:44.994443 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 606/1230] 10.222.0.70 () {56 vars in 1111 bytes} [Tue May 10 19:10:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:10:44.999507 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921c0e2a-7224-4454-a5cb-4939f5c7e96e None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:10:45.099077 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921c0e2a-7224-4454-a5cb-4939f5c7e96e None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:10:45.134513 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17aa635-567f-4636-9a3c-f3b979aa5e9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:10:45.135224 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17aa635-567f-4636-9a3c-f3b979aa5e9a None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:10:45.135571 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17aa635-567f-4636-9a3c-f3b979aa5e9a None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:10:45.136309 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17aa635-567f-4636-9a3c-f3b979aa5e9a None admin] PATH_INFO: `/v3/projects` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:10:45.136686 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17aa635-567f-4636-9a3c-f3b979aa5e9a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:10:45.136997 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17aa635-567f-4636-9a3c-f3b979aa5e9a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:10:45.138567 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17aa635-567f-4636-9a3c-f3b979aa5e9a None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:10:45.152258 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 625/1231] 10.222.0.70 () {56 vars in 1148 bytes} [Tue May 10 19:10:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:10:45.158970 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06ddb76-69b5-452f-b098-3dbef621550e None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:10:45.256619 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06ddb76-69b5-452f-b098-3dbef621550e None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:10:45.292476 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1dec5e-37a4-4357-af51-16a8c85dcd1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:10:45.293536 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1dec5e-37a4-4357-af51-16a8c85dcd1e None admin] REQUEST_METHOD: `PUT` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:10:45.293868 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1dec5e-37a4-4357-af51-16a8c85dcd1e None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:10:45.294194 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1dec5e-37a4-4357-af51-16a8c85dcd1e None admin] PATH_INFO: `/v3/projects/2ee9ec5b515440fe9b39aedf3e339c79/users/11b95d3824f34cfcada6915ee57a7e08/roles/445805bec1e741c9b823495ae6e364f0` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:10:45.310416 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1dec5e-37a4-4357-af51-16a8c85dcd1e None admin] RBAC: Authorizing `identity:create_grant(project_id=2ee9ec5b515440fe9b39aedf3e339c79, user_id=11b95d3824f34cfcada6915ee57a7e08, role_id=445805bec1e741c9b823495ae6e364f0)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:10:45.311890 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1dec5e-37a4-4357-af51-16a8c85dcd1e None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:10:45.324105 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 607/1232] 10.222.0.70 () {58 vars in 1439 bytes} [Tue May 10 19:10:45 2022] PUT /identity/v3/projects/2ee9ec5b515440fe9b39aedf3e339c79/users/11b95d3824f34cfcada6915ee57a7e08/roles/445805bec1e741c9b823495ae6e364f0 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:10:47.798441 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc94330-d51b-4272-a97d-059564f4b3cb None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:10:47.799039 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc94330-d51b-4272-a97d-059564f4b3cb None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:10:47.799148 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc94330-d51b-4272-a97d-059564f4b3cb None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:10:47.800584 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 626/1233] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:10:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 19:10:47.807571 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a6c56c-d4ae-43dc-8f18-0b009ece6612 None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:10:47.808088 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a6c56c-d4ae-43dc-8f18-0b009ece6612 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:10:47.808270 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a6c56c-d4ae-43dc-8f18-0b009ece6612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:10:47.827227 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-15a6c56c-d4ae-43dc-8f18-0b009ece6612 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:10:47.828403 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-15a6c56c-d4ae-43dc-8f18-0b009ece6612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:10:47.905447 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 608/1234] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:10:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 19:10:47.931846 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc94330-d51b-4272-a97d-059564f4b3cb None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:10:48.036751 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc94330-d51b-4272-a97d-059564f4b3cb None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:10:48.071443 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2a449a-983f-4f1a-b296-1f632b8827cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:10:48.072197 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2a449a-983f-4f1a-b296-1f632b8827cc None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:10:48.072647 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2a449a-983f-4f1a-b296-1f632b8827cc None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:10:48.072936 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2a449a-983f-4f1a-b296-1f632b8827cc None admin] PATH_INFO: `/v3/roles/service` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:10:48.085857 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2a449a-983f-4f1a-b296-1f632b8827cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:10:48.096633 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-de2a449a-983f-4f1a-b296-1f632b8827cc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 19:10:48.096633 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:10:48.096633 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:10:48.096633 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:10:48.096633 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:10:48.096633 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:10:48.096633 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:10:48.096633 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:10:48.096633 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:10:48.096633 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:10:48.096633 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:10:48.096633 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:10:48.096633 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:10:48.096633 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:10:48.096633 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:10:48.096633 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:10:48.097707 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:10:48.097707 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:10:48.097707 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:10:48.097707 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:10:48.097707 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:10:48.097707 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:10:48.097707 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:10:48.097707 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:10:48.097707 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:10:48.097707 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:10:48.097707 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:10:48.097707 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( May 10 19:10:48.097707 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:10:48.097707 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() May 10 19:10:48.097707 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:10:48.097707 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:10:48.098787 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:10:48.098787 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() May 10 19:10:48.098787 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:10:48.098787 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( May 10 19:10:48.098787 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:10:48.098787 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:10:48.098787 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:10:48.098787 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:10:48.098787 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:10:48.098787 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:10:48.098787 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 19:10:48.098787 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:10:48.099618 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 627/1235] 10.222.0.70 () {56 vars in 1102 bytes} [Tue May 10 19:10:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:10:48.107645 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a6c56c-d4ae-43dc-8f18-0b009ece6612 None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:10:48.208247 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a6c56c-d4ae-43dc-8f18-0b009ece6612 None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:10:48.247831 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204fdeb8-bb0b-4634-b223-2f7d08b1dff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:10:48.248672 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204fdeb8-bb0b-4634-b223-2f7d08b1dff4 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:10:48.248955 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204fdeb8-bb0b-4634-b223-2f7d08b1dff4 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:10:48.249230 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204fdeb8-bb0b-4634-b223-2f7d08b1dff4 None admin] PATH_INFO: `/v3/roles` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:10:48.249965 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204fdeb8-bb0b-4634-b223-2f7d08b1dff4 None admin] RBAC: Adding query filter params (name=service) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:10:48.250267 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204fdeb8-bb0b-4634-b223-2f7d08b1dff4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:10:48.251637 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204fdeb8-bb0b-4634-b223-2f7d08b1dff4 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:10:48.260869 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 609/1236] 10.222.0.70 () {56 vars in 1103 bytes} [Tue May 10 19:10:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:10:48.266986 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2a449a-983f-4f1a-b296-1f632b8827cc None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:10:48.375250 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2a449a-983f-4f1a-b296-1f632b8827cc None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:10:48.411825 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606bd5a5-586c-44c8-8e11-14176db62b02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:10:48.412656 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606bd5a5-586c-44c8-8e11-14176db62b02 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:10:48.412941 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606bd5a5-586c-44c8-8e11-14176db62b02 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:10:48.414199 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606bd5a5-586c-44c8-8e11-14176db62b02 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:10:48.428350 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606bd5a5-586c-44c8-8e11-14176db62b02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:10:48.429829 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606bd5a5-586c-44c8-8e11-14176db62b02 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:10:48.446784 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-606bd5a5-586c-44c8-8e11-14176db62b02 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:10:48.446784 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:10:48.446784 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:10:48.446784 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:10:48.446784 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:10:48.446784 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:10:48.446784 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:10:48.446784 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:10:48.446784 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:10:48.446784 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:10:48.446784 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:10:48.446784 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:10:48.446784 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 19:10:48.446784 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 19:10:48.446784 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 19:10:48.448029 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 19:10:48.448029 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:10:48.448029 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:10:48.448029 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:10:48.448029 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:10:48.448029 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:10:48.448029 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:10:48.448029 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:10:48.448029 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( May 10 19:10:48.448029 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:10:48.448029 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() May 10 19:10:48.448029 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:10:48.448029 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:10:48.448029 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:10:48.448029 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() May 10 19:10:48.448029 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:10:48.448029 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( May 10 19:10:48.449035 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 19:10:48.449035 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 19:10:48.449035 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:10:48.449035 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:10:48.449035 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 628/1237] 10.222.0.70 () {56 vars in 1108 bytes} [Tue May 10 19:10:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:10:48.456710 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204fdeb8-bb0b-4634-b223-2f7d08b1dff4 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:10:48.567035 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204fdeb8-bb0b-4634-b223-2f7d08b1dff4 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:10:48.604975 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6131b99b-7be8-42ac-bde8-fa7ac3034140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:10:48.605787 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6131b99b-7be8-42ac-bde8-fa7ac3034140 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:10:48.606090 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6131b99b-7be8-42ac-bde8-fa7ac3034140 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:10:48.606520 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6131b99b-7be8-42ac-bde8-fa7ac3034140 None admin] PATH_INFO: `/v3/domains` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:10:48.607274 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6131b99b-7be8-42ac-bde8-fa7ac3034140 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:10:48.607682 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6131b99b-7be8-42ac-bde8-fa7ac3034140 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:10:48.609394 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6131b99b-7be8-42ac-bde8-fa7ac3034140 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:10:48.623538 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 610/1238] 10.222.0.70 () {56 vars in 1109 bytes} [Tue May 10 19:10:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:10:48.630142 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606bd5a5-586c-44c8-8e11-14176db62b02 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:10:48.742170 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606bd5a5-586c-44c8-8e11-14176db62b02 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:10:48.778063 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b11c49-49e1-4c92-abf4-45f13d70d2d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:10:48.778879 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b11c49-49e1-4c92-abf4-45f13d70d2d8 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:10:48.779160 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b11c49-49e1-4c92-abf4-45f13d70d2d8 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:10:48.779439 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b11c49-49e1-4c92-abf4-45f13d70d2d8 None admin] PATH_INFO: `/v3/users/placement` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:10:48.787018 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b11c49-49e1-4c92-abf4-45f13d70d2d8 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:10:48.788508 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b11c49-49e1-4c92-abf4-45f13d70d2d8 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:10:48.803911 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-40b11c49-49e1-4c92-abf4-45f13d70d2d8 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 10 19:10:48.803911 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:10:48.803911 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:10:48.803911 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:10:48.803911 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:10:48.803911 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:10:48.803911 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:10:48.803911 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:10:48.803911 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:10:48.803911 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:10:48.803911 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:10:48.803911 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:10:48.803911 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 19:10:48.803911 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 19:10:48.803911 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 19:10:48.803911 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 19:10:48.805691 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:10:48.805691 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:10:48.805691 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 19:10:48.805691 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 19:10:48.805691 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 19:10:48.805691 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 19:10:48.805691 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:10:48.805691 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:10:48.805691 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:10:48.805691 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:10:48.805691 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:10:48.805691 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( May 10 19:10:48.805691 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:10:48.805691 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() May 10 19:10:48.805691 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:10:48.805691 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:10:48.805691 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:10:48.805691 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() May 10 19:10:48.806713 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:10:48.806713 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( May 10 19:10:48.806713 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 19:10:48.806713 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 19:10:48.806713 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 19:10:48.806713 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 19:10:48.806713 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 19:10:48.806713 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 19:10:48.806713 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 10 19:10:48.806713 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:10:48.806713 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 629/1239] 10.222.0.70 () {56 vars in 1108 bytes} [Tue May 10 19:10:48 2022] GET /identity/v3/users/placement => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:10:48.811229 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6131b99b-7be8-42ac-bde8-fa7ac3034140 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:10:48.920651 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6131b99b-7be8-42ac-bde8-fa7ac3034140 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:10:48.957820 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da418638-6101-4b3c-b6ff-c6e00858de81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:10:48.958530 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da418638-6101-4b3c-b6ff-c6e00858de81 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:10:48.958818 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da418638-6101-4b3c-b6ff-c6e00858de81 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:10:48.959098 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da418638-6101-4b3c-b6ff-c6e00858de81 None admin] PATH_INFO: `/v3/users` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:10:48.959939 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da418638-6101-4b3c-b6ff-c6e00858de81 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:10:48.960253 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da418638-6101-4b3c-b6ff-c6e00858de81 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:10:48.961719 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da418638-6101-4b3c-b6ff-c6e00858de81 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:10:48.980286 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 611/1240] 10.222.0.70 () {56 vars in 1143 bytes} [Tue May 10 19:10:48 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:10:48.986213 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b11c49-49e1-4c92-abf4-45f13d70d2d8 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:10:49.091515 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b11c49-49e1-4c92-abf4-45f13d70d2d8 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:10:49.125097 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e426da-e157-4b9d-a761-3f0a03253628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:10:49.125728 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e426da-e157-4b9d-a761-3f0a03253628 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:10:49.126047 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e426da-e157-4b9d-a761-3f0a03253628 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:10:49.126342 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e426da-e157-4b9d-a761-3f0a03253628 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:10:49.193860 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e426da-e157-4b9d-a761-3f0a03253628 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:10:49.195377 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e426da-e157-4b9d-a761-3f0a03253628 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:10:49.295922 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 630/1241] 10.222.0.70 () {58 vars in 1282 bytes} [Tue May 10 19:10:48 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 19:10:49.301867 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da418638-6101-4b3c-b6ff-c6e00858de81 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:10:49.410007 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da418638-6101-4b3c-b6ff-c6e00858de81 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:10:49.445631 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee12418-75d1-405a-a619-35a9b3c49430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:10:49.446509 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee12418-75d1-405a-a619-35a9b3c49430 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:10:49.447538 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee12418-75d1-405a-a619-35a9b3c49430 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:10:49.447939 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee12418-75d1-405a-a619-35a9b3c49430 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:10:49.460301 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee12418-75d1-405a-a619-35a9b3c49430 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:10:49.462150 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee12418-75d1-405a-a619-35a9b3c49430 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:10:49.482272 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application [None req-0ee12418-75d1-405a-a619-35a9b3c49430 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:10:49.482272 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:10:49.482272 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:10:49.482272 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:10:49.482272 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:10:49.482272 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:10:49.482272 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:10:49.482272 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:10:49.482272 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:10:49.482272 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:10:49.482272 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:10:49.482272 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:10:49.482272 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 19:10:49.482272 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 19:10:49.482272 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 19:10:49.483372 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 19:10:49.483372 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:10:49.483372 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:10:49.483372 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:10:49.483372 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:10:49.483372 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:10:49.483372 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:10:49.483372 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:10:49.483372 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application with Lock( May 10 19:10:49.483372 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:10:49.483372 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._enter() May 10 19:10:49.483372 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:10:49.483372 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:10:49.483372 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:10:49.483372 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.creator() May 10 19:10:49.483372 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:10:49.483372 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application created_value = creator( May 10 19:10:49.484533 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 19:10:49.484533 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 19:10:49.484533 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:10:49.484533 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application May 10 19:10:49.484533 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 612/1242] 10.222.0.70 () {56 vars in 1108 bytes} [Tue May 10 19:10:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:10:49.491328 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e426da-e157-4b9d-a761-3f0a03253628 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:10:49.593510 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e426da-e157-4b9d-a761-3f0a03253628 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:10:49.637374 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6001b3a-6b63-46ef-b504-5a1b7750e795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:10:49.638047 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6001b3a-6b63-46ef-b504-5a1b7750e795 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:10:49.638369 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6001b3a-6b63-46ef-b504-5a1b7750e795 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:10:49.638598 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6001b3a-6b63-46ef-b504-5a1b7750e795 None admin] PATH_INFO: `/v3/domains` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:10:49.639323 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6001b3a-6b63-46ef-b504-5a1b7750e795 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:10:49.639717 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6001b3a-6b63-46ef-b504-5a1b7750e795 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:10:49.641031 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6001b3a-6b63-46ef-b504-5a1b7750e795 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:10:49.653840 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 631/1243] 10.222.0.70 () {56 vars in 1109 bytes} [Tue May 10 19:10:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:10:49.659988 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee12418-75d1-405a-a619-35a9b3c49430 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:10:49.763416 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee12418-75d1-405a-a619-35a9b3c49430 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:10:49.796624 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fe2bf7-a317-4935-aa33-5f4489e15eff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:10:49.797487 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fe2bf7-a317-4935-aa33-5f4489e15eff None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:10:49.797855 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fe2bf7-a317-4935-aa33-5f4489e15eff None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:10:49.798248 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fe2bf7-a317-4935-aa33-5f4489e15eff None admin] PATH_INFO: `/v3/projects/service` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:10:49.806047 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fe2bf7-a317-4935-aa33-5f4489e15eff None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:10:49.807989 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fe2bf7-a317-4935-aa33-5f4489e15eff None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:10:49.821672 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application [None req-d2fe2bf7-a317-4935-aa33-5f4489e15eff None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 19:10:49.821672 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:10:49.821672 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:10:49.821672 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:10:49.821672 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:10:49.821672 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:10:49.821672 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:10:49.821672 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:10:49.821672 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:10:49.821672 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:10:49.821672 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:10:49.821672 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:10:49.821672 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 19:10:49.821672 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 19:10:49.821672 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 19:10:49.823723 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 19:10:49.823723 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:10:49.823723 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:10:49.823723 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:10:49.823723 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:10:49.823723 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:10:49.823723 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:10:49.823723 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:10:49.823723 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application with Lock( May 10 19:10:49.823723 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:10:49.823723 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._enter() May 10 19:10:49.823723 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:10:49.823723 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:10:49.823723 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:10:49.823723 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.creator() May 10 19:10:49.823723 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:10:49.823723 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application created_value = creator( May 10 19:10:49.824687 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 19:10:49.824687 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 19:10:49.824687 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 19:10:49.824687 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 19:10:49.824687 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 19:10:49.824687 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 19:10:49.824687 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 19:10:49.824687 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application May 10 19:10:49.824687 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 613/1244] 10.222.0.70 () {56 vars in 1111 bytes} [Tue May 10 19:10:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 19:10:49.830677 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6001b3a-6b63-46ef-b504-5a1b7750e795 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:10:49.934048 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6001b3a-6b63-46ef-b504-5a1b7750e795 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:10:49.967750 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a397ab49-d3ac-4dfd-95ee-d6ce257cf572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:10:49.968457 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a397ab49-d3ac-4dfd-95ee-d6ce257cf572 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:10:49.968719 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a397ab49-d3ac-4dfd-95ee-d6ce257cf572 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:10:49.968997 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a397ab49-d3ac-4dfd-95ee-d6ce257cf572 None admin] PATH_INFO: `/v3/projects` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:10:49.969786 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a397ab49-d3ac-4dfd-95ee-d6ce257cf572 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:10:49.970094 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a397ab49-d3ac-4dfd-95ee-d6ce257cf572 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:10:49.971577 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a397ab49-d3ac-4dfd-95ee-d6ce257cf572 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:10:49.984578 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 632/1245] 10.222.0.70 () {56 vars in 1148 bytes} [Tue May 10 19:10:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:10:49.991108 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fe2bf7-a317-4935-aa33-5f4489e15eff None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:10:50.094050 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fe2bf7-a317-4935-aa33-5f4489e15eff None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:10:50.126823 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214cb182-fed0-420e-a82d-ddaf9b894760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:10:50.127491 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214cb182-fed0-420e-a82d-ddaf9b894760 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:10:50.127761 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214cb182-fed0-420e-a82d-ddaf9b894760 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:10:50.128043 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214cb182-fed0-420e-a82d-ddaf9b894760 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:10:50.128915 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214cb182-fed0-420e-a82d-ddaf9b894760 None admin] RBAC: Adding query filter params (role.id=445805bec1e741c9b823495ae6e364f0, scope.project.id=2ee9ec5b515440fe9b39aedf3e339c79, user.id=11b95d3824f34cfcada6915ee57a7e08) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:10:50.129208 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214cb182-fed0-420e-a82d-ddaf9b894760 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:10:50.130644 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214cb182-fed0-420e-a82d-ddaf9b894760 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:10:50.136959 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 614/1246] 10.222.0.70 () {56 vars in 1374 bytes} [Tue May 10 19:10:49 2022] GET /identity/v3/role_assignments?user.id=11b95d3824f34cfcada6915ee57a7e08&scope.project.id=2ee9ec5b515440fe9b39aedf3e339c79&role.id=445805bec1e741c9b823495ae6e364f0 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:10:52.618045 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02096aa-fc54-4949-bc77-913b498967f1 None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:10:52.618635 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02096aa-fc54-4949-bc77-913b498967f1 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:10:52.618635 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02096aa-fc54-4949-bc77-913b498967f1 None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:10:52.620173 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 633/1247] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:10:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 19:10:52.625429 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99445a1f-52d3-449e-8c1b-0f95bf7b011d None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:10:52.625932 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99445a1f-52d3-449e-8c1b-0f95bf7b011d None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:10:52.626038 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99445a1f-52d3-449e-8c1b-0f95bf7b011d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:10:52.646240 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-99445a1f-52d3-449e-8c1b-0f95bf7b011d None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:10:52.647449 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-99445a1f-52d3-449e-8c1b-0f95bf7b011d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:10:52.720364 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 615/1248] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:10:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 19:10:52.744965 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02096aa-fc54-4949-bc77-913b498967f1 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:10:52.856206 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02096aa-fc54-4949-bc77-913b498967f1 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:10:52.896721 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175c4594-01b2-4a0d-b856-758f79c3ab70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:10:52.897435 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175c4594-01b2-4a0d-b856-758f79c3ab70 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:10:52.897719 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175c4594-01b2-4a0d-b856-758f79c3ab70 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:10:52.897990 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175c4594-01b2-4a0d-b856-758f79c3ab70 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:10:52.907688 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175c4594-01b2-4a0d-b856-758f79c3ab70 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:10:52.916232 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-175c4594-01b2-4a0d-b856-758f79c3ab70 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 19:10:52.916232 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:10:52.916232 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:10:52.916232 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:10:52.916232 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:10:52.916232 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:10:52.916232 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:10:52.916232 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:10:52.916232 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:10:52.916232 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:10:52.916232 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:10:52.916232 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:10:52.916232 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:10:52.916232 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:10:52.916232 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:10:52.916232 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:10:52.917543 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:10:52.917543 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:10:52.917543 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:10:52.917543 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:10:52.917543 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:10:52.917543 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:10:52.917543 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:10:52.917543 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:10:52.917543 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:10:52.917543 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:10:52.917543 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:10:52.917543 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( May 10 19:10:52.917543 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:10:52.917543 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() May 10 19:10:52.917543 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:10:52.917543 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:10:52.918515 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:10:52.918515 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() May 10 19:10:52.918515 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:10:52.918515 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( May 10 19:10:52.918515 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:10:52.918515 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:10:52.918515 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:10:52.918515 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:10:52.918515 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:10:52.918515 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:10:52.918515 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 19:10:52.918515 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:10:52.918515 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 634/1249] 10.222.0.70 () {56 vars in 1096 bytes} [Tue May 10 19:10:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:10:52.923647 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99445a1f-52d3-449e-8c1b-0f95bf7b011d None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:10:53.030469 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99445a1f-52d3-449e-8c1b-0f95bf7b011d None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:10:53.075997 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92c45af-62cd-47ac-a58e-b17acfd7c95f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:10:53.076706 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92c45af-62cd-47ac-a58e-b17acfd7c95f None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:10:53.076987 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92c45af-62cd-47ac-a58e-b17acfd7c95f None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:10:53.077296 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92c45af-62cd-47ac-a58e-b17acfd7c95f None admin] PATH_INFO: `/v3/roles` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:10:53.078051 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92c45af-62cd-47ac-a58e-b17acfd7c95f None admin] RBAC: Adding query filter params (name=admin) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:10:53.078354 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92c45af-62cd-47ac-a58e-b17acfd7c95f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:10:53.079973 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92c45af-62cd-47ac-a58e-b17acfd7c95f None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:10:53.088909 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 616/1250] 10.222.0.70 () {56 vars in 1099 bytes} [Tue May 10 19:10:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:10:53.094784 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175c4594-01b2-4a0d-b856-758f79c3ab70 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:10:53.208776 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175c4594-01b2-4a0d-b856-758f79c3ab70 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:10:53.245653 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b76f28-9a81-4b8b-b5c9-5fe563edbf01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:10:53.246482 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b76f28-9a81-4b8b-b5c9-5fe563edbf01 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:10:53.246734 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b76f28-9a81-4b8b-b5c9-5fe563edbf01 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:10:53.247056 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b76f28-9a81-4b8b-b5c9-5fe563edbf01 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:10:53.258010 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b76f28-9a81-4b8b-b5c9-5fe563edbf01 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:10:53.259638 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b76f28-9a81-4b8b-b5c9-5fe563edbf01 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:10:53.279538 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-39b76f28-9a81-4b8b-b5c9-5fe563edbf01 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:10:53.279538 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:10:53.279538 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:10:53.279538 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:10:53.279538 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:10:53.279538 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:10:53.279538 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:10:53.279538 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:10:53.279538 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:10:53.279538 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:10:53.279538 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:10:53.279538 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:10:53.279538 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 19:10:53.279538 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 19:10:53.279538 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 19:10:53.280709 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 19:10:53.280709 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:10:53.280709 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:10:53.280709 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:10:53.280709 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:10:53.280709 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:10:53.280709 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:10:53.280709 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:10:53.280709 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( May 10 19:10:53.280709 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:10:53.280709 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() May 10 19:10:53.280709 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:10:53.280709 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:10:53.280709 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:10:53.280709 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() May 10 19:10:53.280709 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:10:53.280709 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( May 10 19:10:53.281706 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 19:10:53.281706 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 19:10:53.281706 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:10:53.281706 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:10:53.281706 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 635/1251] 10.222.0.70 () {56 vars in 1108 bytes} [Tue May 10 19:10:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:10:53.288179 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92c45af-62cd-47ac-a58e-b17acfd7c95f None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:10:53.388589 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92c45af-62cd-47ac-a58e-b17acfd7c95f None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:10:53.422103 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9267f1ba-acb1-4a51-b311-0b2a7eae83a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:10:53.422764 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9267f1ba-acb1-4a51-b311-0b2a7eae83a9 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:10:53.423120 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9267f1ba-acb1-4a51-b311-0b2a7eae83a9 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:10:53.423430 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9267f1ba-acb1-4a51-b311-0b2a7eae83a9 None admin] PATH_INFO: `/v3/domains` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:10:53.424141 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9267f1ba-acb1-4a51-b311-0b2a7eae83a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:10:53.424469 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9267f1ba-acb1-4a51-b311-0b2a7eae83a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:10:53.425842 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9267f1ba-acb1-4a51-b311-0b2a7eae83a9 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:10:53.437890 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 617/1252] 10.222.0.70 () {56 vars in 1109 bytes} [Tue May 10 19:10:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:10:53.443856 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b76f28-9a81-4b8b-b5c9-5fe563edbf01 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:10:53.546542 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b76f28-9a81-4b8b-b5c9-5fe563edbf01 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:10:53.584869 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe37d309-8355-497c-8634-43be7d16658d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:10:53.585682 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe37d309-8355-497c-8634-43be7d16658d None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:10:53.585965 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe37d309-8355-497c-8634-43be7d16658d None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:10:53.586236 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe37d309-8355-497c-8634-43be7d16658d None admin] PATH_INFO: `/v3/users/placement` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:10:53.596328 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe37d309-8355-497c-8634-43be7d16658d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:10:53.598134 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe37d309-8355-497c-8634-43be7d16658d None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:10:53.615906 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-fe37d309-8355-497c-8634-43be7d16658d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 10 19:10:53.615906 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:10:53.615906 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:10:53.615906 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:10:53.615906 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:10:53.615906 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:10:53.615906 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:10:53.615906 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:10:53.615906 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:10:53.615906 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:10:53.615906 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:10:53.615906 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:10:53.615906 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 19:10:53.615906 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 19:10:53.615906 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 19:10:53.615906 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 19:10:53.617006 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:10:53.617006 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:10:53.617006 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 19:10:53.617006 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 19:10:53.617006 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 19:10:53.617006 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 19:10:53.617006 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:10:53.617006 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:10:53.617006 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:10:53.617006 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:10:53.617006 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:10:53.617006 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( May 10 19:10:53.617006 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:10:53.617006 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() May 10 19:10:53.617006 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:10:53.617006 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:10:53.617006 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:10:53.617006 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() May 10 19:10:53.617982 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:10:53.617982 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( May 10 19:10:53.617982 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 19:10:53.617982 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 19:10:53.617982 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 19:10:53.617982 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 19:10:53.617982 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 19:10:53.617982 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 19:10:53.617982 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 10 19:10:53.617982 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:10:53.617982 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 636/1253] 10.222.0.70 () {56 vars in 1108 bytes} [Tue May 10 19:10:53 2022] GET /identity/v3/users/placement => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 19:10:53.623999 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9267f1ba-acb1-4a51-b311-0b2a7eae83a9 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:10:53.730545 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9267f1ba-acb1-4a51-b311-0b2a7eae83a9 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:10:53.764343 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec67f2ff-ea6f-4b65-a5be-55281080ba88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:10:53.765107 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec67f2ff-ea6f-4b65-a5be-55281080ba88 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:10:53.765369 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec67f2ff-ea6f-4b65-a5be-55281080ba88 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:10:53.765644 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec67f2ff-ea6f-4b65-a5be-55281080ba88 None admin] PATH_INFO: `/v3/users` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:10:53.766478 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec67f2ff-ea6f-4b65-a5be-55281080ba88 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:10:53.766785 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec67f2ff-ea6f-4b65-a5be-55281080ba88 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:10:53.768209 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec67f2ff-ea6f-4b65-a5be-55281080ba88 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:10:53.785100 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 618/1254] 10.222.0.70 () {56 vars in 1143 bytes} [Tue May 10 19:10:53 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:10:53.791705 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe37d309-8355-497c-8634-43be7d16658d None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:10:53.892832 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe37d309-8355-497c-8634-43be7d16658d None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:10:53.927921 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bb2637-1f8e-405c-88a6-c352c244042a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:10:53.928632 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bb2637-1f8e-405c-88a6-c352c244042a None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:10:53.928943 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bb2637-1f8e-405c-88a6-c352c244042a None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:10:53.929176 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bb2637-1f8e-405c-88a6-c352c244042a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:10:54.004393 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bb2637-1f8e-405c-88a6-c352c244042a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:10:54.005886 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bb2637-1f8e-405c-88a6-c352c244042a None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:10:54.110337 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 637/1255] 10.222.0.70 () {58 vars in 1282 bytes} [Tue May 10 19:10:53 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 10 19:10:54.111625 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec67f2ff-ea6f-4b65-a5be-55281080ba88 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:10:54.211855 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec67f2ff-ea6f-4b65-a5be-55281080ba88 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:10:54.246499 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b7a732-a993-4f9b-9250-b892a5f4fa2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:10:54.247314 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b7a732-a993-4f9b-9250-b892a5f4fa2f None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:10:54.247601 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b7a732-a993-4f9b-9250-b892a5f4fa2f None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:10:54.247875 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b7a732-a993-4f9b-9250-b892a5f4fa2f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:10:54.258599 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b7a732-a993-4f9b-9250-b892a5f4fa2f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:10:54.260672 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b7a732-a993-4f9b-9250-b892a5f4fa2f None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:10:54.278709 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application [None req-41b7a732-a993-4f9b-9250-b892a5f4fa2f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:10:54.278709 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:10:54.278709 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:10:54.278709 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:10:54.278709 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:10:54.278709 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:10:54.278709 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:10:54.278709 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:10:54.278709 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:10:54.278709 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:10:54.278709 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:10:54.278709 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:10:54.278709 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 19:10:54.278709 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 19:10:54.278709 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 19:10:54.279862 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 19:10:54.279862 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:10:54.279862 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:10:54.279862 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:10:54.279862 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:10:54.279862 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:10:54.279862 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:10:54.279862 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:10:54.279862 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application with Lock( May 10 19:10:54.279862 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:10:54.279862 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._enter() May 10 19:10:54.279862 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:10:54.279862 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:10:54.279862 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:10:54.279862 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.creator() May 10 19:10:54.279862 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:10:54.279862 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application created_value = creator( May 10 19:10:54.280979 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 19:10:54.280979 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 19:10:54.280979 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:10:54.280979 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application May 10 19:10:54.280979 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 619/1256] 10.222.0.70 () {56 vars in 1108 bytes} [Tue May 10 19:10:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:10:54.285755 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bb2637-1f8e-405c-88a6-c352c244042a None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:10:54.382858 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bb2637-1f8e-405c-88a6-c352c244042a None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:10:54.417286 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e6750d-8649-4e6e-9076-aa593c74b8f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:10:54.417949 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e6750d-8649-4e6e-9076-aa593c74b8f3 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:10:54.418225 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e6750d-8649-4e6e-9076-aa593c74b8f3 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:10:54.418493 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e6750d-8649-4e6e-9076-aa593c74b8f3 None admin] PATH_INFO: `/v3/domains` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:10:54.419205 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e6750d-8649-4e6e-9076-aa593c74b8f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:10:54.419499 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e6750d-8649-4e6e-9076-aa593c74b8f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:10:54.420902 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e6750d-8649-4e6e-9076-aa593c74b8f3 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:10:54.432655 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 638/1257] 10.222.0.70 () {56 vars in 1109 bytes} [Tue May 10 19:10:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:10:54.438271 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b7a732-a993-4f9b-9250-b892a5f4fa2f None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:10:54.537049 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b7a732-a993-4f9b-9250-b892a5f4fa2f None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:10:54.568554 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57481e10-a02e-4579-b316-96bbb28b513f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:10:54.569344 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57481e10-a02e-4579-b316-96bbb28b513f None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:10:54.569626 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57481e10-a02e-4579-b316-96bbb28b513f None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:10:54.569899 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57481e10-a02e-4579-b316-96bbb28b513f None admin] PATH_INFO: `/v3/projects/service` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:10:54.576739 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57481e10-a02e-4579-b316-96bbb28b513f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:10:54.578172 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57481e10-a02e-4579-b316-96bbb28b513f None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:10:54.592319 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application [None req-57481e10-a02e-4579-b316-96bbb28b513f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 19:10:54.592319 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:10:54.592319 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:10:54.592319 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:10:54.592319 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:10:54.592319 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:10:54.592319 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:10:54.592319 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:10:54.592319 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:10:54.592319 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:10:54.592319 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:10:54.592319 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:10:54.592319 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 19:10:54.592319 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 19:10:54.592319 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 19:10:54.593605 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 19:10:54.593605 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:10:54.593605 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:10:54.593605 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:10:54.593605 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:10:54.593605 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:10:54.593605 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:10:54.593605 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:10:54.593605 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application with Lock( May 10 19:10:54.593605 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:10:54.593605 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._enter() May 10 19:10:54.593605 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:10:54.593605 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:10:54.593605 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:10:54.593605 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.creator() May 10 19:10:54.593605 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:10:54.593605 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application created_value = creator( May 10 19:10:54.594811 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 19:10:54.594811 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 19:10:54.594811 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 19:10:54.594811 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 19:10:54.594811 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 19:10:54.594811 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 19:10:54.594811 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 19:10:54.594811 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application May 10 19:10:54.594811 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 620/1258] 10.222.0.70 () {56 vars in 1111 bytes} [Tue May 10 19:10:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:10:54.600615 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e6750d-8649-4e6e-9076-aa593c74b8f3 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:10:54.700728 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e6750d-8649-4e6e-9076-aa593c74b8f3 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:10:54.732436 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa47b325-efa9-49ac-a6f7-7c8cb915f517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:10:54.733106 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa47b325-efa9-49ac-a6f7-7c8cb915f517 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:10:54.733390 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa47b325-efa9-49ac-a6f7-7c8cb915f517 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:10:54.733663 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa47b325-efa9-49ac-a6f7-7c8cb915f517 None admin] PATH_INFO: `/v3/projects` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:10:54.734435 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa47b325-efa9-49ac-a6f7-7c8cb915f517 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:10:54.734741 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa47b325-efa9-49ac-a6f7-7c8cb915f517 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:10:54.736156 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa47b325-efa9-49ac-a6f7-7c8cb915f517 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:10:54.747427 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 639/1259] 10.222.0.70 () {56 vars in 1148 bytes} [Tue May 10 19:10:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:10:54.753391 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57481e10-a02e-4579-b316-96bbb28b513f None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:10:54.850262 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57481e10-a02e-4579-b316-96bbb28b513f None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:10:54.881867 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abd5e84-ffb2-482b-bc88-41f422517b20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:10:54.882505 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abd5e84-ffb2-482b-bc88-41f422517b20 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:10:54.882791 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abd5e84-ffb2-482b-bc88-41f422517b20 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:10:54.883069 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abd5e84-ffb2-482b-bc88-41f422517b20 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:10:54.883887 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abd5e84-ffb2-482b-bc88-41f422517b20 None admin] RBAC: Adding query filter params (role.id=634ba284303b4626b5a0402772c68f5c, scope.project.id=2ee9ec5b515440fe9b39aedf3e339c79, user.id=11b95d3824f34cfcada6915ee57a7e08) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:10:54.884201 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abd5e84-ffb2-482b-bc88-41f422517b20 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:10:54.885663 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abd5e84-ffb2-482b-bc88-41f422517b20 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:10:54.890782 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 621/1260] 10.222.0.70 () {56 vars in 1374 bytes} [Tue May 10 19:10:54 2022] GET /identity/v3/role_assignments?user.id=11b95d3824f34cfcada6915ee57a7e08&scope.project.id=2ee9ec5b515440fe9b39aedf3e339c79&role.id=634ba284303b4626b5a0402772c68f5c => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:10:57.057637 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f37abc-1258-4107-8273-2c21d6af31c6 None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:10:57.058129 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f37abc-1258-4107-8273-2c21d6af31c6 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:10:57.058244 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f37abc-1258-4107-8273-2c21d6af31c6 None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:10:57.059565 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 640/1261] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:10:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:10:57.064764 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85859e87-af28-408d-9537-bf04cfbc44fc None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:10:57.065136 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85859e87-af28-408d-9537-bf04cfbc44fc None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:10:57.065325 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85859e87-af28-408d-9537-bf04cfbc44fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:10:57.082191 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-85859e87-af28-408d-9537-bf04cfbc44fc None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:10:57.083361 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-85859e87-af28-408d-9537-bf04cfbc44fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:10:57.145844 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 622/1262] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:10:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 19:10:57.167923 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f37abc-1258-4107-8273-2c21d6af31c6 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:10:57.262560 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f37abc-1258-4107-8273-2c21d6af31c6 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:10:57.294309 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbecb20-0480-46d9-8147-50aa6440c93a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:10:57.295079 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbecb20-0480-46d9-8147-50aa6440c93a None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:10:57.295359 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbecb20-0480-46d9-8147-50aa6440c93a None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:10:57.295630 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbecb20-0480-46d9-8147-50aa6440c93a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:10:57.305095 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbecb20-0480-46d9-8147-50aa6440c93a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:10:57.312625 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-6fbecb20-0480-46d9-8147-50aa6440c93a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 19:10:57.312625 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:10:57.312625 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:10:57.312625 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:10:57.312625 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:10:57.312625 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:10:57.312625 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:10:57.312625 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:10:57.312625 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:10:57.312625 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:10:57.312625 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:10:57.312625 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:10:57.312625 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:10:57.312625 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:10:57.312625 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:10:57.312625 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:10:57.313743 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:10:57.313743 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:10:57.313743 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:10:57.313743 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:10:57.313743 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:10:57.313743 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:10:57.313743 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:10:57.313743 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:10:57.313743 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:10:57.313743 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:10:57.313743 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:10:57.313743 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( May 10 19:10:57.313743 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:10:57.313743 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() May 10 19:10:57.313743 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:10:57.313743 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:10:57.314756 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:10:57.314756 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() May 10 19:10:57.314756 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:10:57.314756 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( May 10 19:10:57.314756 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:10:57.314756 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:10:57.314756 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:10:57.314756 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:10:57.314756 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:10:57.314756 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:10:57.314756 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 19:10:57.314756 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:10:57.314756 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 641/1263] 10.222.0.70 () {56 vars in 1096 bytes} [Tue May 10 19:10:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:10:57.319617 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85859e87-af28-408d-9537-bf04cfbc44fc None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:10:57.412281 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85859e87-af28-408d-9537-bf04cfbc44fc None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:10:57.443785 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9435dc-352b-4387-878f-2f358707b511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:10:57.444513 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9435dc-352b-4387-878f-2f358707b511 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:10:57.444748 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9435dc-352b-4387-878f-2f358707b511 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:10:57.445027 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9435dc-352b-4387-878f-2f358707b511 None admin] PATH_INFO: `/v3/roles` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:10:57.445762 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9435dc-352b-4387-878f-2f358707b511 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:10:57.446067 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9435dc-352b-4387-878f-2f358707b511 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:10:57.447454 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9435dc-352b-4387-878f-2f358707b511 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:10:57.455229 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 623/1264] 10.222.0.70 () {56 vars in 1099 bytes} [Tue May 10 19:10:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:10:57.460834 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbecb20-0480-46d9-8147-50aa6440c93a None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:10:57.553648 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbecb20-0480-46d9-8147-50aa6440c93a None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:10:57.593422 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaf65a7-d94a-4b30-9c5d-d441e4b33569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:10:57.594212 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaf65a7-d94a-4b30-9c5d-d441e4b33569 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:10:57.594450 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaf65a7-d94a-4b30-9c5d-d441e4b33569 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:10:57.594728 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaf65a7-d94a-4b30-9c5d-d441e4b33569 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:10:57.607020 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aaf65a7-d94a-4b30-9c5d-d441e4b33569 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:10:57.608635 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aaf65a7-d94a-4b30-9c5d-d441e4b33569 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:10:57.626564 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-4aaf65a7-d94a-4b30-9c5d-d441e4b33569 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:10:57.626564 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:10:57.626564 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:10:57.626564 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:10:57.626564 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:10:57.626564 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:10:57.626564 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:10:57.626564 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:10:57.626564 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:10:57.626564 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:10:57.626564 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:10:57.626564 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:10:57.626564 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 19:10:57.626564 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 19:10:57.626564 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 19:10:57.627495 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 19:10:57.627495 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:10:57.627495 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:10:57.627495 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:10:57.627495 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:10:57.627495 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:10:57.627495 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:10:57.627495 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:10:57.627495 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( May 10 19:10:57.627495 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:10:57.627495 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() May 10 19:10:57.627495 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:10:57.627495 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:10:57.627495 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:10:57.627495 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() May 10 19:10:57.627495 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:10:57.627495 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( May 10 19:10:57.628454 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 19:10:57.628454 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 19:10:57.628454 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:10:57.628454 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:10:57.628454 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 642/1265] 10.222.0.70 () {56 vars in 1108 bytes} [Tue May 10 19:10:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:10:57.633919 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9435dc-352b-4387-878f-2f358707b511 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:10:57.735538 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9435dc-352b-4387-878f-2f358707b511 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:10:57.766798 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab01e97c-134d-4f41-b96c-ab3795c38407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:10:57.767455 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab01e97c-134d-4f41-b96c-ab3795c38407 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:10:57.767739 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab01e97c-134d-4f41-b96c-ab3795c38407 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:10:57.768015 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab01e97c-134d-4f41-b96c-ab3795c38407 None admin] PATH_INFO: `/v3/domains` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:10:57.768764 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab01e97c-134d-4f41-b96c-ab3795c38407 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:10:57.769071 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab01e97c-134d-4f41-b96c-ab3795c38407 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:10:57.770436 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab01e97c-134d-4f41-b96c-ab3795c38407 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:10:57.782034 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 624/1266] 10.222.0.70 () {56 vars in 1109 bytes} [Tue May 10 19:10:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:10:57.787596 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaf65a7-d94a-4b30-9c5d-d441e4b33569 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:10:57.880410 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaf65a7-d94a-4b30-9c5d-d441e4b33569 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:10:57.911178 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72931d4-c4df-4b9e-90be-60141f0eadf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:10:57.911958 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72931d4-c4df-4b9e-90be-60141f0eadf8 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:10:57.912234 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72931d4-c4df-4b9e-90be-60141f0eadf8 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:10:57.912528 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72931d4-c4df-4b9e-90be-60141f0eadf8 None admin] PATH_INFO: `/v3/users/placement` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:10:57.919512 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72931d4-c4df-4b9e-90be-60141f0eadf8 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:10:57.920977 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72931d4-c4df-4b9e-90be-60141f0eadf8 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:10:57.934929 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-d72931d4-c4df-4b9e-90be-60141f0eadf8 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 10 19:10:57.934929 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:10:57.934929 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:10:57.934929 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:10:57.934929 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:10:57.934929 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:10:57.934929 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:10:57.934929 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:10:57.934929 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:10:57.934929 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:10:57.934929 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:10:57.934929 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:10:57.934929 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 19:10:57.934929 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 19:10:57.934929 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 19:10:57.934929 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 19:10:57.936051 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:10:57.936051 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:10:57.936051 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 19:10:57.936051 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 19:10:57.936051 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 19:10:57.936051 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 19:10:57.936051 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:10:57.936051 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:10:57.936051 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:10:57.936051 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:10:57.936051 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:10:57.936051 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( May 10 19:10:57.936051 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:10:57.936051 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() May 10 19:10:57.936051 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:10:57.936051 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:10:57.936051 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:10:57.936051 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() May 10 19:10:57.937251 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:10:57.937251 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( May 10 19:10:57.937251 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 19:10:57.937251 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 19:10:57.937251 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 19:10:57.937251 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 19:10:57.937251 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 19:10:57.937251 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 19:10:57.937251 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 10 19:10:57.937251 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:10:57.937251 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 643/1267] 10.222.0.70 () {56 vars in 1108 bytes} [Tue May 10 19:10:57 2022] GET /identity/v3/users/placement => generated 87 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:10:57.941672 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab01e97c-134d-4f41-b96c-ab3795c38407 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:10:58.034340 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab01e97c-134d-4f41-b96c-ab3795c38407 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:10:58.065674 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9e7a1a-4248-472c-be81-d90827ce2a55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:10:58.066332 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9e7a1a-4248-472c-be81-d90827ce2a55 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:10:58.066617 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9e7a1a-4248-472c-be81-d90827ce2a55 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:10:58.066894 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9e7a1a-4248-472c-be81-d90827ce2a55 None admin] PATH_INFO: `/v3/users` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:10:58.067712 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9e7a1a-4248-472c-be81-d90827ce2a55 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:10:58.068026 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9e7a1a-4248-472c-be81-d90827ce2a55 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:10:58.069485 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9e7a1a-4248-472c-be81-d90827ce2a55 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:10:58.086198 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 625/1268] 10.222.0.70 () {56 vars in 1143 bytes} [Tue May 10 19:10:57 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:10:58.091714 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72931d4-c4df-4b9e-90be-60141f0eadf8 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:10:58.186057 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72931d4-c4df-4b9e-90be-60141f0eadf8 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:10:58.217489 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2a6d1f-3d01-4839-a0bd-83deb3ad08c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:10:58.218257 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2a6d1f-3d01-4839-a0bd-83deb3ad08c1 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:10:58.218530 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2a6d1f-3d01-4839-a0bd-83deb3ad08c1 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:10:58.218795 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2a6d1f-3d01-4839-a0bd-83deb3ad08c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:10:58.229093 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2a6d1f-3d01-4839-a0bd-83deb3ad08c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:10:58.230509 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2a6d1f-3d01-4839-a0bd-83deb3ad08c1 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:10:58.246470 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-7b2a6d1f-3d01-4839-a0bd-83deb3ad08c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:10:58.246470 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:10:58.246470 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:10:58.246470 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:10:58.246470 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:10:58.246470 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:10:58.246470 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:10:58.246470 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:10:58.246470 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:10:58.246470 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:10:58.246470 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:10:58.246470 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:10:58.246470 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 19:10:58.246470 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 19:10:58.246470 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 19:10:58.247497 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 19:10:58.247497 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:10:58.247497 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:10:58.247497 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:10:58.247497 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:10:58.247497 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:10:58.247497 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:10:58.247497 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:10:58.247497 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( May 10 19:10:58.247497 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:10:58.247497 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() May 10 19:10:58.247497 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:10:58.247497 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:10:58.247497 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:10:58.247497 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() May 10 19:10:58.247497 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:10:58.247497 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( May 10 19:10:58.252859 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 19:10:58.252859 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 19:10:58.252859 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:10:58.252859 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:10:58.252859 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 644/1269] 10.222.0.70 () {56 vars in 1108 bytes} [Tue May 10 19:10:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:10:58.253201 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9e7a1a-4248-472c-be81-d90827ce2a55 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:10:58.346294 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9e7a1a-4248-472c-be81-d90827ce2a55 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:10:58.377642 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd174ee-64b1-45d9-a58d-908e444aa950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:10:58.378286 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd174ee-64b1-45d9-a58d-908e444aa950 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:10:58.378570 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd174ee-64b1-45d9-a58d-908e444aa950 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:10:58.378845 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd174ee-64b1-45d9-a58d-908e444aa950 None admin] PATH_INFO: `/v3/domains` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:10:58.379547 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd174ee-64b1-45d9-a58d-908e444aa950 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:10:58.379851 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd174ee-64b1-45d9-a58d-908e444aa950 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:10:58.381229 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd174ee-64b1-45d9-a58d-908e444aa950 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:10:58.392261 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 626/1270] 10.222.0.70 () {56 vars in 1109 bytes} [Tue May 10 19:10:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:10:58.397567 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2a6d1f-3d01-4839-a0bd-83deb3ad08c1 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:10:58.493174 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2a6d1f-3d01-4839-a0bd-83deb3ad08c1 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:10:58.524551 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45af364a-7d11-4559-9f96-54584864e51c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:10:58.525847 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45af364a-7d11-4559-9f96-54584864e51c None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:10:58.526128 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45af364a-7d11-4559-9f96-54584864e51c None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:10:58.526398 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45af364a-7d11-4559-9f96-54584864e51c None admin] PATH_INFO: `/v3/projects/service` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:10:58.532791 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45af364a-7d11-4559-9f96-54584864e51c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:10:58.534217 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45af364a-7d11-4559-9f96-54584864e51c None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:10:58.547811 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-45af364a-7d11-4559-9f96-54584864e51c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 19:10:58.547811 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:10:58.547811 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:10:58.547811 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:10:58.547811 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:10:58.547811 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:10:58.547811 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:10:58.547811 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:10:58.547811 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:10:58.547811 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:10:58.547811 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:10:58.547811 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:10:58.547811 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 19:10:58.547811 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 19:10:58.547811 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 19:10:58.548899 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 19:10:58.548899 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:10:58.548899 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:10:58.548899 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:10:58.548899 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:10:58.548899 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:10:58.548899 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:10:58.548899 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:10:58.548899 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( May 10 19:10:58.548899 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:10:58.548899 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() May 10 19:10:58.548899 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:10:58.548899 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:10:58.548899 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:10:58.548899 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() May 10 19:10:58.548899 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:10:58.548899 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( May 10 19:10:58.550155 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 19:10:58.550155 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 19:10:58.550155 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 19:10:58.550155 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 19:10:58.550155 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 19:10:58.550155 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 19:10:58.550155 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 19:10:58.550155 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:10:58.550155 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 645/1271] 10.222.0.70 () {56 vars in 1111 bytes} [Tue May 10 19:10:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:10:58.554503 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd174ee-64b1-45d9-a58d-908e444aa950 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:10:58.654581 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd174ee-64b1-45d9-a58d-908e444aa950 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:10:58.685881 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743b3673-e861-4128-80c6-ae824ea1a690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:10:58.686536 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743b3673-e861-4128-80c6-ae824ea1a690 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:10:58.686821 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743b3673-e861-4128-80c6-ae824ea1a690 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:10:58.687100 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743b3673-e861-4128-80c6-ae824ea1a690 None admin] PATH_INFO: `/v3/projects` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:10:58.687879 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743b3673-e861-4128-80c6-ae824ea1a690 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:10:58.688188 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743b3673-e861-4128-80c6-ae824ea1a690 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:10:58.689682 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743b3673-e861-4128-80c6-ae824ea1a690 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:10:58.702400 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 627/1272] 10.222.0.70 () {56 vars in 1148 bytes} [Tue May 10 19:10:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:10:58.708556 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45af364a-7d11-4559-9f96-54584864e51c None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:10:58.801124 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45af364a-7d11-4559-9f96-54584864e51c None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:10:58.832829 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d3e946-35b3-41c2-8403-1a34a186bf0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:10:58.833696 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d3e946-35b3-41c2-8403-1a34a186bf0d None admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:10:58.833974 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d3e946-35b3-41c2-8403-1a34a186bf0d None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:10:58.834245 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d3e946-35b3-41c2-8403-1a34a186bf0d None admin] PATH_INFO: `/v3/projects/2ee9ec5b515440fe9b39aedf3e339c79/users/11b95d3824f34cfcada6915ee57a7e08/roles/634ba284303b4626b5a0402772c68f5c` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:10:58.836155 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d3e946-35b3-41c2-8403-1a34a186bf0d None admin] RBAC: Authorizing `identity:create_grant(project_id=2ee9ec5b515440fe9b39aedf3e339c79, user_id=11b95d3824f34cfcada6915ee57a7e08, role_id=634ba284303b4626b5a0402772c68f5c)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:10:58.838186 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d3e946-35b3-41c2-8403-1a34a186bf0d None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:10:58.851677 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 646/1273] 10.222.0.70 () {58 vars in 1439 bytes} [Tue May 10 19:10:58 2022] PUT /identity/v3/projects/2ee9ec5b515440fe9b39aedf3e339c79/users/11b95d3824f34cfcada6915ee57a7e08/roles/634ba284303b4626b5a0402772c68f5c => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:11:01.043434 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0606c1b-ccb5-4296-8eba-590994f2d393 None None] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:11:01.043934 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0606c1b-ccb5-4296-8eba-590994f2d393 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:11:01.044029 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0606c1b-ccb5-4296-8eba-590994f2d393 None None] PATH_INFO: `/` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:11:01.045360 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 628/1274] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:11:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:11:01.050514 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a880b9d8-8ad9-47ec-92d9-822bd3dfb3f2 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:11:01.050927 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a880b9d8-8ad9-47ec-92d9-822bd3dfb3f2 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:11:01.051063 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a880b9d8-8ad9-47ec-92d9-822bd3dfb3f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:11:01.067054 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-a880b9d8-8ad9-47ec-92d9-822bd3dfb3f2 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:11:01.068209 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-a880b9d8-8ad9-47ec-92d9-822bd3dfb3f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:11:01.130131 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 647/1275] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:11:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 19:11:01.153739 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0606c1b-ccb5-4296-8eba-590994f2d393 None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:11:01.247672 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0606c1b-ccb5-4296-8eba-590994f2d393 None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:11:01.286712 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf77e9d-814a-4d44-a802-9966e9b69b34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:11:01.287490 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf77e9d-814a-4d44-a802-9966e9b69b34 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:11:01.287770 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf77e9d-814a-4d44-a802-9966e9b69b34 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:11:01.288044 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf77e9d-814a-4d44-a802-9966e9b69b34 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:11:01.297716 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf77e9d-814a-4d44-a802-9966e9b69b34 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:11:01.308071 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application [None req-aaf77e9d-814a-4d44-a802-9966e9b69b34 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 19:11:01.308071 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:11:01.308071 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:11:01.308071 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:11:01.308071 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:11:01.308071 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:11:01.308071 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:11:01.308071 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:11:01.308071 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:11:01.308071 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:11:01.308071 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:11:01.308071 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:11:01.308071 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:11:01.308071 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:11:01.308071 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:11:01.308071 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:11:01.309194 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:11:01.309194 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:11:01.309194 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:11:01.309194 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:11:01.309194 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:11:01.309194 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:11:01.309194 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:11:01.309194 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:11:01.309194 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:11:01.309194 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:11:01.309194 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:11:01.309194 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application with Lock( May 10 19:11:01.309194 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:11:01.309194 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._enter() May 10 19:11:01.309194 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:11:01.309194 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:11:01.310094 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:11:01.310094 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.creator() May 10 19:11:01.310094 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:11:01.310094 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application created_value = creator( May 10 19:11:01.310094 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:11:01.310094 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:11:01.310094 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:11:01.310094 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:11:01.310094 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:11:01.310094 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:11:01.310094 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 19:11:01.310094 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application May 10 19:11:01.310094 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 629/1276] 10.222.0.70 () {56 vars in 1096 bytes} [Tue May 10 19:11:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:11:01.316688 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a880b9d8-8ad9-47ec-92d9-822bd3dfb3f2 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:11:01.410132 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a880b9d8-8ad9-47ec-92d9-822bd3dfb3f2 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:11:01.441637 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843ba715-f9ed-48d0-aad5-d006e09f9383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:11:01.442295 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843ba715-f9ed-48d0-aad5-d006e09f9383 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:11:01.442579 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843ba715-f9ed-48d0-aad5-d006e09f9383 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:11:01.442851 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843ba715-f9ed-48d0-aad5-d006e09f9383 None admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:11:01.443581 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843ba715-f9ed-48d0-aad5-d006e09f9383 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:11:01.443885 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843ba715-f9ed-48d0-aad5-d006e09f9383 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:11:01.445265 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843ba715-f9ed-48d0-aad5-d006e09f9383 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:11:01.453668 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 648/1277] 10.222.0.70 () {56 vars in 1099 bytes} [Tue May 10 19:11:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:11:01.459257 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf77e9d-814a-4d44-a802-9966e9b69b34 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:11:01.551944 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf77e9d-814a-4d44-a802-9966e9b69b34 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:11:01.583674 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01488fcf-4f06-4828-8498-8ffc1375ec97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:11:01.584465 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01488fcf-4f06-4828-8498-8ffc1375ec97 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:11:01.584753 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01488fcf-4f06-4828-8498-8ffc1375ec97 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:11:01.585029 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01488fcf-4f06-4828-8498-8ffc1375ec97 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:11:01.595268 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01488fcf-4f06-4828-8498-8ffc1375ec97 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:11:01.596745 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01488fcf-4f06-4828-8498-8ffc1375ec97 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:11:01.613920 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application [None req-01488fcf-4f06-4828-8498-8ffc1375ec97 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:11:01.613920 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:11:01.613920 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:11:01.613920 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:11:01.613920 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:11:01.613920 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:11:01.613920 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:11:01.613920 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:11:01.613920 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:11:01.613920 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:11:01.613920 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:11:01.613920 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:11:01.613920 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 19:11:01.613920 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 19:11:01.613920 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 19:11:01.614868 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 19:11:01.614868 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:11:01.614868 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:11:01.614868 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:11:01.614868 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:11:01.614868 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:11:01.614868 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:11:01.614868 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:11:01.614868 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application with Lock( May 10 19:11:01.614868 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:11:01.614868 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._enter() May 10 19:11:01.614868 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:11:01.614868 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:11:01.614868 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:11:01.614868 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.creator() May 10 19:11:01.614868 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:11:01.614868 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application created_value = creator( May 10 19:11:01.615883 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 19:11:01.615883 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 19:11:01.615883 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:11:01.615883 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application May 10 19:11:01.615883 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 630/1278] 10.222.0.70 () {56 vars in 1108 bytes} [Tue May 10 19:11:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:11:01.621786 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843ba715-f9ed-48d0-aad5-d006e09f9383 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:11:01.723048 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843ba715-f9ed-48d0-aad5-d006e09f9383 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:11:01.754619 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d60b0c-4a0c-4abd-9064-5c7c9795f26d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:11:01.755268 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d60b0c-4a0c-4abd-9064-5c7c9795f26d None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:11:01.755545 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d60b0c-4a0c-4abd-9064-5c7c9795f26d None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:11:01.755815 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d60b0c-4a0c-4abd-9064-5c7c9795f26d None admin] PATH_INFO: `/v3/domains` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:11:01.756547 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d60b0c-4a0c-4abd-9064-5c7c9795f26d None admin] RBAC: Adding query filter params (name=Default) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:11:01.756851 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d60b0c-4a0c-4abd-9064-5c7c9795f26d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:11:01.758211 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d60b0c-4a0c-4abd-9064-5c7c9795f26d None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:11:01.769235 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 649/1279] 10.222.0.70 () {56 vars in 1109 bytes} [Tue May 10 19:11:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:11:01.774934 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01488fcf-4f06-4828-8498-8ffc1375ec97 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:11:01.868281 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01488fcf-4f06-4828-8498-8ffc1375ec97 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:11:01.899369 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef8c3ae-5371-48f7-a47a-147173edc63a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:11:01.900729 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef8c3ae-5371-48f7-a47a-147173edc63a None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:11:01.901015 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef8c3ae-5371-48f7-a47a-147173edc63a None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:11:01.901291 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef8c3ae-5371-48f7-a47a-147173edc63a None admin] PATH_INFO: `/v3/users/placement` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:11:01.908336 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef8c3ae-5371-48f7-a47a-147173edc63a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:11:01.909804 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef8c3ae-5371-48f7-a47a-147173edc63a None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:11:01.923476 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application [None req-9ef8c3ae-5371-48f7-a47a-147173edc63a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 10 19:11:01.923476 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:11:01.923476 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:11:01.923476 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:11:01.923476 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:11:01.923476 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:11:01.923476 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:11:01.923476 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:11:01.923476 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:11:01.923476 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:11:01.923476 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:11:01.923476 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:11:01.923476 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 19:11:01.923476 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 19:11:01.923476 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 19:11:01.923476 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 19:11:01.924619 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:11:01.924619 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:11:01.924619 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 19:11:01.924619 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 19:11:01.924619 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 19:11:01.924619 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 19:11:01.924619 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:11:01.924619 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:11:01.924619 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:11:01.924619 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:11:01.924619 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:11:01.924619 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application with Lock( May 10 19:11:01.924619 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:11:01.924619 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._enter() May 10 19:11:01.924619 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:11:01.924619 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:11:01.924619 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:11:01.924619 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.creator() May 10 19:11:01.925987 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:11:01.925987 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application created_value = creator( May 10 19:11:01.925987 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 19:11:01.925987 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 19:11:01.925987 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 19:11:01.925987 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 19:11:01.925987 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 19:11:01.925987 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 19:11:01.925987 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 10 19:11:01.925987 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application May 10 19:11:01.925987 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 631/1280] 10.222.0.70 () {56 vars in 1108 bytes} [Tue May 10 19:11:01 2022] GET /identity/v3/users/placement => generated 87 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:11:01.930303 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d60b0c-4a0c-4abd-9064-5c7c9795f26d None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:11:02.030902 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d60b0c-4a0c-4abd-9064-5c7c9795f26d None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:11:02.062558 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0043a1-d92e-4a6a-959d-98e5b9908894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:11:02.063220 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0043a1-d92e-4a6a-959d-98e5b9908894 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:11:02.063498 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0043a1-d92e-4a6a-959d-98e5b9908894 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:11:02.063769 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0043a1-d92e-4a6a-959d-98e5b9908894 None admin] PATH_INFO: `/v3/users` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:11:02.064615 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0043a1-d92e-4a6a-959d-98e5b9908894 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:11:02.064919 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0043a1-d92e-4a6a-959d-98e5b9908894 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:11:02.066329 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0043a1-d92e-4a6a-959d-98e5b9908894 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:11:02.082986 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 650/1281] 10.222.0.70 () {56 vars in 1143 bytes} [Tue May 10 19:11:01 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:11:02.088765 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef8c3ae-5371-48f7-a47a-147173edc63a None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:11:02.181700 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef8c3ae-5371-48f7-a47a-147173edc63a None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:11:02.212895 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe4ea12-77a5-4ee2-9955-d120486db799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:11:02.213526 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe4ea12-77a5-4ee2-9955-d120486db799 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:11:02.213810 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe4ea12-77a5-4ee2-9955-d120486db799 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:11:02.214087 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe4ea12-77a5-4ee2-9955-d120486db799 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:11:02.275860 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe4ea12-77a5-4ee2-9955-d120486db799 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:11:02.277342 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe4ea12-77a5-4ee2-9955-d120486db799 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:11:02.368029 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 632/1282] 10.222.0.70 () {58 vars in 1282 bytes} [Tue May 10 19:11:02 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 19:11:02.373809 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0043a1-d92e-4a6a-959d-98e5b9908894 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:11:02.466265 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0043a1-d92e-4a6a-959d-98e5b9908894 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:11:02.496991 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e331c8-c529-4bd4-b32d-34aecd92990f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:11:02.497768 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e331c8-c529-4bd4-b32d-34aecd92990f None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:11:02.498048 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e331c8-c529-4bd4-b32d-34aecd92990f None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:11:02.498319 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e331c8-c529-4bd4-b32d-34aecd92990f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:11:02.507592 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e331c8-c529-4bd4-b32d-34aecd92990f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:11:02.509594 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e331c8-c529-4bd4-b32d-34aecd92990f None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:11:02.526634 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-f2e331c8-c529-4bd4-b32d-34aecd92990f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:11:02.526634 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:11:02.526634 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:11:02.526634 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:11:02.526634 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:11:02.526634 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:11:02.526634 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:11:02.526634 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:11:02.526634 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:11:02.526634 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:11:02.526634 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:11:02.526634 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:11:02.526634 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 19:11:02.526634 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 19:11:02.526634 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 19:11:02.527714 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 19:11:02.527714 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:11:02.527714 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:11:02.527714 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:11:02.527714 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:11:02.527714 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:11:02.527714 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:11:02.527714 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:11:02.527714 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( May 10 19:11:02.527714 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:11:02.527714 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() May 10 19:11:02.527714 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:11:02.527714 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:11:02.527714 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:11:02.527714 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() May 10 19:11:02.527714 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:11:02.527714 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( May 10 19:11:02.528884 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 19:11:02.528884 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 19:11:02.528884 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:11:02.528884 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:11:02.528884 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 651/1283] 10.222.0.70 () {56 vars in 1108 bytes} [Tue May 10 19:11:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:11:02.533267 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe4ea12-77a5-4ee2-9955-d120486db799 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:11:02.629754 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe4ea12-77a5-4ee2-9955-d120486db799 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:11:02.662120 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61d47a5-60cf-4d02-9f92-a2972498e757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:11:02.662777 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61d47a5-60cf-4d02-9f92-a2972498e757 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:11:02.663061 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61d47a5-60cf-4d02-9f92-a2972498e757 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:11:02.663341 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61d47a5-60cf-4d02-9f92-a2972498e757 None admin] PATH_INFO: `/v3/domains` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:11:02.664040 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61d47a5-60cf-4d02-9f92-a2972498e757 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:11:02.664341 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61d47a5-60cf-4d02-9f92-a2972498e757 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:11:02.665749 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61d47a5-60cf-4d02-9f92-a2972498e757 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:11:02.676200 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 633/1284] 10.222.0.70 () {56 vars in 1109 bytes} [Tue May 10 19:11:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:11:02.681844 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e331c8-c529-4bd4-b32d-34aecd92990f None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:11:02.773691 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e331c8-c529-4bd4-b32d-34aecd92990f None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:11:02.804288 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a17917-e3c1-4eba-a6ce-d3e1e7823624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:11:02.805082 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a17917-e3c1-4eba-a6ce-d3e1e7823624 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:11:02.805365 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a17917-e3c1-4eba-a6ce-d3e1e7823624 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:11:02.806157 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a17917-e3c1-4eba-a6ce-d3e1e7823624 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:11:02.812376 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a17917-e3c1-4eba-a6ce-d3e1e7823624 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:11:02.813871 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a17917-e3c1-4eba-a6ce-d3e1e7823624 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:11:02.827047 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-47a17917-e3c1-4eba-a6ce-d3e1e7823624 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 19:11:02.827047 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:11:02.827047 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:11:02.827047 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:11:02.827047 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:11:02.827047 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:11:02.827047 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:11:02.827047 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:11:02.827047 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:11:02.827047 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:11:02.827047 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:11:02.827047 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:11:02.827047 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 19:11:02.827047 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 19:11:02.827047 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 19:11:02.828116 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 19:11:02.828116 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:11:02.828116 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:11:02.828116 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:11:02.828116 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:11:02.828116 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:11:02.828116 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:11:02.828116 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:11:02.828116 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( May 10 19:11:02.828116 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:11:02.828116 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() May 10 19:11:02.828116 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:11:02.828116 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:11:02.828116 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:11:02.828116 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() May 10 19:11:02.828116 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:11:02.828116 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( May 10 19:11:02.829360 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 19:11:02.829360 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 19:11:02.829360 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 19:11:02.829360 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 19:11:02.829360 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 19:11:02.829360 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 19:11:02.829360 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 19:11:02.829360 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application May 10 19:11:02.829360 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 652/1285] 10.222.0.70 () {56 vars in 1111 bytes} [Tue May 10 19:11:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:11:02.834246 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61d47a5-60cf-4d02-9f92-a2972498e757 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:11:02.928348 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61d47a5-60cf-4d02-9f92-a2972498e757 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:11:02.959520 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dd8266-3c63-48ae-9797-a9d6174812e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:11:02.960173 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dd8266-3c63-48ae-9797-a9d6174812e2 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:11:02.960491 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dd8266-3c63-48ae-9797-a9d6174812e2 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:11:02.960771 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dd8266-3c63-48ae-9797-a9d6174812e2 None admin] PATH_INFO: `/v3/projects` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:11:02.961545 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dd8266-3c63-48ae-9797-a9d6174812e2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:11:02.962382 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dd8266-3c63-48ae-9797-a9d6174812e2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:11:02.963818 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dd8266-3c63-48ae-9797-a9d6174812e2 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:11:02.975151 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 634/1286] 10.222.0.70 () {56 vars in 1148 bytes} [Tue May 10 19:11:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:11:02.981840 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a17917-e3c1-4eba-a6ce-d3e1e7823624 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:11:03.073565 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a17917-e3c1-4eba-a6ce-d3e1e7823624 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:11:03.104924 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f3872b-057a-4d3b-941b-ec77ddae29d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:11:03.105550 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f3872b-057a-4d3b-941b-ec77ddae29d3 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:11:03.105825 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f3872b-057a-4d3b-941b-ec77ddae29d3 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:11:03.106093 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f3872b-057a-4d3b-941b-ec77ddae29d3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:11:03.106903 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f3872b-057a-4d3b-941b-ec77ddae29d3 None admin] RBAC: Adding query filter params (role.id=634ba284303b4626b5a0402772c68f5c, scope.project.id=2ee9ec5b515440fe9b39aedf3e339c79, user.id=11b95d3824f34cfcada6915ee57a7e08) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:11:03.107207 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f3872b-057a-4d3b-941b-ec77ddae29d3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:11:03.108664 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f3872b-057a-4d3b-941b-ec77ddae29d3 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:11:03.114095 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 653/1287] 10.222.0.70 () {56 vars in 1374 bytes} [Tue May 10 19:11:02 2022] GET /identity/v3/role_assignments?user.id=11b95d3824f34cfcada6915ee57a7e08&scope.project.id=2ee9ec5b515440fe9b39aedf3e339c79&role.id=634ba284303b4626b5a0402772c68f5c => generated 608 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:11:05.343663 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5539882-c892-4f4a-bc15-4109c88c12b1 None None] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:11:05.344169 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5539882-c892-4f4a-bc15-4109c88c12b1 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:11:05.344169 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5539882-c892-4f4a-bc15-4109c88c12b1 None None] PATH_INFO: `/` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:11:05.345521 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 635/1288] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:11:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:11:05.350724 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97becd36-431c-4b38-a5c4-21f7720a30d3 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:11:05.351127 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97becd36-431c-4b38-a5c4-21f7720a30d3 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:11:05.351271 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97becd36-431c-4b38-a5c4-21f7720a30d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:11:05.367503 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-97becd36-431c-4b38-a5c4-21f7720a30d3 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:11:05.369237 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-97becd36-431c-4b38-a5c4-21f7720a30d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:11:05.432812 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 654/1289] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:11:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 19:11:05.454602 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5539882-c892-4f4a-bc15-4109c88c12b1 None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:11:05.547355 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5539882-c892-4f4a-bc15-4109c88c12b1 None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:11:05.579639 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de972757-ce73-4497-96ed-9df1b1c723f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:11:05.580451 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de972757-ce73-4497-96ed-9df1b1c723f2 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:11:05.580734 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de972757-ce73-4497-96ed-9df1b1c723f2 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:11:05.581013 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de972757-ce73-4497-96ed-9df1b1c723f2 None admin] PATH_INFO: `/v3/services/placement` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:11:05.581651 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de972757-ce73-4497-96ed-9df1b1c723f2 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:11:05.583015 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de972757-ce73-4497-96ed-9df1b1c723f2 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:11:05.595496 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application [None req-de972757-ce73-4497-96ed-9df1b1c723f2 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 10 19:11:05.595496 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:11:05.595496 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 19:11:05.595496 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 19:11:05.595496 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 19:11:05.595496 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 19:11:05.595496 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 19:11:05.595496 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 19:11:05.595496 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 10 19:11:05.595496 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application May 10 19:11:05.595496 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 19:11:05.595496 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application May 10 19:11:05.595496 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:11:05.595496 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:11:05.595496 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:11:05.595496 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:11:05.595496 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:11:05.596684 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:11:05.596684 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:11:05.596684 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:11:05.596684 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:11:05.596684 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:11:05.596684 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:11:05.596684 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 19:11:05.596684 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 19:11:05.596684 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 19:11:05.596684 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 19:11:05.596684 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:11:05.596684 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:11:05.596684 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:11:05.596684 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:11:05.596684 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:11:05.596684 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:11:05.597766 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:11:05.597766 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application with Lock( May 10 19:11:05.597766 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:11:05.597766 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._enter() May 10 19:11:05.597766 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:11:05.597766 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:11:05.597766 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:11:05.597766 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.creator() May 10 19:11:05.597766 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:11:05.597766 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application created_value = creator( May 10 19:11:05.597766 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 19:11:05.597766 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 19:11:05.597766 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 10 19:11:05.597766 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application May 10 19:11:05.597766 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 636/1290] 10.222.0.70 () {56 vars in 1117 bytes} [Tue May 10 19:11:05 2022] GET /identity/v3/services/placement => generated 90 bytes in 143 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:11:05.603584 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97becd36-431c-4b38-a5c4-21f7720a30d3 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:11:05.705256 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97becd36-431c-4b38-a5c4-21f7720a30d3 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:11:05.736503 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f423601b-4b3b-439f-b8cc-e52fbade95c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:11:05.737159 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f423601b-4b3b-439f-b8cc-e52fbade95c0 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:11:05.737441 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f423601b-4b3b-439f-b8cc-e52fbade95c0 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:11:05.737710 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f423601b-4b3b-439f-b8cc-e52fbade95c0 None admin] PATH_INFO: `/v3/services` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:11:05.738395 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f423601b-4b3b-439f-b8cc-e52fbade95c0 None admin] RBAC: Adding query filter params (name=placement) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:11:05.738696 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f423601b-4b3b-439f-b8cc-e52fbade95c0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:11:05.740064 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f423601b-4b3b-439f-b8cc-e52fbade95c0 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:11:05.745173 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 655/1291] 10.222.0.70 () {56 vars in 1116 bytes} [Tue May 10 19:11:05 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:11:05.751049 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de972757-ce73-4497-96ed-9df1b1c723f2 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:11:05.844349 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de972757-ce73-4497-96ed-9df1b1c723f2 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:11:05.875677 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2741f7da-fa10-470e-8520-5a977a521099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:11:05.876261 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2741f7da-fa10-470e-8520-5a977a521099 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:11:05.876579 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2741f7da-fa10-470e-8520-5a977a521099 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:11:05.876857 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2741f7da-fa10-470e-8520-5a977a521099 None admin] PATH_INFO: `/v3/services` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:11:05.877550 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2741f7da-fa10-470e-8520-5a977a521099 None admin] RBAC: Adding query filter params (type=placement) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:11:05.877854 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2741f7da-fa10-470e-8520-5a977a521099 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:11:05.879212 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2741f7da-fa10-470e-8520-5a977a521099 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:11:05.883386 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 637/1292] 10.222.0.70 () {56 vars in 1116 bytes} [Tue May 10 19:11:05 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:11:08.087921 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2e44cc-f7f3-44da-96cc-a0a4484f018a None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:11:08.088475 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2e44cc-f7f3-44da-96cc-a0a4484f018a None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:11:08.088587 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2e44cc-f7f3-44da-96cc-a0a4484f018a None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:11:08.089880 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 656/1293] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:11:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:11:08.094967 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc78d4c0-7d33-4606-91a9-f14f2b398ff2 None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:11:08.095357 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc78d4c0-7d33-4606-91a9-f14f2b398ff2 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:11:08.095529 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc78d4c0-7d33-4606-91a9-f14f2b398ff2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:11:08.111729 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-fc78d4c0-7d33-4606-91a9-f14f2b398ff2 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:11:08.112927 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-fc78d4c0-7d33-4606-91a9-f14f2b398ff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:11:08.176140 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 638/1294] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:11:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 19:11:08.198700 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2e44cc-f7f3-44da-96cc-a0a4484f018a None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:11:08.299120 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2e44cc-f7f3-44da-96cc-a0a4484f018a None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:11:08.330575 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a080dc04-a269-4237-8881-37c317e94c0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:11:08.331224 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a080dc04-a269-4237-8881-37c317e94c0c None admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:11:08.331509 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a080dc04-a269-4237-8881-37c317e94c0c None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:11:08.331787 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a080dc04-a269-4237-8881-37c317e94c0c None admin] PATH_INFO: `/v3/services` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:11:08.332534 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a080dc04-a269-4237-8881-37c317e94c0c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:11:08.333889 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a080dc04-a269-4237-8881-37c317e94c0c None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:11:08.346774 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 657/1295] 10.222.0.70 () {60 vars in 1141 bytes} [Tue May 10 19:11:08 2022] POST /identity/v3/services => generated 246 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 19:11:10.549888 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cb896b-993d-4880-84d8-6a7da1895c8c None None] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:11:10.550451 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cb896b-993d-4880-84d8-6a7da1895c8c None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:11:10.550451 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cb896b-993d-4880-84d8-6a7da1895c8c None None] PATH_INFO: `/` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:11:10.551772 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 639/1296] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:11:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:11:10.557563 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c72004c-86d3-4b4e-9c23-d45a1460b0b9 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:11:10.557955 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c72004c-86d3-4b4e-9c23-d45a1460b0b9 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:11:10.558121 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c72004c-86d3-4b4e-9c23-d45a1460b0b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:11:10.574803 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-4c72004c-86d3-4b4e-9c23-d45a1460b0b9 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:11:10.575973 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-4c72004c-86d3-4b4e-9c23-d45a1460b0b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:11:10.647313 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 658/1297] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:11:10 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 19:11:10.670171 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cb896b-993d-4880-84d8-6a7da1895c8c None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:11:10.762745 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cb896b-993d-4880-84d8-6a7da1895c8c None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:11:10.793446 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba78037-90ef-4459-9c8c-6b66b7295b75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:11:10.794221 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba78037-90ef-4459-9c8c-6b66b7295b75 None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:11:10.794499 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba78037-90ef-4459-9c8c-6b66b7295b75 None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:11:10.794774 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba78037-90ef-4459-9c8c-6b66b7295b75 None admin] PATH_INFO: `/v3/services/placement` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:11:10.795401 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba78037-90ef-4459-9c8c-6b66b7295b75 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:11:10.796787 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba78037-90ef-4459-9c8c-6b66b7295b75 None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:11:10.808867 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application [None req-aba78037-90ef-4459-9c8c-6b66b7295b75 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 10 19:11:10.808867 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:11:10.808867 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 19:11:10.808867 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 19:11:10.808867 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 19:11:10.808867 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 19:11:10.808867 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 19:11:10.808867 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 19:11:10.808867 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 10 19:11:10.808867 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application May 10 19:11:10.808867 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 19:11:10.808867 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application May 10 19:11:10.808867 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:11:10.808867 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:11:10.808867 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:11:10.808867 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:11:10.808867 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:11:10.810057 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:11:10.810057 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:11:10.810057 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:11:10.810057 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:11:10.810057 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:11:10.810057 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:11:10.810057 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 19:11:10.810057 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 19:11:10.810057 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 19:11:10.810057 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 19:11:10.810057 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:11:10.810057 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:11:10.810057 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:11:10.810057 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:11:10.810057 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:11:10.810057 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:11:10.811120 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:11:10.811120 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application with Lock( May 10 19:11:10.811120 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:11:10.811120 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._enter() May 10 19:11:10.811120 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:11:10.811120 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:11:10.811120 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:11:10.811120 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.creator() May 10 19:11:10.811120 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:11:10.811120 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application created_value = creator( May 10 19:11:10.811120 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 19:11:10.811120 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 19:11:10.811120 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 10 19:11:10.811120 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application May 10 19:11:10.811120 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 640/1298] 10.222.0.70 () {56 vars in 1117 bytes} [Tue May 10 19:11:10 2022] GET /identity/v3/services/placement => generated 90 bytes in 140 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:11:10.815957 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c72004c-86d3-4b4e-9c23-d45a1460b0b9 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:11:10.908374 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c72004c-86d3-4b4e-9c23-d45a1460b0b9 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:11:10.940190 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa963a6-2dae-4abc-ab6e-9282ed891014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:11:10.940865 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa963a6-2dae-4abc-ab6e-9282ed891014 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:11:10.941149 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa963a6-2dae-4abc-ab6e-9282ed891014 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:11:10.941425 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa963a6-2dae-4abc-ab6e-9282ed891014 None admin] PATH_INFO: `/v3/services` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:11:10.942117 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa963a6-2dae-4abc-ab6e-9282ed891014 None admin] RBAC: Adding query filter params (name=placement) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:11:10.942424 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa963a6-2dae-4abc-ab6e-9282ed891014 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:11:10.943789 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa963a6-2dae-4abc-ab6e-9282ed891014 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:11:10.949576 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 659/1299] 10.222.0.70 () {56 vars in 1116 bytes} [Tue May 10 19:11:10 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:11:10.955619 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba78037-90ef-4459-9c8c-6b66b7295b75 None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:11:11.051284 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba78037-90ef-4459-9c8c-6b66b7295b75 None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:11:11.083416 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b71fd9-48dd-453d-b635-33f7801deceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:11:11.084001 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b71fd9-48dd-453d-b635-33f7801deceb None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:11:11.084285 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b71fd9-48dd-453d-b635-33f7801deceb None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:11:11.084594 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b71fd9-48dd-453d-b635-33f7801deceb None admin] PATH_INFO: `/v3/endpoints` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:11:11.085376 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b71fd9-48dd-453d-b635-33f7801deceb None admin] RBAC: Adding query filter params (interface=public, service_id=a3f94dd761654e29bf05bd39d4f385bb, region_id=RegionOne) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:11:11.085687 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b71fd9-48dd-453d-b635-33f7801deceb None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:11:11.087092 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b71fd9-48dd-453d-b635-33f7801deceb None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:11:11.091850 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 641/1300] 10.222.0.70 () {56 vars in 1251 bytes} [Tue May 10 19:11:10 2022] GET /identity/v3/endpoints?service_id=a3f94dd761654e29bf05bd39d4f385bb&interface=public®ion_id=RegionOne => generated 194 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:11:11.097469 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa963a6-2dae-4abc-ab6e-9282ed891014 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:11:11.189421 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa963a6-2dae-4abc-ab6e-9282ed891014 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:11:11.221494 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a4ecf2-b324-42f2-b922-70a6f42b4a8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:11:11.222209 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a4ecf2-b324-42f2-b922-70a6f42b4a8e None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:11:11.222490 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a4ecf2-b324-42f2-b922-70a6f42b4a8e None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:11:11.222759 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a4ecf2-b324-42f2-b922-70a6f42b4a8e None admin] PATH_INFO: `/v3/services` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:11:11.223419 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a4ecf2-b324-42f2-b922-70a6f42b4a8e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:11:11.224782 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a4ecf2-b324-42f2-b922-70a6f42b4a8e None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:11:11.231742 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 660/1301] 10.222.0.70 () {56 vars in 1087 bytes} [Tue May 10 19:11:11 2022] GET /identity/v3/services => generated 2191 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 19:11:13.403738 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f16c37c-b7a9-4baa-a415-fa99af98535e None None] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:11:13.404252 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f16c37c-b7a9-4baa-a415-fa99af98535e None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:11:13.404252 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f16c37c-b7a9-4baa-a415-fa99af98535e None None] PATH_INFO: `/` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:11:13.405584 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 642/1302] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:11:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:11:13.410651 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0333585c-e470-44d0-854b-44d160a72a9c None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:11:13.411073 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0333585c-e470-44d0-854b-44d160a72a9c None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:11:13.411204 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0333585c-e470-44d0-854b-44d160a72a9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:11:13.426799 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-0333585c-e470-44d0-854b-44d160a72a9c None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:11:13.427970 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-0333585c-e470-44d0-854b-44d160a72a9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:11:13.493364 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 661/1303] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:11:13 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 19:11:13.515912 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f16c37c-b7a9-4baa-a415-fa99af98535e None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:11:13.611699 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f16c37c-b7a9-4baa-a415-fa99af98535e None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:11:13.648250 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37e289e-4aaf-408d-9fbb-16a52610e61e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:11:13.649710 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37e289e-4aaf-408d-9fbb-16a52610e61e None admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:11:13.649991 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37e289e-4aaf-408d-9fbb-16a52610e61e None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:11:13.650266 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37e289e-4aaf-408d-9fbb-16a52610e61e None admin] PATH_INFO: `/v3/services/placement` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:11:13.650905 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37e289e-4aaf-408d-9fbb-16a52610e61e None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:11:13.652304 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37e289e-4aaf-408d-9fbb-16a52610e61e None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:11:13.663698 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application [None req-d37e289e-4aaf-408d-9fbb-16a52610e61e None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 10 19:11:13.663698 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:11:13.663698 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 19:11:13.663698 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 19:11:13.663698 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 19:11:13.663698 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 19:11:13.663698 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 19:11:13.663698 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 19:11:13.663698 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 10 19:11:13.663698 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application May 10 19:11:13.663698 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 19:11:13.663698 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application May 10 19:11:13.663698 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:11:13.663698 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:11:13.663698 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:11:13.663698 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:11:13.663698 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:11:13.664924 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:11:13.664924 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:11:13.664924 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:11:13.664924 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:11:13.664924 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:11:13.664924 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:11:13.664924 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 19:11:13.664924 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 19:11:13.664924 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 19:11:13.664924 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 19:11:13.664924 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:11:13.664924 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:11:13.664924 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:11:13.664924 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:11:13.664924 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:11:13.664924 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:11:13.666145 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:11:13.666145 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application with Lock( May 10 19:11:13.666145 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:11:13.666145 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self._enter() May 10 19:11:13.666145 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:11:13.666145 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:11:13.666145 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:11:13.666145 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application return self.creator() May 10 19:11:13.666145 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:11:13.666145 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application created_value = creator( May 10 19:11:13.666145 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 19:11:13.666145 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 19:11:13.666145 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 10 19:11:13.666145 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: ERROR keystone.server.flask.application May 10 19:11:13.666145 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 643/1304] 10.222.0.70 () {56 vars in 1117 bytes} [Tue May 10 19:11:13 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:11:13.670970 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0333585c-e470-44d0-854b-44d160a72a9c None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:11:13.763265 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0333585c-e470-44d0-854b-44d160a72a9c None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:11:13.793713 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111c8add-a54d-42c6-9b47-ee43899e3867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:11:13.794356 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111c8add-a54d-42c6-9b47-ee43899e3867 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:11:13.794635 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111c8add-a54d-42c6-9b47-ee43899e3867 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:11:13.794905 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111c8add-a54d-42c6-9b47-ee43899e3867 None admin] PATH_INFO: `/v3/services` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:11:13.795593 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111c8add-a54d-42c6-9b47-ee43899e3867 None admin] RBAC: Adding query filter params (name=placement) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:11:13.795896 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111c8add-a54d-42c6-9b47-ee43899e3867 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:11:13.797263 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111c8add-a54d-42c6-9b47-ee43899e3867 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:11:13.802105 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 662/1305] 10.222.0.70 () {56 vars in 1116 bytes} [Tue May 10 19:11:13 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:11:13.808253 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37e289e-4aaf-408d-9fbb-16a52610e61e None admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:11:13.902606 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37e289e-4aaf-408d-9fbb-16a52610e61e None admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:11:13.933957 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7781b8f-b437-4d87-ae96-40a54f4211ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:11:13.934591 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7781b8f-b437-4d87-ae96-40a54f4211ec None admin] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:11:13.934877 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7781b8f-b437-4d87-ae96-40a54f4211ec None admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:11:13.935156 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7781b8f-b437-4d87-ae96-40a54f4211ec None admin] PATH_INFO: `/v3/endpoints` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:11:13.935889 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7781b8f-b437-4d87-ae96-40a54f4211ec None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:11:13.937278 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7781b8f-b437-4d87-ae96-40a54f4211ec None admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:11:13.955180 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 644/1306] 10.222.0.70 () {60 vars in 1144 bytes} [Tue May 10 19:11:13 2022] POST /identity/v3/endpoints => generated 331 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 19:12:17.091848 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39744c52-94ad-46bb-a0cd-4f704ba8e6e3 None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:12:17.092404 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39744c52-94ad-46bb-a0cd-4f704ba8e6e3 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:12:17.092404 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39744c52-94ad-46bb-a0cd-4f704ba8e6e3 None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:12:17.093789 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 663/1307] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:12:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:12:17.099666 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df61eea-ffb4-478d-b88e-b9dc88aec97a None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:12:17.100101 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df61eea-ffb4-478d-b88e-b9dc88aec97a None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:12:17.100224 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df61eea-ffb4-478d-b88e-b9dc88aec97a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:12:17.172131 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-7df61eea-ffb4-478d-b88e-b9dc88aec97a None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:12:17.174305 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-7df61eea-ffb4-478d-b88e-b9dc88aec97a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:12:17.317195 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 645/1308] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:12:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:12:17.360240 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7ebd93-ef2f-4dcd-b75c-4baae8be878c None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:12:17.360852 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7ebd93-ef2f-4dcd-b75c-4baae8be878c None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:12:17.361288 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7ebd93-ef2f-4dcd-b75c-4baae8be878c None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:12:17.363277 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 664/1309] 10.222.0.70 () {54 vars in 964 bytes} [Tue May 10 19:12:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:12:17.371230 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cec490-6c2c-49ad-b767-40214d89b825 None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:12:17.371611 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cec490-6c2c-49ad-b767-40214d89b825 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:12:17.371962 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cec490-6c2c-49ad-b767-40214d89b825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:12:17.449764 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-e2cec490-6c2c-49ad-b767-40214d89b825 None None] MFA Rules not processed for user `91f1dc79540b48c0866478cc48cd8205`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:12:17.450985 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-e2cec490-6c2c-49ad-b767-40214d89b825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:12:17.525850 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 646/1310] 10.222.0.70 () {58 vars in 1061 bytes} [Tue May 10 19:12:17 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:12:17.534801 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7ebd93-ef2f-4dcd-b75c-4baae8be878c None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:12:17.537319 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-4f7ebd93-ef2f-4dcd-b75c-4baae8be878c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:12:17.655781 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7ebd93-ef2f-4dcd-b75c-4baae8be878c None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:12:17.727682 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0bdaf6-4317-4bc9-9886-c6dad101adb8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f1dc79540b48c0866478cc48cd8205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:12:17.728327 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0bdaf6-4317-4bc9-9886-c6dad101adb8 service neutron] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:12:17.728650 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0bdaf6-4317-4bc9-9886-c6dad101adb8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:12:17.728925 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0bdaf6-4317-4bc9-9886-c6dad101adb8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:12:17.730544 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-fe0bdaf6-4317-4bc9-9886-c6dad101adb8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:12:17.839677 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0bdaf6-4317-4bc9-9886-c6dad101adb8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:12:17.841084 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0bdaf6-4317-4bc9-9886-c6dad101adb8 service neutron] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:12:17.860560 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 665/1311] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:12:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:12:20.414427 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feacbe07-caec-42fc-a42a-4107b7057f44 None None] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:12:20.414961 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feacbe07-caec-42fc-a42a-4107b7057f44 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:12:20.414961 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feacbe07-caec-42fc-a42a-4107b7057f44 None None] PATH_INFO: `/` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:12:20.416390 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 647/1312] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:12:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:12:20.421766 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ce63a8-82ff-403d-afe7-1cffcb09d846 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:12:20.422166 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ce63a8-82ff-403d-afe7-1cffcb09d846 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:12:20.422310 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ce63a8-82ff-403d-afe7-1cffcb09d846 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:12:20.502493 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-54ce63a8-82ff-403d-afe7-1cffcb09d846 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:12:20.503684 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-54ce63a8-82ff-403d-afe7-1cffcb09d846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:12:20.607613 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 666/1313] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:12:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:12:20.644266 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feacbe07-caec-42fc-a42a-4107b7057f44 None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:12:20.646429 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-feacbe07-caec-42fc-a42a-4107b7057f44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:12:20.750574 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feacbe07-caec-42fc-a42a-4107b7057f44 None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:12:20.821134 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2b3349-b5f7-4e49-927c-6152c9f6908d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f1dc79540b48c0866478cc48cd8205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:12:20.821785 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2b3349-b5f7-4e49-927c-6152c9f6908d service neutron] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:12:20.822068 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2b3349-b5f7-4e49-927c-6152c9f6908d service neutron] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:12:20.822346 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2b3349-b5f7-4e49-927c-6152c9f6908d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:12:20.823966 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-9c2b3349-b5f7-4e49-927c-6152c9f6908d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:12:20.928309 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2b3349-b5f7-4e49-927c-6152c9f6908d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:12:20.929776 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2b3349-b5f7-4e49-927c-6152c9f6908d service neutron] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:12:20.951023 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 648/1314] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:12:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:12:23.528553 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad085c9-9f2c-40ac-a33e-c6c97b3160a1 None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:12:23.529198 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad085c9-9f2c-40ac-a33e-c6c97b3160a1 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:12:23.529198 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad085c9-9f2c-40ac-a33e-c6c97b3160a1 None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:12:23.530477 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 667/1315] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:12:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:12:23.535931 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad3fca1-ddbf-42f4-8389-8b12bd241881 None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:12:23.536918 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad3fca1-ddbf-42f4-8389-8b12bd241881 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:12:23.537184 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad3fca1-ddbf-42f4-8389-8b12bd241881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:12:23.599909 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-7ad3fca1-ddbf-42f4-8389-8b12bd241881 None None] MFA Rules not processed for user `6ad40793dcf0490689f2bcb5b52fd84e`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:12:23.601125 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-7ad3fca1-ddbf-42f4-8389-8b12bd241881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:12:23.700448 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 649/1316] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:12:23 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:12:23.757074 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a1e096-6ff3-4b7f-951d-3ccbb782f51a None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:12:23.757456 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a1e096-6ff3-4b7f-951d-3ccbb782f51a None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:12:23.757806 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a1e096-6ff3-4b7f-951d-3ccbb782f51a None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:12:23.759250 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 668/1317] 10.222.0.70 () {54 vars in 964 bytes} [Tue May 10 19:12:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:12:23.765759 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4621050c-ef88-4eae-9eee-9b0b75ffde76 None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:12:23.766048 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4621050c-ef88-4eae-9eee-9b0b75ffde76 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:12:23.766330 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4621050c-ef88-4eae-9eee-9b0b75ffde76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:12:23.847211 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-4621050c-ef88-4eae-9eee-9b0b75ffde76 None None] MFA Rules not processed for user `91f1dc79540b48c0866478cc48cd8205`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:12:23.848351 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-4621050c-ef88-4eae-9eee-9b0b75ffde76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:12:23.921671 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 650/1318] 10.222.0.70 () {58 vars in 1061 bytes} [Tue May 10 19:12:23 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:12:23.930878 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a1e096-6ff3-4b7f-951d-3ccbb782f51a None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:12:23.932640 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-d5a1e096-6ff3-4b7f-951d-3ccbb782f51a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:12:24.032369 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a1e096-6ff3-4b7f-951d-3ccbb782f51a None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:12:24.102703 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9514748-451a-4608-aafc-fc693f109224 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f1dc79540b48c0866478cc48cd8205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:12:24.103276 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9514748-451a-4608-aafc-fc693f109224 service neutron] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:12:24.103560 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9514748-451a-4608-aafc-fc693f109224 service neutron] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:12:24.103837 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9514748-451a-4608-aafc-fc693f109224 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:12:24.105523 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-b9514748-451a-4608-aafc-fc693f109224 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:12:24.209315 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9514748-451a-4608-aafc-fc693f109224 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:12:24.210754 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9514748-451a-4608-aafc-fc693f109224 service neutron] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:12:24.229800 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 669/1319] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:12:23 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:12:27.367783 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16921514-e0c4-4dcf-a15c-9af06d8407ce None None] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:12:27.368305 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16921514-e0c4-4dcf-a15c-9af06d8407ce None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:12:27.368305 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16921514-e0c4-4dcf-a15c-9af06d8407ce None None] PATH_INFO: `/` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:12:27.369633 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 651/1320] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:12:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:12:27.374797 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd420c3c-811c-43ed-90c6-3d3a3b9e3a5b None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:12:27.375228 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd420c3c-811c-43ed-90c6-3d3a3b9e3a5b None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:12:27.375340 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd420c3c-811c-43ed-90c6-3d3a3b9e3a5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:12:27.436133 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-fd420c3c-811c-43ed-90c6-3d3a3b9e3a5b None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:12:27.437343 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-fd420c3c-811c-43ed-90c6-3d3a3b9e3a5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:12:27.527492 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 670/1321] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:12:27 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:12:27.565564 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16921514-e0c4-4dcf-a15c-9af06d8407ce None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:12:27.567058 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-16921514-e0c4-4dcf-a15c-9af06d8407ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:12:27.667215 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16921514-e0c4-4dcf-a15c-9af06d8407ce None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:12:27.734326 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89cf625-bbd5-48f5-baa6-01a935ade23f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f1dc79540b48c0866478cc48cd8205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:12:27.734958 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89cf625-bbd5-48f5-baa6-01a935ade23f service neutron] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:12:27.735237 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89cf625-bbd5-48f5-baa6-01a935ade23f service neutron] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:12:27.735507 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89cf625-bbd5-48f5-baa6-01a935ade23f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:12:27.737123 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-b89cf625-bbd5-48f5-baa6-01a935ade23f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:12:27.842686 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89cf625-bbd5-48f5-baa6-01a935ade23f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:12:27.844126 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89cf625-bbd5-48f5-baa6-01a935ade23f service neutron] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:12:27.861888 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 652/1322] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:12:27 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:12:30.724158 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7353fc-9794-488a-bded-4e84c26f8c0d None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:12:30.724751 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7353fc-9794-488a-bded-4e84c26f8c0d None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:12:30.724857 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7353fc-9794-488a-bded-4e84c26f8c0d None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:12:30.726208 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 671/1323] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:12:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:12:30.731509 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7ac6d7-ee6e-45a1-89aa-bfb905df46e7 None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:12:30.731884 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7ac6d7-ee6e-45a1-89aa-bfb905df46e7 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:12:30.732201 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7ac6d7-ee6e-45a1-89aa-bfb905df46e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:12:30.793897 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-9c7ac6d7-ee6e-45a1-89aa-bfb905df46e7 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:12:30.795058 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-9c7ac6d7-ee6e-45a1-89aa-bfb905df46e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:12:30.885370 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 653/1324] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:12:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:12:30.920583 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7353fc-9794-488a-bded-4e84c26f8c0d None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:12:30.922165 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-bd7353fc-9794-488a-bded-4e84c26f8c0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:12:31.021305 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7353fc-9794-488a-bded-4e84c26f8c0d None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:12:31.089898 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f88735-84bf-450b-a2fb-1f104c8139a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f1dc79540b48c0866478cc48cd8205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:12:31.090542 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f88735-84bf-450b-a2fb-1f104c8139a4 service neutron] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:12:31.090819 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f88735-84bf-450b-a2fb-1f104c8139a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:12:31.091090 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f88735-84bf-450b-a2fb-1f104c8139a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:12:31.092722 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-30f88735-84bf-450b-a2fb-1f104c8139a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:12:31.196874 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f88735-84bf-450b-a2fb-1f104c8139a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:12:31.198319 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f88735-84bf-450b-a2fb-1f104c8139a4 service neutron] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:12:31.216317 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 672/1325] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:12:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:12:33.490833 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58633f13-0e25-4125-ba3f-b23bb1ff1df2 None None] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:12:33.491378 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58633f13-0e25-4125-ba3f-b23bb1ff1df2 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:12:33.491378 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58633f13-0e25-4125-ba3f-b23bb1ff1df2 None None] PATH_INFO: `/` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:12:33.492793 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 654/1326] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:12:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:12:33.498624 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ff8f15-2826-4601-a1a7-e6d71b70477a None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:12:33.499124 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ff8f15-2826-4601-a1a7-e6d71b70477a None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:12:33.499222 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ff8f15-2826-4601-a1a7-e6d71b70477a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:12:33.565490 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-58ff8f15-2826-4601-a1a7-e6d71b70477a None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:12:33.566684 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-58ff8f15-2826-4601-a1a7-e6d71b70477a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:12:33.664488 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 673/1327] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:12:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:12:33.699940 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58633f13-0e25-4125-ba3f-b23bb1ff1df2 None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:12:33.701483 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-58633f13-0e25-4125-ba3f-b23bb1ff1df2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:12:33.805202 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58633f13-0e25-4125-ba3f-b23bb1ff1df2 None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:12:33.874446 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a36c1a-1212-42b1-a5f2-2c7144b0f3ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f1dc79540b48c0866478cc48cd8205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:12:33.875085 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a36c1a-1212-42b1-a5f2-2c7144b0f3ab service neutron] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:12:33.875366 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a36c1a-1212-42b1-a5f2-2c7144b0f3ab service neutron] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:12:33.875639 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a36c1a-1212-42b1-a5f2-2c7144b0f3ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:12:33.877264 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-96a36c1a-1212-42b1-a5f2-2c7144b0f3ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:12:33.984131 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a36c1a-1212-42b1-a5f2-2c7144b0f3ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:12:33.985601 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a36c1a-1212-42b1-a5f2-2c7144b0f3ab service neutron] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:12:34.003142 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 655/1328] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:12:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:12:36.282087 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf233186-ec21-4b64-b1de-40409786855d None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:12:36.282617 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf233186-ec21-4b64-b1de-40409786855d None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:12:36.282617 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf233186-ec21-4b64-b1de-40409786855d None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:12:36.283916 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 674/1329] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:12:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:12:36.289906 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ecc6d6-ce24-4657-9a11-0a21c019f5bb None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:12:36.290340 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ecc6d6-ce24-4657-9a11-0a21c019f5bb None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:12:36.290470 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ecc6d6-ce24-4657-9a11-0a21c019f5bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:12:36.352054 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-00ecc6d6-ce24-4657-9a11-0a21c019f5bb None None] MFA Rules not processed for user `6ad40793dcf0490689f2bcb5b52fd84e`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:12:36.353240 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-00ecc6d6-ce24-4657-9a11-0a21c019f5bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:12:36.445032 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 656/1330] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:12:36 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:12:36.483470 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf233186-ec21-4b64-b1de-40409786855d None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:12:36.485019 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-cf233186-ec21-4b64-b1de-40409786855d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:12:36.584008 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf233186-ec21-4b64-b1de-40409786855d None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:12:36.653374 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f2de04-58d9-4b31-aaa8-6fc9ad6ea2dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f1dc79540b48c0866478cc48cd8205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:12:36.654023 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f2de04-58d9-4b31-aaa8-6fc9ad6ea2dc service neutron] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:12:36.654304 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f2de04-58d9-4b31-aaa8-6fc9ad6ea2dc service neutron] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:12:36.654578 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f2de04-58d9-4b31-aaa8-6fc9ad6ea2dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:12:36.656181 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-b2f2de04-58d9-4b31-aaa8-6fc9ad6ea2dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:12:36.760835 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f2de04-58d9-4b31-aaa8-6fc9ad6ea2dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:12:36.762283 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f2de04-58d9-4b31-aaa8-6fc9ad6ea2dc service neutron] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:12:36.780293 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 675/1331] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:12:36 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:12:39.291216 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7cf737-a999-4633-8eab-04b0e7c5bf7f None None] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:12:39.291697 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7cf737-a999-4633-8eab-04b0e7c5bf7f None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:12:39.291793 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7cf737-a999-4633-8eab-04b0e7c5bf7f None None] PATH_INFO: `/` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:12:39.293179 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 657/1332] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:12:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:12:39.298734 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdc71f6-1d04-4ae4-878b-adc55ceacd16 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:12:39.299218 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdc71f6-1d04-4ae4-878b-adc55ceacd16 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:12:39.299314 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdc71f6-1d04-4ae4-878b-adc55ceacd16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:12:39.366458 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-7cdc71f6-1d04-4ae4-878b-adc55ceacd16 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:12:39.367696 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-7cdc71f6-1d04-4ae4-878b-adc55ceacd16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:12:39.458995 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 676/1333] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:12:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:12:39.493698 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7cf737-a999-4633-8eab-04b0e7c5bf7f None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:12:39.495200 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-1b7cf737-a999-4633-8eab-04b0e7c5bf7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:12:39.593366 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7cf737-a999-4633-8eab-04b0e7c5bf7f None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:12:39.664927 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43db052-8c67-4f35-9697-0a10d7d6d7d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f1dc79540b48c0866478cc48cd8205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:12:39.665579 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43db052-8c67-4f35-9697-0a10d7d6d7d0 service neutron] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:12:39.665864 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43db052-8c67-4f35-9697-0a10d7d6d7d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:12:39.666140 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43db052-8c67-4f35-9697-0a10d7d6d7d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:12:39.667807 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-e43db052-8c67-4f35-9697-0a10d7d6d7d0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:12:39.772060 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43db052-8c67-4f35-9697-0a10d7d6d7d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:12:39.773479 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43db052-8c67-4f35-9697-0a10d7d6d7d0 service neutron] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:12:39.791197 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 658/1334] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:12:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:12:42.100378 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497d8ea1-44c5-4979-9379-dc9d64fb146e None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:12:42.100939 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497d8ea1-44c5-4979-9379-dc9d64fb146e None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:12:42.101037 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497d8ea1-44c5-4979-9379-dc9d64fb146e None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:12:42.102329 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 677/1335] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:12:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:12:42.107528 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd37d9fc-a674-43fc-8273-9c64954c9c2a None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:12:42.107906 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd37d9fc-a674-43fc-8273-9c64954c9c2a None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:12:42.108119 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd37d9fc-a674-43fc-8273-9c64954c9c2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:12:42.170718 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-bd37d9fc-a674-43fc-8273-9c64954c9c2a None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:12:42.171882 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-bd37d9fc-a674-43fc-8273-9c64954c9c2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:12:42.261147 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 659/1336] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:12:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:12:42.299673 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497d8ea1-44c5-4979-9379-dc9d64fb146e None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:12:42.301204 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-497d8ea1-44c5-4979-9379-dc9d64fb146e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:12:42.397842 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497d8ea1-44c5-4979-9379-dc9d64fb146e None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:12:42.465595 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb29072-25f0-4391-b5a2-194f0992a8dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f1dc79540b48c0866478cc48cd8205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:12:42.466235 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb29072-25f0-4391-b5a2-194f0992a8dc service neutron] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:12:42.466525 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb29072-25f0-4391-b5a2-194f0992a8dc service neutron] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:12:42.466827 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb29072-25f0-4391-b5a2-194f0992a8dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:12:42.468439 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-3bb29072-25f0-4391-b5a2-194f0992a8dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:12:42.580873 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb29072-25f0-4391-b5a2-194f0992a8dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:12:42.582220 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb29072-25f0-4391-b5a2-194f0992a8dc service neutron] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:12:42.599735 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 678/1337] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:12:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 19:12:45.273993 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6fa764-bf1d-4cce-9cb7-12c180bf0795 None None] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:12:45.274489 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6fa764-bf1d-4cce-9cb7-12c180bf0795 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:12:45.274583 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6fa764-bf1d-4cce-9cb7-12c180bf0795 None None] PATH_INFO: `/` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:12:45.275910 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 660/1338] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:12:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:12:45.281357 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73269aa-dca1-4e4b-9e29-de54d4967900 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:12:45.281767 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73269aa-dca1-4e4b-9e29-de54d4967900 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:12:45.281885 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73269aa-dca1-4e4b-9e29-de54d4967900 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:12:45.343338 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-c73269aa-dca1-4e4b-9e29-de54d4967900 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:12:45.344529 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-c73269aa-dca1-4e4b-9e29-de54d4967900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:12:45.434332 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 679/1339] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:12:45 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:12:45.470400 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6fa764-bf1d-4cce-9cb7-12c180bf0795 None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:12:45.471892 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-aa6fa764-bf1d-4cce-9cb7-12c180bf0795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:12:45.569779 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6fa764-bf1d-4cce-9cb7-12c180bf0795 None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:12:45.640058 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dada2e54-0741-41a0-9fc6-8608df130831 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f1dc79540b48c0866478cc48cd8205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:12:45.640740 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dada2e54-0741-41a0-9fc6-8608df130831 service neutron] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:12:45.641027 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dada2e54-0741-41a0-9fc6-8608df130831 service neutron] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:12:45.641304 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dada2e54-0741-41a0-9fc6-8608df130831 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:12:45.642914 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-dada2e54-0741-41a0-9fc6-8608df130831 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:12:45.745676 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dada2e54-0741-41a0-9fc6-8608df130831 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:12:45.747048 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dada2e54-0741-41a0-9fc6-8608df130831 service neutron] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:12:45.764036 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 661/1340] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:12:45 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:12:50.024070 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5d1454-cf03-4852-bfd3-484a6b76fdd2 None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:12:50.024615 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5d1454-cf03-4852-bfd3-484a6b76fdd2 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:12:50.024615 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5d1454-cf03-4852-bfd3-484a6b76fdd2 None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:12:50.025928 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 680/1341] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:12:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:12:50.031608 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfb2b6c-cdec-44a3-ae9f-bd2eea9aa416 None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:12:50.032024 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfb2b6c-cdec-44a3-ae9f-bd2eea9aa416 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:12:50.032178 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfb2b6c-cdec-44a3-ae9f-bd2eea9aa416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:12:50.106489 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-1bfb2b6c-cdec-44a3-ae9f-bd2eea9aa416 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:12:50.107693 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-1bfb2b6c-cdec-44a3-ae9f-bd2eea9aa416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:12:50.209493 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 662/1342] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:12:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:12:50.247680 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5d1454-cf03-4852-bfd3-484a6b76fdd2 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:12:50.249940 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-ba5d1454-cf03-4852-bfd3-484a6b76fdd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:12:50.346044 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5d1454-cf03-4852-bfd3-484a6b76fdd2 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:12:50.349561 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b9d2c6-5842-4517-a7dd-41569fda89e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f1dc79540b48c0866478cc48cd8205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:12:50.350208 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b9d2c6-5842-4517-a7dd-41569fda89e2 service neutron] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:12:50.350487 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b9d2c6-5842-4517-a7dd-41569fda89e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:12:50.350761 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b9d2c6-5842-4517-a7dd-41569fda89e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:12:50.359924 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b9d2c6-5842-4517-a7dd-41569fda89e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:12:50.361443 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b9d2c6-5842-4517-a7dd-41569fda89e2 service neutron] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:12:50.371554 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 681/1343] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:12:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:12:53.184050 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da7b679-69f7-4eaa-bc19-bf3835eb17c5 None None] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:12:53.184607 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da7b679-69f7-4eaa-bc19-bf3835eb17c5 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:12:53.184697 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da7b679-69f7-4eaa-bc19-bf3835eb17c5 None None] PATH_INFO: `/` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:12:53.185993 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 663/1344] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:12:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:12:53.191235 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbcd574-730c-4a0f-a35e-46d172c2bad7 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:12:53.191655 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbcd574-730c-4a0f-a35e-46d172c2bad7 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:12:53.191797 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbcd574-730c-4a0f-a35e-46d172c2bad7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:12:53.219782 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-bbbcd574-730c-4a0f-a35e-46d172c2bad7 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:12:53.220989 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-bbbcd574-730c-4a0f-a35e-46d172c2bad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:12:53.293039 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 682/1345] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:12:53 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:12:53.329672 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da7b679-69f7-4eaa-bc19-bf3835eb17c5 None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:12:53.339976 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da7b679-69f7-4eaa-bc19-bf3835eb17c5 None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:12:53.343379 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3b0001-a2a0-4b2e-8476-4d7cbc090829 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f1dc79540b48c0866478cc48cd8205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:12:53.344005 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3b0001-a2a0-4b2e-8476-4d7cbc090829 service neutron] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:12:53.344283 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3b0001-a2a0-4b2e-8476-4d7cbc090829 service neutron] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:12:53.344588 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3b0001-a2a0-4b2e-8476-4d7cbc090829 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:12:53.353584 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3b0001-a2a0-4b2e-8476-4d7cbc090829 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:12:53.355006 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3b0001-a2a0-4b2e-8476-4d7cbc090829 service neutron] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:12:53.364918 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 664/1346] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:12:53 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:12:57.698366 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24857ee-c178-4bc8-bc07-d37de8b10529 None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:12:57.698947 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24857ee-c178-4bc8-bc07-d37de8b10529 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:12:57.698947 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24857ee-c178-4bc8-bc07-d37de8b10529 None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:12:57.700285 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 683/1347] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:12:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:12:57.705790 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906f1148-6d96-4735-acfa-5398fe768eb7 None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:12:57.706554 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906f1148-6d96-4735-acfa-5398fe768eb7 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:12:57.706837 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906f1148-6d96-4735-acfa-5398fe768eb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:12:57.724354 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-906f1148-6d96-4735-acfa-5398fe768eb7 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:12:57.725562 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-906f1148-6d96-4735-acfa-5398fe768eb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:12:57.733248 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 665/1348] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:12:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:12:57.771300 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24857ee-c178-4bc8-bc07-d37de8b10529 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:12:57.781632 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24857ee-c178-4bc8-bc07-d37de8b10529 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:12:57.785302 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58f6bea-a1b5-4bce-ad46-7cd82354a904 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f1dc79540b48c0866478cc48cd8205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:12:57.786149 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58f6bea-a1b5-4bce-ad46-7cd82354a904 service neutron] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:12:57.786436 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58f6bea-a1b5-4bce-ad46-7cd82354a904 service neutron] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:12:57.786739 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58f6bea-a1b5-4bce-ad46-7cd82354a904 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:12:57.795505 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58f6bea-a1b5-4bce-ad46-7cd82354a904 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:12:57.796961 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58f6bea-a1b5-4bce-ad46-7cd82354a904 service neutron] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:12:57.806118 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 684/1349] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:12:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 19:13:03.094542 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650b1ea8-317a-49ca-a554-f9ae7500ae74 None None] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:13:03.095066 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650b1ea8-317a-49ca-a554-f9ae7500ae74 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:13:03.095302 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650b1ea8-317a-49ca-a554-f9ae7500ae74 None None] PATH_INFO: `/` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:13:03.097144 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 666/1350] 10.222.0.70 () {54 vars in 921 bytes} [Tue May 10 19:13:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:13:03.102778 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433c7ab1-7bc0-4112-8f2d-e2319fe71a16 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:13:03.103176 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433c7ab1-7bc0-4112-8f2d-e2319fe71a16 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:13:03.103332 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433c7ab1-7bc0-4112-8f2d-e2319fe71a16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:13:03.175578 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-433c7ab1-7bc0-4112-8f2d-e2319fe71a16 None None] MFA Rules not processed for user `11b95d3824f34cfcada6915ee57a7e08`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:13:03.177036 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-433c7ab1-7bc0-4112-8f2d-e2319fe71a16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:13:03.312991 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 685/1351] 10.222.0.70 () {58 vars in 1018 bytes} [Tue May 10 19:13:03 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:13:07.580987 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00038d00-2dd3-40b2-bcb7-5b0b23d396ac None None] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:13:07.581497 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00038d00-2dd3-40b2-bcb7-5b0b23d396ac None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:13:07.581497 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00038d00-2dd3-40b2-bcb7-5b0b23d396ac None None] PATH_INFO: `/` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:13:07.583385 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 667/1352] 10.222.0.70 () {54 vars in 921 bytes} [Tue May 10 19:13:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:13:07.588832 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0942bfd4-e795-40e8-999f-bfbc43fdc72f None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:13:07.589254 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0942bfd4-e795-40e8-999f-bfbc43fdc72f None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:13:07.589470 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0942bfd4-e795-40e8-999f-bfbc43fdc72f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:13:07.609111 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-0942bfd4-e795-40e8-999f-bfbc43fdc72f None None] MFA Rules not processed for user `11b95d3824f34cfcada6915ee57a7e08`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:13:07.610331 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-0942bfd4-e795-40e8-999f-bfbc43fdc72f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:13:07.620898 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 686/1353] 10.222.0.70 () {58 vars in 1018 bytes} [Tue May 10 19:13:07 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:13:09.265342 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3001aa-e768-4a89-8fb1-8e0d4d4304f5 None None] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:13:09.266356 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3001aa-e768-4a89-8fb1-8e0d4d4304f5 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:13:09.266356 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3001aa-e768-4a89-8fb1-8e0d4d4304f5 None None] PATH_INFO: `/` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:13:09.267439 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 668/1354] 10.222.0.70 () {54 vars in 921 bytes} [Tue May 10 19:13:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:13:09.272510 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c07d5e-4698-4868-90bd-f1d7edb338b2 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:13:09.272923 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c07d5e-4698-4868-90bd-f1d7edb338b2 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:13:09.273073 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c07d5e-4698-4868-90bd-f1d7edb338b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:13:09.290679 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-91c07d5e-4698-4868-90bd-f1d7edb338b2 None None] MFA Rules not processed for user `11b95d3824f34cfcada6915ee57a7e08`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:13:09.291969 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-91c07d5e-4698-4868-90bd-f1d7edb338b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:13:09.300627 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 687/1355] 10.222.0.70 () {58 vars in 1018 bytes} [Tue May 10 19:13:09 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:13:13.096047 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1353541-da92-46a0-8dcb-d9ea8939ebe2 None None] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:13:13.096602 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1353541-da92-46a0-8dcb-d9ea8939ebe2 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:13:13.096602 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1353541-da92-46a0-8dcb-d9ea8939ebe2 None None] PATH_INFO: `/` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:13:13.098073 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 669/1356] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:13:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:13:13.107642 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acb1e61-789b-4c32-a807-0b812187121a None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:13:13.107642 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acb1e61-789b-4c32-a807-0b812187121a None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:13:13.107642 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acb1e61-789b-4c32-a807-0b812187121a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:13:13.124992 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-8acb1e61-789b-4c32-a807-0b812187121a None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:13:13.126357 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-8acb1e61-789b-4c32-a807-0b812187121a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:13:13.144446 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 688/1357] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:13:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:13:13.183701 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa82841-7120-42c8-9932-b68a73b9a61a None None] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:13:13.184203 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa82841-7120-42c8-9932-b68a73b9a61a None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:13:13.184702 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa82841-7120-42c8-9932-b68a73b9a61a None None] PATH_INFO: `/` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:13:13.186418 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 670/1358] 10.222.0.70 () {54 vars in 961 bytes} [Tue May 10 19:13:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:13:13.193454 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5534286c-13c7-46a7-bc3a-32fb62711296 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:13:13.195631 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5534286c-13c7-46a7-bc3a-32fb62711296 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:13:13.196505 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5534286c-13c7-46a7-bc3a-32fb62711296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:13:13.289309 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-5534286c-13c7-46a7-bc3a-32fb62711296 None None] MFA Rules not processed for user `b9f310a468ec4058b3c95356ea60ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:13:13.291204 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-5534286c-13c7-46a7-bc3a-32fb62711296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:13:13.387523 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 689/1359] 10.222.0.70 () {58 vars in 1058 bytes} [Tue May 10 19:13:13 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:13:13.398255 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa82841-7120-42c8-9932-b68a73b9a61a None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:13:13.413175 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa82841-7120-42c8-9932-b68a73b9a61a None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:13:13.418777 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dd5118-43bd-4f1c-91a7-4d1926331628 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9f310a468ec4058b3c95356ea60ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:13:13.419429 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dd5118-43bd-4f1c-91a7-4d1926331628 service nova] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:13:13.419716 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dd5118-43bd-4f1c-91a7-4d1926331628 service nova] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:13:13.419994 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dd5118-43bd-4f1c-91a7-4d1926331628 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:13:13.428577 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dd5118-43bd-4f1c-91a7-4d1926331628 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:13:13.430177 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dd5118-43bd-4f1c-91a7-4d1926331628 service nova] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:13:13.439681 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 671/1360] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:13:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:13:15.893730 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6414b62-e8fe-4b5d-a5f9-93dc286dde17 None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:13:15.894586 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6414b62-e8fe-4b5d-a5f9-93dc286dde17 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:13:15.895484 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6414b62-e8fe-4b5d-a5f9-93dc286dde17 None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:13:15.897171 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 690/1361] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:13:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:13:15.902630 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e99f432-a6fb-48e2-b07f-cfc9eed1c3a9 None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:13:15.903170 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e99f432-a6fb-48e2-b07f-cfc9eed1c3a9 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:13:15.903170 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e99f432-a6fb-48e2-b07f-cfc9eed1c3a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:13:15.921160 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-2e99f432-a6fb-48e2-b07f-cfc9eed1c3a9 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:13:15.922398 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-2e99f432-a6fb-48e2-b07f-cfc9eed1c3a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:13:15.930163 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 672/1362] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:13:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:13:15.975484 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6414b62-e8fe-4b5d-a5f9-93dc286dde17 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:13:15.991482 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6414b62-e8fe-4b5d-a5f9-93dc286dde17 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:13:15.997315 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f31840-e10d-4802-970e-d6d02b4653ca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9f310a468ec4058b3c95356ea60ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:13:15.998221 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f31840-e10d-4802-970e-d6d02b4653ca service nova] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:13:15.998687 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f31840-e10d-4802-970e-d6d02b4653ca service nova] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:13:15.999236 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f31840-e10d-4802-970e-d6d02b4653ca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:13:16.009499 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f31840-e10d-4802-970e-d6d02b4653ca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:13:16.011078 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f31840-e10d-4802-970e-d6d02b4653ca service nova] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:13:16.023142 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 691/1363] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:13:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:13:18.536950 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa464ad-25bb-4656-995b-3e6e3813ab69 None None] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:13:18.537485 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa464ad-25bb-4656-995b-3e6e3813ab69 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:13:18.537485 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa464ad-25bb-4656-995b-3e6e3813ab69 None None] PATH_INFO: `/` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:13:18.539280 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 673/1364] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:13:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:13:18.544758 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85359b4-90e6-4b3e-bd53-c639ada55757 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:13:18.545573 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85359b4-90e6-4b3e-bd53-c639ada55757 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:13:18.545999 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85359b4-90e6-4b3e-bd53-c639ada55757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:13:18.565314 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-b85359b4-90e6-4b3e-bd53-c639ada55757 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:13:18.566505 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-b85359b4-90e6-4b3e-bd53-c639ada55757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:13:18.574881 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 692/1365] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:13:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:13:18.619984 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64411cf5-f122-43cb-b890-0d521c625359 None None] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:13:18.620272 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64411cf5-f122-43cb-b890-0d521c625359 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:13:18.620588 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64411cf5-f122-43cb-b890-0d521c625359 None None] PATH_INFO: `/` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:13:18.621924 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 674/1366] 10.222.0.70 () {54 vars in 961 bytes} [Tue May 10 19:13:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:13:18.627331 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2b939e-5891-400f-ab73-45a29aef6acd None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:13:18.627611 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2b939e-5891-400f-ab73-45a29aef6acd None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:13:18.627900 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2b939e-5891-400f-ab73-45a29aef6acd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:13:18.645313 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-ad2b939e-5891-400f-ab73-45a29aef6acd None None] MFA Rules not processed for user `b9f310a468ec4058b3c95356ea60ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:13:18.646459 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-ad2b939e-5891-400f-ab73-45a29aef6acd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:13:18.655178 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 693/1367] 10.222.0.70 () {58 vars in 1058 bytes} [Tue May 10 19:13:18 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:13:18.663267 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64411cf5-f122-43cb-b890-0d521c625359 None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:13:18.678282 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64411cf5-f122-43cb-b890-0d521c625359 None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:13:18.683559 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71985d2-1d35-4484-a534-402b4562092f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9f310a468ec4058b3c95356ea60ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:13:18.684184 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71985d2-1d35-4484-a534-402b4562092f service nova] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:13:18.684494 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71985d2-1d35-4484-a534-402b4562092f service nova] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:13:18.684769 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71985d2-1d35-4484-a534-402b4562092f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:13:18.693198 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71985d2-1d35-4484-a534-402b4562092f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:13:18.694764 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71985d2-1d35-4484-a534-402b4562092f service nova] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:13:18.704193 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 675/1368] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:13:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 19:13:21.026011 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b5ace3-f075-4dd5-9c94-4e3bc5ca39ef None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:13:21.026876 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b5ace3-f075-4dd5-9c94-4e3bc5ca39ef None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:13:21.027156 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b5ace3-f075-4dd5-9c94-4e3bc5ca39ef None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:13:21.028837 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 694/1369] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:13:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:13:21.033960 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706e662f-a887-4bf2-9d27-4ea2f997ed44 None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:13:21.034378 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706e662f-a887-4bf2-9d27-4ea2f997ed44 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:13:21.034496 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706e662f-a887-4bf2-9d27-4ea2f997ed44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:13:21.052289 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-706e662f-a887-4bf2-9d27-4ea2f997ed44 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:13:21.053558 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-706e662f-a887-4bf2-9d27-4ea2f997ed44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:13:21.062184 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 676/1370] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:13:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:13:21.107173 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b5ace3-f075-4dd5-9c94-4e3bc5ca39ef None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:13:21.122827 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b5ace3-f075-4dd5-9c94-4e3bc5ca39ef None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:13:21.129576 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22c8f84-5f87-41ab-b455-541c571e83d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9f310a468ec4058b3c95356ea60ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:13:21.130591 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22c8f84-5f87-41ab-b455-541c571e83d1 service nova] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:13:21.131063 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22c8f84-5f87-41ab-b455-541c571e83d1 service nova] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:13:21.131438 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22c8f84-5f87-41ab-b455-541c571e83d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:13:21.140118 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22c8f84-5f87-41ab-b455-541c571e83d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:13:21.141919 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22c8f84-5f87-41ab-b455-541c571e83d1 service nova] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:13:21.151967 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 695/1371] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:13:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:13:21.251538 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec385709-f2d9-4bb5-9d3e-2053ba7af902 None None] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:13:21.251825 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec385709-f2d9-4bb5-9d3e-2053ba7af902 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:13:21.252120 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec385709-f2d9-4bb5-9d3e-2053ba7af902 None None] PATH_INFO: `/` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:13:21.254193 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 677/1372] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:13:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:13:21.260510 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd914d9-ac3b-47a4-83bf-caa8f75b0881 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:13:21.260795 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd914d9-ac3b-47a4-83bf-caa8f75b0881 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:13:21.261066 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd914d9-ac3b-47a4-83bf-caa8f75b0881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:13:21.281318 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-1bd914d9-ac3b-47a4-83bf-caa8f75b0881 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:13:21.282583 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-1bd914d9-ac3b-47a4-83bf-caa8f75b0881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:13:21.291367 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 696/1373] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:13:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:13:21.605332 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff5de8a-9989-4e7e-8886-23efb46b7a1b None None] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:13:21.605779 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff5de8a-9989-4e7e-8886-23efb46b7a1b None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:13:21.606846 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff5de8a-9989-4e7e-8886-23efb46b7a1b None None] PATH_INFO: `/` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:13:21.608310 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 678/1374] 10.222.0.70 () {54 vars in 963 bytes} [Tue May 10 19:13:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 19:13:21.614098 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc54def6-348b-4190-8e72-aca87396d382 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:13:21.614388 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc54def6-348b-4190-8e72-aca87396d382 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:13:21.614662 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc54def6-348b-4190-8e72-aca87396d382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:13:21.662780 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-bc54def6-348b-4190-8e72-aca87396d382 None None] MFA Rules not processed for user `15df2a8967aa43299c10e365f4200d37`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:13:21.664124 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-bc54def6-348b-4190-8e72-aca87396d382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:13:21.726019 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 697/1375] 10.222.0.70 () {58 vars in 1060 bytes} [Tue May 10 19:13:21 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:13:21.734513 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff5de8a-9989-4e7e-8886-23efb46b7a1b None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:13:21.750887 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff5de8a-9989-4e7e-8886-23efb46b7a1b None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:13:21.754923 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330c6c95-f662-4aa4-90db-53a99d860f0a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15df2a8967aa43299c10e365f4200d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:13:21.755559 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330c6c95-f662-4aa4-90db-53a99d860f0a service cinder] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:13:21.755836 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330c6c95-f662-4aa4-90db-53a99d860f0a service cinder] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:13:21.756108 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330c6c95-f662-4aa4-90db-53a99d860f0a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:13:21.765422 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330c6c95-f662-4aa4-90db-53a99d860f0a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:13:21.766855 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330c6c95-f662-4aa4-90db-53a99d860f0a service cinder] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:13:21.776463 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 679/1376] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:13:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:13:23.454899 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bd990d-6cc6-4047-8080-4338463ee995 None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:13:23.455422 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bd990d-6cc6-4047-8080-4338463ee995 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:13:23.455517 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bd990d-6cc6-4047-8080-4338463ee995 None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:13:23.456858 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 698/1377] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:13:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:13:23.462476 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01681370-505f-476f-8b2e-2742022fb2ee None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:13:23.462894 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01681370-505f-476f-8b2e-2742022fb2ee None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:13:23.462990 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01681370-505f-476f-8b2e-2742022fb2ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:13:23.480751 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-01681370-505f-476f-8b2e-2742022fb2ee None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:13:23.481915 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-01681370-505f-476f-8b2e-2742022fb2ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:13:23.490397 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 680/1378] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:13:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:13:23.533465 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bd990d-6cc6-4047-8080-4338463ee995 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:13:23.547566 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bd990d-6cc6-4047-8080-4338463ee995 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:13:23.553722 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a1ce24-1017-4f34-bd97-ea1907dfdd85 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9f310a468ec4058b3c95356ea60ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:13:23.554368 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a1ce24-1017-4f34-bd97-ea1907dfdd85 service nova] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:13:23.554652 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a1ce24-1017-4f34-bd97-ea1907dfdd85 service nova] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:13:23.554926 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a1ce24-1017-4f34-bd97-ea1907dfdd85 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:13:23.563826 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a1ce24-1017-4f34-bd97-ea1907dfdd85 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:13:23.565447 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a1ce24-1017-4f34-bd97-ea1907dfdd85 service nova] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:13:23.575836 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 699/1379] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:13:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:13:25.853753 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2352ae05-0854-4a55-9a51-40cbd8064f4a None None] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:13:25.854361 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2352ae05-0854-4a55-9a51-40cbd8064f4a None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:13:25.854361 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2352ae05-0854-4a55-9a51-40cbd8064f4a None None] PATH_INFO: `/` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:13:25.856760 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 681/1380] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:13:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:13:25.860995 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee58d05-1b6e-4b8a-b443-432ca5ff80c4 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:13:25.861426 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee58d05-1b6e-4b8a-b443-432ca5ff80c4 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:13:25.861533 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee58d05-1b6e-4b8a-b443-432ca5ff80c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:13:25.878974 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-0ee58d05-1b6e-4b8a-b443-432ca5ff80c4 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:13:25.880149 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-0ee58d05-1b6e-4b8a-b443-432ca5ff80c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:13:25.887936 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 700/1381] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:13:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:13:25.931937 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2352ae05-0854-4a55-9a51-40cbd8064f4a None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:13:25.949460 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2352ae05-0854-4a55-9a51-40cbd8064f4a None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:13:25.956977 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e68966-ec83-48d8-bcf0-deea47d6fa33 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9f310a468ec4058b3c95356ea60ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:13:25.957614 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e68966-ec83-48d8-bcf0-deea47d6fa33 service nova] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:13:25.957900 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e68966-ec83-48d8-bcf0-deea47d6fa33 service nova] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:13:25.958176 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e68966-ec83-48d8-bcf0-deea47d6fa33 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:13:25.967081 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e68966-ec83-48d8-bcf0-deea47d6fa33 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:13:25.968692 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e68966-ec83-48d8-bcf0-deea47d6fa33 service nova] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:13:25.978391 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 682/1382] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:13:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:13:28.248337 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dd895e-87fa-4ac2-84ff-0cce9ec802eb None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:13:28.248952 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dd895e-87fa-4ac2-84ff-0cce9ec802eb None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:13:28.248952 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dd895e-87fa-4ac2-84ff-0cce9ec802eb None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:13:28.250271 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 701/1383] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:13:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:13:28.255689 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3da59b-2edb-41e0-8be4-513761fc11ca None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:13:28.256126 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3da59b-2edb-41e0-8be4-513761fc11ca None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:13:28.256370 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3da59b-2edb-41e0-8be4-513761fc11ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:13:28.274449 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-ba3da59b-2edb-41e0-8be4-513761fc11ca None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:13:28.275725 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-ba3da59b-2edb-41e0-8be4-513761fc11ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:13:28.284966 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 683/1384] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:13:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:13:28.326607 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dd895e-87fa-4ac2-84ff-0cce9ec802eb None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:13:28.341617 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dd895e-87fa-4ac2-84ff-0cce9ec802eb None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:13:28.347048 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feefbfe4-4fb1-4cad-9498-69d6ca611095 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9f310a468ec4058b3c95356ea60ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:13:28.347720 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feefbfe4-4fb1-4cad-9498-69d6ca611095 service nova] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:13:28.348004 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feefbfe4-4fb1-4cad-9498-69d6ca611095 service nova] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:13:28.348279 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feefbfe4-4fb1-4cad-9498-69d6ca611095 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:13:28.356728 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feefbfe4-4fb1-4cad-9498-69d6ca611095 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:13:28.358294 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feefbfe4-4fb1-4cad-9498-69d6ca611095 service nova] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:13:28.367729 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 702/1385] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:13:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:13:30.602797 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04010e52-bcca-47e7-ba80-32b0bda1a813 None None] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:13:30.603524 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04010e52-bcca-47e7-ba80-32b0bda1a813 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:13:30.603618 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04010e52-bcca-47e7-ba80-32b0bda1a813 None None] PATH_INFO: `/` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:13:30.605570 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 684/1386] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:13:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:13:30.612275 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd81953-7b7a-4a0e-8741-5b423a6b4234 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:13:30.612731 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd81953-7b7a-4a0e-8741-5b423a6b4234 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:13:30.612893 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd81953-7b7a-4a0e-8741-5b423a6b4234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:13:30.632063 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-2bd81953-7b7a-4a0e-8741-5b423a6b4234 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:13:30.633353 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-2bd81953-7b7a-4a0e-8741-5b423a6b4234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:13:30.641653 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 703/1387] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:13:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:13:30.686505 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04010e52-bcca-47e7-ba80-32b0bda1a813 None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:13:30.700698 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04010e52-bcca-47e7-ba80-32b0bda1a813 None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:13:30.706606 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827410a4-4ae3-4b26-8c37-ee6ea4e88e15 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9f310a468ec4058b3c95356ea60ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:13:30.707294 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827410a4-4ae3-4b26-8c37-ee6ea4e88e15 service nova] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:13:30.707540 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827410a4-4ae3-4b26-8c37-ee6ea4e88e15 service nova] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:13:30.707811 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827410a4-4ae3-4b26-8c37-ee6ea4e88e15 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:13:30.716073 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827410a4-4ae3-4b26-8c37-ee6ea4e88e15 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:13:30.717699 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827410a4-4ae3-4b26-8c37-ee6ea4e88e15 service nova] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:13:30.727556 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 685/1388] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:13:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:13:33.329821 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8a1db5-ee1c-428d-8e61-e9dd1ec92e05 None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:13:33.330344 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8a1db5-ee1c-428d-8e61-e9dd1ec92e05 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:13:33.330458 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8a1db5-ee1c-428d-8e61-e9dd1ec92e05 None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:13:33.332391 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 704/1389] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:13:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:13:33.338296 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1180901-923d-4812-90c3-2f64cb00fa22 None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:13:33.338744 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1180901-923d-4812-90c3-2f64cb00fa22 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:13:33.339086 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1180901-923d-4812-90c3-2f64cb00fa22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:13:33.362413 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-c1180901-923d-4812-90c3-2f64cb00fa22 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:13:33.364017 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-c1180901-923d-4812-90c3-2f64cb00fa22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:13:33.374271 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 686/1390] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:13:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:13:33.419963 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8a1db5-ee1c-428d-8e61-e9dd1ec92e05 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:13:33.435428 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8a1db5-ee1c-428d-8e61-e9dd1ec92e05 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:13:33.441027 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534be03a-29e6-4797-afa8-ce999cd6b7a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9f310a468ec4058b3c95356ea60ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:13:33.441724 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534be03a-29e6-4797-afa8-ce999cd6b7a8 service nova] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:13:33.442023 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534be03a-29e6-4797-afa8-ce999cd6b7a8 service nova] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:13:33.442314 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534be03a-29e6-4797-afa8-ce999cd6b7a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:13:33.450752 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534be03a-29e6-4797-afa8-ce999cd6b7a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:13:33.452398 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534be03a-29e6-4797-afa8-ce999cd6b7a8 service nova] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:13:33.462951 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 705/1391] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:13:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:13:35.839648 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41b84aa-f7e5-44d8-a603-4e9f1c7702f2 None None] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:13:35.840248 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41b84aa-f7e5-44d8-a603-4e9f1c7702f2 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:13:35.840248 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41b84aa-f7e5-44d8-a603-4e9f1c7702f2 None None] PATH_INFO: `/` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:13:35.841684 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 687/1392] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:13:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:13:35.847009 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcf8729-aa95-41fe-baef-52c9684cd7de None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:13:35.847941 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcf8729-aa95-41fe-baef-52c9684cd7de None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:13:35.848141 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcf8729-aa95-41fe-baef-52c9684cd7de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:13:35.866301 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-1fcf8729-aa95-41fe-baef-52c9684cd7de None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:13:35.867484 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-1fcf8729-aa95-41fe-baef-52c9684cd7de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:13:35.875238 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 706/1393] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:13:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:13:35.918453 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41b84aa-f7e5-44d8-a603-4e9f1c7702f2 None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:13:35.932462 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41b84aa-f7e5-44d8-a603-4e9f1c7702f2 None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:13:35.937803 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d48532-4727-4d9f-aca6-d15573b2944b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9f310a468ec4058b3c95356ea60ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:13:35.938443 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d48532-4727-4d9f-aca6-d15573b2944b service nova] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:13:35.938730 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d48532-4727-4d9f-aca6-d15573b2944b service nova] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:13:35.939010 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d48532-4727-4d9f-aca6-d15573b2944b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:13:35.947911 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d48532-4727-4d9f-aca6-d15573b2944b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:13:35.951505 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d48532-4727-4d9f-aca6-d15573b2944b service nova] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:13:35.960140 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 688/1394] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:13:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:13:37.500778 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454c60fe-bb93-4144-bf1a-578af85e09c0 None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:13:37.501302 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454c60fe-bb93-4144-bf1a-578af85e09c0 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:13:37.501302 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454c60fe-bb93-4144-bf1a-578af85e09c0 None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:13:37.502667 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 707/1395] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:13:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:13:37.508383 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbf9469-1d85-435f-ab8a-be2bccd660b5 None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:13:37.508848 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbf9469-1d85-435f-ab8a-be2bccd660b5 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:13:37.508948 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbf9469-1d85-435f-ab8a-be2bccd660b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:13:37.526478 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-7cbf9469-1d85-435f-ab8a-be2bccd660b5 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:13:37.527633 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-7cbf9469-1d85-435f-ab8a-be2bccd660b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:13:37.535333 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 689/1396] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:13:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:13:37.589895 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aaa119-6868-4324-9aff-9fab7d2374b2 None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:13:37.590180 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aaa119-6868-4324-9aff-9fab7d2374b2 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:13:37.590453 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aaa119-6868-4324-9aff-9fab7d2374b2 None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:13:37.591831 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 708/1397] 10.222.0.70 () {54 vars in 962 bytes} [Tue May 10 19:13:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 19:13:37.596955 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92a62bb-d11f-4067-ac84-a4938c8ad373 None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:13:37.597249 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92a62bb-d11f-4067-ac84-a4938c8ad373 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:13:37.597562 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92a62bb-d11f-4067-ac84-a4938c8ad373 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:13:37.643955 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-c92a62bb-d11f-4067-ac84-a4938c8ad373 None None] MFA Rules not processed for user `24ca97ff2a1745e58dedba4cef61b3f0`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:13:37.645708 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-c92a62bb-d11f-4067-ac84-a4938c8ad373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:13:37.702008 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 690/1398] 10.222.0.70 () {58 vars in 1059 bytes} [Tue May 10 19:13:37 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:13:37.710460 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aaa119-6868-4324-9aff-9fab7d2374b2 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:13:37.720803 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aaa119-6868-4324-9aff-9fab7d2374b2 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:13:37.724740 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e65d75-6560-40a4-804d-74775c8116fd service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24ca97ff2a1745e58dedba4cef61b3f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:13:37.725384 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e65d75-6560-40a4-804d-74775c8116fd service glance] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:13:37.725667 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e65d75-6560-40a4-804d-74775c8116fd service glance] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:13:37.725942 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e65d75-6560-40a4-804d-74775c8116fd service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:13:37.734963 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e65d75-6560-40a4-804d-74775c8116fd service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:13:37.736481 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e65d75-6560-40a4-804d-74775c8116fd service glance] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:13:37.746178 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 709/1399] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:13:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:13:38.165774 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3308931-ceba-491f-9a57-3f5aaeaa6610 None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:13:38.166069 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3308931-ceba-491f-9a57-3f5aaeaa6610 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:13:38.166348 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3308931-ceba-491f-9a57-3f5aaeaa6610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:13:38.209499 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79b8a44-b9ec-4d07-835d-4223f52a9783 None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:13:38.209780 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79b8a44-b9ec-4d07-835d-4223f52a9783 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:13:38.210056 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79b8a44-b9ec-4d07-835d-4223f52a9783 None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:13:38.211475 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 710/1400] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:13:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:13:38.214699 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-a3308931-ceba-491f-9a57-3f5aaeaa6610 None None] MFA Rules not processed for user `058e52f1bf0b4aba965d945815d4acb3`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:13:38.215917 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-a3308931-ceba-491f-9a57-3f5aaeaa6610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:13:38.216668 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb964c8-cc88-4fb4-802c-eeb744ac8036 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:13:38.216953 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb964c8-cc88-4fb4-802c-eeb744ac8036 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:13:38.217226 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb964c8-cc88-4fb4-802c-eeb744ac8036 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:13:38.233781 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-9cb964c8-cc88-4fb4-802c-eeb744ac8036 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:13:38.234930 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-9cb964c8-cc88-4fb4-802c-eeb744ac8036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:13:38.242988 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 711/1401] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:13:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:13:38.278648 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 691/1402] 10.222.0.70 () {58 vars in 1009 bytes} [Tue May 10 19:13:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:13:38.287283 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb964c8-cc88-4fb4-802c-eeb744ac8036 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:13:38.299985 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb964c8-cc88-4fb4-802c-eeb744ac8036 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:13:38.305332 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a2503d-9976-45d0-ad81-ed28ce24dd5e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9f310a468ec4058b3c95356ea60ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:13:38.305976 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a2503d-9976-45d0-ad81-ed28ce24dd5e service nova] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:13:38.306253 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a2503d-9976-45d0-ad81-ed28ce24dd5e service nova] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:13:38.306530 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a2503d-9976-45d0-ad81-ed28ce24dd5e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:13:38.315097 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a2503d-9976-45d0-ad81-ed28ce24dd5e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:13:38.317093 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a2503d-9976-45d0-ad81-ed28ce24dd5e service nova] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:13:38.323868 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c7ca78-7719-43d9-884a-4a2958bbc408 None None] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:13:38.324229 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c7ca78-7719-43d9-884a-4a2958bbc408 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:13:38.324553 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c7ca78-7719-43d9-884a-4a2958bbc408 None None] PATH_INFO: `/` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:13:38.325904 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 692/1403] 10.222.0.70 () {54 vars in 942 bytes} [Tue May 10 19:13:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:13:38.326405 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 712/1404] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:13:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:13:38.333279 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2406b93-fe97-4764-bd41-9e07e05cfe7f None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:13:38.333428 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2406b93-fe97-4764-bd41-9e07e05cfe7f None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:13:38.333773 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2406b93-fe97-4764-bd41-9e07e05cfe7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:13:38.382223 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-d2406b93-fe97-4764-bd41-9e07e05cfe7f None None] MFA Rules not processed for user `0454aa03fa31487ea1464b9d0008212c`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:13:38.383417 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-d2406b93-fe97-4764-bd41-9e07e05cfe7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:13:38.459955 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 693/1405] 10.222.0.70 () {58 vars in 1039 bytes} [Tue May 10 19:13:38 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:13:38.469785 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a2503d-9976-45d0-ad81-ed28ce24dd5e service nova] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:13:38.481020 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a2503d-9976-45d0-ad81-ed28ce24dd5e service nova] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:13:38.486115 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5433c7-59af-4836-bef8-85172eb88ddf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0454aa03fa31487ea1464b9d0008212c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:13:38.486851 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5433c7-59af-4836-bef8-85172eb88ddf service swift] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:13:38.487204 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5433c7-59af-4836-bef8-85172eb88ddf service swift] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:13:38.487551 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5433c7-59af-4836-bef8-85172eb88ddf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:13:38.496992 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5433c7-59af-4836-bef8-85172eb88ddf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:13:38.498692 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5433c7-59af-4836-bef8-85172eb88ddf service swift] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:13:38.510809 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 713/1406] 10.222.0.70 () {60 vars in 1384 bytes} [Tue May 10 19:13:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 19:13:40.630116 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e605b9f3-3a71-4179-aac7-0c8fe0622e2d None None] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:13:40.630764 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e605b9f3-3a71-4179-aac7-0c8fe0622e2d None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:13:40.630764 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e605b9f3-3a71-4179-aac7-0c8fe0622e2d None None] PATH_INFO: `/` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:13:40.632053 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 694/1407] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:13:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:13:40.637701 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13aa4ee-1692-4dd7-b623-39cc6d526455 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:13:40.638196 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13aa4ee-1692-4dd7-b623-39cc6d526455 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:13:40.638289 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13aa4ee-1692-4dd7-b623-39cc6d526455 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:13:40.656514 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-c13aa4ee-1692-4dd7-b623-39cc6d526455 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:13:40.657700 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-c13aa4ee-1692-4dd7-b623-39cc6d526455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:13:40.673038 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 714/1408] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:13:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:13:40.712549 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e605b9f3-3a71-4179-aac7-0c8fe0622e2d None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:13:40.724823 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e605b9f3-3a71-4179-aac7-0c8fe0622e2d None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:13:40.730277 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbdc8fd-7a02-479d-a7e2-d2cb9b9b8c43 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9f310a468ec4058b3c95356ea60ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:13:40.730917 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbdc8fd-7a02-479d-a7e2-d2cb9b9b8c43 service nova] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:13:40.731197 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbdc8fd-7a02-479d-a7e2-d2cb9b9b8c43 service nova] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:13:40.731472 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbdc8fd-7a02-479d-a7e2-d2cb9b9b8c43 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:13:40.741059 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbdc8fd-7a02-479d-a7e2-d2cb9b9b8c43 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:13:40.742655 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbdc8fd-7a02-479d-a7e2-d2cb9b9b8c43 service nova] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:13:40.756506 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 695/1409] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:13:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:14:02.000527 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44694f25-6899-44ed-ad07-b1d9595d4f1e None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:14:02.001166 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44694f25-6899-44ed-ad07-b1d9595d4f1e None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:14:02.001166 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44694f25-6899-44ed-ad07-b1d9595d4f1e None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:14:02.002466 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 715/1410] 10.222.0.70 () {54 vars in 918 bytes} [Tue May 10 19:14:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:14:02.007697 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7f9a24-9d84-477d-81ef-fc3d93559d00 None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:14:02.008164 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7f9a24-9d84-477d-81ef-fc3d93559d00 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:14:02.008273 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7f9a24-9d84-477d-81ef-fc3d93559d00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:14:02.026186 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-5e7f9a24-9d84-477d-81ef-fc3d93559d00 None None] MFA Rules not processed for user `11b95d3824f34cfcada6915ee57a7e08`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:14:02.027371 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-5e7f9a24-9d84-477d-81ef-fc3d93559d00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:14:02.036347 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 696/1411] 10.222.0.70 () {58 vars in 1015 bytes} [Tue May 10 19:14:02 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:14:02.050111 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddf30c0-95dc-48ea-a1b8-ed6fd8756530 None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:14:02.050398 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddf30c0-95dc-48ea-a1b8-ed6fd8756530 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:14:02.050678 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddf30c0-95dc-48ea-a1b8-ed6fd8756530 None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:14:02.052003 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 716/1412] 10.222.0.70 () {54 vars in 918 bytes} [Tue May 10 19:14:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:14:02.056604 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29f0f78-d8eb-4668-b599-4eb366d41262 None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:14:02.056897 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29f0f78-d8eb-4668-b599-4eb366d41262 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:14:02.057174 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29f0f78-d8eb-4668-b599-4eb366d41262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:14:02.074682 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-e29f0f78-d8eb-4668-b599-4eb366d41262 None None] MFA Rules not processed for user `b9f310a468ec4058b3c95356ea60ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:14:02.075839 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-e29f0f78-d8eb-4668-b599-4eb366d41262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:14:02.085116 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 697/1413] 10.222.0.70 () {58 vars in 1015 bytes} [Tue May 10 19:14:02 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:14:04.772114 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb33cc21-6579-4a6f-82e4-42c0f0f39899 None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:14:04.772760 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb33cc21-6579-4a6f-82e4-42c0f0f39899 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:14:04.773018 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb33cc21-6579-4a6f-82e4-42c0f0f39899 None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:14:04.774406 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 717/1414] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 19:14:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:14:04.779713 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4dedf0-9fcb-4d82-aaae-5a06e638b597 None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:14:04.780135 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4dedf0-9fcb-4d82-aaae-5a06e638b597 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:14:04.780278 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4dedf0-9fcb-4d82-aaae-5a06e638b597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:14:04.797357 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-7d4dedf0-9fcb-4d82-aaae-5a06e638b597 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:14:04.798533 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-7d4dedf0-9fcb-4d82-aaae-5a06e638b597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:14:04.806748 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 698/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 19:14:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:14:04.847889 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb33cc21-6579-4a6f-82e4-42c0f0f39899 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:14:04.862074 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb33cc21-6579-4a6f-82e4-42c0f0f39899 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:14:04.868412 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3defffbf-1dd6-452c-ace0-1b7d713bfcbf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9f310a468ec4058b3c95356ea60ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:14:04.869065 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3defffbf-1dd6-452c-ace0-1b7d713bfcbf service nova] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:14:04.869347 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3defffbf-1dd6-452c-ace0-1b7d713bfcbf service nova] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:14:04.869619 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3defffbf-1dd6-452c-ace0-1b7d713bfcbf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:14:04.877486 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3defffbf-1dd6-452c-ace0-1b7d713bfcbf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:14:04.879577 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3defffbf-1dd6-452c-ace0-1b7d713bfcbf service nova] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:14:04.888584 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 718/1416] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:14:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:14:05.873110 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4445954c-2de9-4686-a6f7-d9eec62c7075 None None] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:14:05.873667 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4445954c-2de9-4686-a6f7-d9eec62c7075 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:14:05.873667 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4445954c-2de9-4686-a6f7-d9eec62c7075 None None] PATH_INFO: `/` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:14:05.875039 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 699/1417] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 10 19:14:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:14:05.880399 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef29f844-539c-4fbb-b7e0-cd5826e76c35 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:14:05.880840 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef29f844-539c-4fbb-b7e0-cd5826e76c35 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:14:05.880983 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef29f844-539c-4fbb-b7e0-cd5826e76c35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:14:05.898637 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-ef29f844-539c-4fbb-b7e0-cd5826e76c35 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:14:05.899791 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-ef29f844-539c-4fbb-b7e0-cd5826e76c35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:14:05.907324 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 719/1418] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 10 19:14:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:14:06.087460 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4445954c-2de9-4686-a6f7-d9eec62c7075 None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:14:06.101264 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4445954c-2de9-4686-a6f7-d9eec62c7075 None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:14:06.106516 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617f937f-d693-4590-9b8c-a624cd4998f8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9f310a468ec4058b3c95356ea60ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:14:06.107141 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617f937f-d693-4590-9b8c-a624cd4998f8 service nova] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:14:06.107452 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617f937f-d693-4590-9b8c-a624cd4998f8 service nova] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:14:06.107731 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617f937f-d693-4590-9b8c-a624cd4998f8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:14:06.115478 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617f937f-d693-4590-9b8c-a624cd4998f8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:14:06.117155 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617f937f-d693-4590-9b8c-a624cd4998f8 service nova] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:14:06.126051 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 700/1419] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:14:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:14:07.100603 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25150f8-ee52-42ef-bb28-92aaeb2a2da6 None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:14:07.101164 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25150f8-ee52-42ef-bb28-92aaeb2a2da6 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:14:07.101164 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25150f8-ee52-42ef-bb28-92aaeb2a2da6 None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:14:07.102522 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 720/1420] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 10 19:14:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:14:07.107407 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f739378a-68f8-4412-8a33-f3ae383affef None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:14:07.107869 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f739378a-68f8-4412-8a33-f3ae383affef None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:14:07.107987 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f739378a-68f8-4412-8a33-f3ae383affef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:14:07.125976 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-f739378a-68f8-4412-8a33-f3ae383affef None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:14:07.127170 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-f739378a-68f8-4412-8a33-f3ae383affef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:14:07.135427 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 701/1421] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 10 19:14:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:14:07.285148 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25150f8-ee52-42ef-bb28-92aaeb2a2da6 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:14:07.298947 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25150f8-ee52-42ef-bb28-92aaeb2a2da6 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:14:07.304814 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79c30fe-bf62-417f-8ee7-8d8647ee1778 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9f310a468ec4058b3c95356ea60ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:14:07.305453 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79c30fe-bf62-417f-8ee7-8d8647ee1778 service nova] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:14:07.305737 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79c30fe-bf62-417f-8ee7-8d8647ee1778 service nova] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:14:07.306014 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79c30fe-bf62-417f-8ee7-8d8647ee1778 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:14:07.313826 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79c30fe-bf62-417f-8ee7-8d8647ee1778 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:14:07.315406 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79c30fe-bf62-417f-8ee7-8d8647ee1778 service nova] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:14:07.325133 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 721/1422] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:14:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:14:08.253512 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb7d920-12b8-4647-9b9a-bcc1cfcbcb7e None None] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:14:08.254023 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb7d920-12b8-4647-9b9a-bcc1cfcbcb7e None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:14:08.254023 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb7d920-12b8-4647-9b9a-bcc1cfcbcb7e None None] PATH_INFO: `/` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:14:08.255342 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 702/1423] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 10 19:14:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:14:08.260467 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cac2e1-1a61-4321-abb8-b300a46cd414 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:14:08.260911 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cac2e1-1a61-4321-abb8-b300a46cd414 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:14:08.261022 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cac2e1-1a61-4321-abb8-b300a46cd414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:14:08.279500 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-77cac2e1-1a61-4321-abb8-b300a46cd414 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:14:08.280706 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-77cac2e1-1a61-4321-abb8-b300a46cd414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:14:08.288334 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 722/1424] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 10 19:14:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:14:08.441109 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb7d920-12b8-4647-9b9a-bcc1cfcbcb7e None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:14:08.455258 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb7d920-12b8-4647-9b9a-bcc1cfcbcb7e None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:14:08.461217 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12919894-a9a5-461d-b727-6db78ce64634 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9f310a468ec4058b3c95356ea60ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:14:08.461849 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12919894-a9a5-461d-b727-6db78ce64634 service nova] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:14:08.462135 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12919894-a9a5-461d-b727-6db78ce64634 service nova] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:14:08.462413 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12919894-a9a5-461d-b727-6db78ce64634 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:14:08.470212 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12919894-a9a5-461d-b727-6db78ce64634 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:14:08.471828 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12919894-a9a5-461d-b727-6db78ce64634 service nova] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:14:08.480890 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 703/1425] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:14:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:14:09.412957 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215a40d5-0741-445f-be64-f2ea1040cca9 None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:14:09.413485 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215a40d5-0741-445f-be64-f2ea1040cca9 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:14:09.413485 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215a40d5-0741-445f-be64-f2ea1040cca9 None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:14:09.414858 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 723/1426] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 10 19:14:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:14:09.419722 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025039a6-ee69-4bb4-ace7-fe25409c6264 None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:14:09.420128 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025039a6-ee69-4bb4-ace7-fe25409c6264 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:14:09.420290 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025039a6-ee69-4bb4-ace7-fe25409c6264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:14:09.438064 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-025039a6-ee69-4bb4-ace7-fe25409c6264 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:14:09.439240 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-025039a6-ee69-4bb4-ace7-fe25409c6264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:14:09.447599 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 704/1427] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 10 19:14:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:14:09.595792 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215a40d5-0741-445f-be64-f2ea1040cca9 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:14:09.610507 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215a40d5-0741-445f-be64-f2ea1040cca9 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:14:09.616397 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57750d3-052f-414c-8629-d7c8d03ffaae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9f310a468ec4058b3c95356ea60ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:14:09.617053 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57750d3-052f-414c-8629-d7c8d03ffaae service nova] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:14:09.617333 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57750d3-052f-414c-8629-d7c8d03ffaae service nova] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:14:09.617603 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57750d3-052f-414c-8629-d7c8d03ffaae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:14:09.625487 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57750d3-052f-414c-8629-d7c8d03ffaae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:14:09.627039 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57750d3-052f-414c-8629-d7c8d03ffaae service nova] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:14:09.636064 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 724/1428] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:14:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:14:10.513319 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffb93ec-4307-4030-a78b-01c7ff230158 None None] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:14:10.513887 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffb93ec-4307-4030-a78b-01c7ff230158 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:14:10.513887 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffb93ec-4307-4030-a78b-01c7ff230158 None None] PATH_INFO: `/` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:14:10.515257 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 705/1429] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 10 19:14:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:14:10.520631 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ee1efb-9852-4364-9177-a9750627c9fd None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:14:10.521053 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ee1efb-9852-4364-9177-a9750627c9fd None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:14:10.521169 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ee1efb-9852-4364-9177-a9750627c9fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:14:10.538223 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-e4ee1efb-9852-4364-9177-a9750627c9fd None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:14:10.539380 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-e4ee1efb-9852-4364-9177-a9750627c9fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:14:10.546938 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 725/1430] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 10 19:14:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:14:10.695910 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffb93ec-4307-4030-a78b-01c7ff230158 None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:14:10.710747 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffb93ec-4307-4030-a78b-01c7ff230158 None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:14:10.715998 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a474f3-ac5b-446c-a2b5-daf4048992dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9f310a468ec4058b3c95356ea60ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:14:10.716674 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a474f3-ac5b-446c-a2b5-daf4048992dd service nova] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:14:10.716945 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a474f3-ac5b-446c-a2b5-daf4048992dd service nova] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:14:10.717217 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a474f3-ac5b-446c-a2b5-daf4048992dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:14:10.725093 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a474f3-ac5b-446c-a2b5-daf4048992dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:14:10.726663 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a474f3-ac5b-446c-a2b5-daf4048992dd service nova] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:14:10.735994 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 706/1431] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:14:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:14:11.614543 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81285bed-5965-4906-87d6-e60e822064fc None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:14:11.615054 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81285bed-5965-4906-87d6-e60e822064fc None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:14:11.615054 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81285bed-5965-4906-87d6-e60e822064fc None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:14:11.616395 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 726/1432] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 10 19:14:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:14:11.621395 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8835b94-badf-4877-910d-d562c06b212e None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:14:11.621808 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8835b94-badf-4877-910d-d562c06b212e None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:14:11.621943 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8835b94-badf-4877-910d-d562c06b212e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:14:11.639401 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-f8835b94-badf-4877-910d-d562c06b212e None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:14:11.640609 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-f8835b94-badf-4877-910d-d562c06b212e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:14:11.648885 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 707/1433] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 10 19:14:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:14:11.803015 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81285bed-5965-4906-87d6-e60e822064fc None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:14:11.817344 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81285bed-5965-4906-87d6-e60e822064fc None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:14:11.822596 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c24007d-61fd-42d5-bc28-ac1ad8a725e7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9f310a468ec4058b3c95356ea60ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:14:11.823219 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c24007d-61fd-42d5-bc28-ac1ad8a725e7 service nova] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:14:11.823499 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c24007d-61fd-42d5-bc28-ac1ad8a725e7 service nova] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:14:11.823771 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c24007d-61fd-42d5-bc28-ac1ad8a725e7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:14:11.833080 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c24007d-61fd-42d5-bc28-ac1ad8a725e7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:14:11.834721 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c24007d-61fd-42d5-bc28-ac1ad8a725e7 service nova] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:14:11.843711 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 727/1434] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:14:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:14:12.715661 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e3bc7b-f5d4-43f1-b995-6ca176402100 None None] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:14:12.716225 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e3bc7b-f5d4-43f1-b995-6ca176402100 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:14:12.716225 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e3bc7b-f5d4-43f1-b995-6ca176402100 None None] PATH_INFO: `/` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:14:12.717605 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 708/1435] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 10 19:14:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:14:12.723012 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dbc937-52a5-415c-a2a7-2431a178b559 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:14:12.723399 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dbc937-52a5-415c-a2a7-2431a178b559 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:14:12.723561 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dbc937-52a5-415c-a2a7-2431a178b559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:14:12.741621 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-81dbc937-52a5-415c-a2a7-2431a178b559 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:14:12.742805 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-81dbc937-52a5-415c-a2a7-2431a178b559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:14:12.750730 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 728/1436] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 10 19:14:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:14:12.900141 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e3bc7b-f5d4-43f1-b995-6ca176402100 None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:14:12.914492 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e3bc7b-f5d4-43f1-b995-6ca176402100 None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:14:12.919781 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a497329-3eb0-4df0-a347-1abefee8dc64 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9f310a468ec4058b3c95356ea60ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:14:12.920408 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a497329-3eb0-4df0-a347-1abefee8dc64 service nova] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:14:12.920725 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a497329-3eb0-4df0-a347-1abefee8dc64 service nova] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:14:12.920994 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a497329-3eb0-4df0-a347-1abefee8dc64 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:14:12.929340 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a497329-3eb0-4df0-a347-1abefee8dc64 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:14:12.930908 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a497329-3eb0-4df0-a347-1abefee8dc64 service nova] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:14:12.939893 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 709/1437] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:14:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:14:13.818365 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae69db9-1a0e-4a82-8aaa-b6c0d3551c40 None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:14:13.818929 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae69db9-1a0e-4a82-8aaa-b6c0d3551c40 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:14:13.818929 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae69db9-1a0e-4a82-8aaa-b6c0d3551c40 None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:14:13.820286 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 729/1438] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 10 19:14:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:14:13.825387 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f76c75-84a5-49dd-a04c-921bd2195f78 None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:14:13.825850 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f76c75-84a5-49dd-a04c-921bd2195f78 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:14:13.825958 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f76c75-84a5-49dd-a04c-921bd2195f78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:14:13.844039 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-14f76c75-84a5-49dd-a04c-921bd2195f78 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:14:13.845245 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-14f76c75-84a5-49dd-a04c-921bd2195f78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:14:13.853529 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 710/1439] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 10 19:14:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:14:14.005913 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae69db9-1a0e-4a82-8aaa-b6c0d3551c40 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:14:14.020347 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae69db9-1a0e-4a82-8aaa-b6c0d3551c40 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:14:14.025690 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862f6cd4-d4c9-4563-9a8d-39ab33447e6f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9f310a468ec4058b3c95356ea60ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:14:14.026320 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862f6cd4-d4c9-4563-9a8d-39ab33447e6f service nova] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:14:14.026604 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862f6cd4-d4c9-4563-9a8d-39ab33447e6f service nova] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:14:14.026879 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862f6cd4-d4c9-4563-9a8d-39ab33447e6f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:14:14.035187 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862f6cd4-d4c9-4563-9a8d-39ab33447e6f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:14:14.036797 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862f6cd4-d4c9-4563-9a8d-39ab33447e6f service nova] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:14:14.045807 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 730/1440] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:14:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:14:16.098693 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9994c101-bb28-461b-b236-12cddef199e6 None None] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:14:16.099246 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9994c101-bb28-461b-b236-12cddef199e6 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:14:16.099246 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9994c101-bb28-461b-b236-12cddef199e6 None None] PATH_INFO: `/` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:14:16.100618 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 711/1441] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 19:14:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:14:16.105845 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c065ae39-b7e6-4236-9d0d-e57626b2049e None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:14:16.106272 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c065ae39-b7e6-4236-9d0d-e57626b2049e None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:14:16.106388 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c065ae39-b7e6-4236-9d0d-e57626b2049e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:14:16.123397 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-c065ae39-b7e6-4236-9d0d-e57626b2049e None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:14:16.124724 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-c065ae39-b7e6-4236-9d0d-e57626b2049e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:14:16.132436 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 731/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 19:14:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:14:16.170645 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9994c101-bb28-461b-b236-12cddef199e6 None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:14:16.172220 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-9994c101-bb28-461b-b236-12cddef199e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:14:16.184722 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9994c101-bb28-461b-b236-12cddef199e6 None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:14:16.188175 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6920ea-e958-4b88-aadb-10e8ce8a532e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f1dc79540b48c0866478cc48cd8205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:14:16.188844 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6920ea-e958-4b88-aadb-10e8ce8a532e service neutron] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:14:16.189127 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6920ea-e958-4b88-aadb-10e8ce8a532e service neutron] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:14:16.189404 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6920ea-e958-4b88-aadb-10e8ce8a532e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:14:16.198035 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6920ea-e958-4b88-aadb-10e8ce8a532e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:14:16.199461 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6920ea-e958-4b88-aadb-10e8ce8a532e service neutron] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:14:16.209268 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 712/1443] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:14:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:14:18.561844 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be6fbab-4375-4937-8639-0254cc9a80a7 None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:14:18.562378 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be6fbab-4375-4937-8639-0254cc9a80a7 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:14:18.562477 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be6fbab-4375-4937-8639-0254cc9a80a7 None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:14:18.563806 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 732/1444] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 19:14:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 19:14:18.569569 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9e90cf-c020-4016-8a32-56c4bd8a0d0a None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:14:18.569947 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9e90cf-c020-4016-8a32-56c4bd8a0d0a None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:14:18.570130 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9e90cf-c020-4016-8a32-56c4bd8a0d0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:14:18.588206 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-4a9e90cf-c020-4016-8a32-56c4bd8a0d0a None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:14:18.589418 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-4a9e90cf-c020-4016-8a32-56c4bd8a0d0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:14:18.597684 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 713/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 19:14:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:14:18.634906 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be6fbab-4375-4937-8639-0254cc9a80a7 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:14:18.645425 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be6fbab-4375-4937-8639-0254cc9a80a7 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:14:18.648932 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7471e8a2-07d5-400c-b622-2a0a4c6f615b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f1dc79540b48c0866478cc48cd8205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:14:18.649561 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7471e8a2-07d5-400c-b622-2a0a4c6f615b service neutron] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:14:18.649846 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7471e8a2-07d5-400c-b622-2a0a4c6f615b service neutron] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:14:18.650120 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7471e8a2-07d5-400c-b622-2a0a4c6f615b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:14:18.658779 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7471e8a2-07d5-400c-b622-2a0a4c6f615b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:14:18.660746 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7471e8a2-07d5-400c-b622-2a0a4c6f615b service neutron] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:14:18.670150 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 733/1446] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:14:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:14:21.150487 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f496e0-8125-4e17-a449-ca1f8d36e520 None None] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:14:21.151071 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f496e0-8125-4e17-a449-ca1f8d36e520 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:14:21.151071 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f496e0-8125-4e17-a449-ca1f8d36e520 None None] PATH_INFO: `/` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:14:21.152358 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 714/1447] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 19:14:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:14:21.157562 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf07fc59-58ba-4ff4-a575-7d576c083528 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:14:21.158030 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf07fc59-58ba-4ff4-a575-7d576c083528 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:14:21.158146 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf07fc59-58ba-4ff4-a575-7d576c083528 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:14:21.175786 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-bf07fc59-58ba-4ff4-a575-7d576c083528 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:14:21.177004 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-bf07fc59-58ba-4ff4-a575-7d576c083528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:14:21.184694 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 734/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 19:14:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:14:21.223015 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f496e0-8125-4e17-a449-ca1f8d36e520 None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:14:21.233333 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f496e0-8125-4e17-a449-ca1f8d36e520 None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:14:21.236759 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c233d509-cf66-4c22-aee1-60c6c57310f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f1dc79540b48c0866478cc48cd8205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:14:21.237892 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c233d509-cf66-4c22-aee1-60c6c57310f6 service neutron] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:14:21.238170 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c233d509-cf66-4c22-aee1-60c6c57310f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:14:21.238439 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c233d509-cf66-4c22-aee1-60c6c57310f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:14:21.246855 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c233d509-cf66-4c22-aee1-60c6c57310f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:14:21.248272 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c233d509-cf66-4c22-aee1-60c6c57310f6 service neutron] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:14:21.257998 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 715/1449] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:14:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:14:23.591357 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e0a3f7-eb11-464a-bd4d-07922037ddd1 None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:14:23.591954 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e0a3f7-eb11-464a-bd4d-07922037ddd1 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:14:23.591954 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e0a3f7-eb11-464a-bd4d-07922037ddd1 None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:14:23.593265 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 735/1450] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 19:14:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:14:23.599181 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856f32c5-82b7-44a2-b608-3742d2243923 None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:14:23.599637 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856f32c5-82b7-44a2-b608-3742d2243923 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:14:23.599747 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856f32c5-82b7-44a2-b608-3742d2243923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:14:23.618248 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-856f32c5-82b7-44a2-b608-3742d2243923 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:14:23.619418 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-856f32c5-82b7-44a2-b608-3742d2243923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:14:23.627117 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 716/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 19:14:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:14:23.665010 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e0a3f7-eb11-464a-bd4d-07922037ddd1 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:14:23.675340 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e0a3f7-eb11-464a-bd4d-07922037ddd1 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:14:23.678754 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf15562-3b51-408b-b6f4-6ac801cc8e3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f1dc79540b48c0866478cc48cd8205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:14:23.679374 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf15562-3b51-408b-b6f4-6ac801cc8e3b service neutron] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:14:23.679649 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf15562-3b51-408b-b6f4-6ac801cc8e3b service neutron] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:14:23.679915 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf15562-3b51-408b-b6f4-6ac801cc8e3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:14:23.688392 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf15562-3b51-408b-b6f4-6ac801cc8e3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:14:23.689829 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf15562-3b51-408b-b6f4-6ac801cc8e3b service neutron] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:14:23.698860 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 736/1452] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:14:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:14:25.969993 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09bf181-6d20-4972-b0e9-59c684f8b0a9 None None] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:14:25.970495 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09bf181-6d20-4972-b0e9-59c684f8b0a9 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:14:25.970621 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09bf181-6d20-4972-b0e9-59c684f8b0a9 None None] PATH_INFO: `/` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:14:25.972586 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 717/1453] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 19:14:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:14:25.977792 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f183a68-9137-41ef-b594-97e68d2dc06f None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:14:25.978204 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f183a68-9137-41ef-b594-97e68d2dc06f None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:14:25.978359 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f183a68-9137-41ef-b594-97e68d2dc06f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:14:25.995444 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-9f183a68-9137-41ef-b594-97e68d2dc06f None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:14:25.996660 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-9f183a68-9137-41ef-b594-97e68d2dc06f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:14:26.004466 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 737/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 19:14:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:14:26.041827 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09bf181-6d20-4972-b0e9-59c684f8b0a9 None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:14:26.051993 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09bf181-6d20-4972-b0e9-59c684f8b0a9 None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:14:26.055545 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d79089-7cc0-413e-ab7a-5366fe857546 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f1dc79540b48c0866478cc48cd8205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:14:26.056162 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d79089-7cc0-413e-ab7a-5366fe857546 service neutron] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:14:26.056459 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d79089-7cc0-413e-ab7a-5366fe857546 service neutron] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:14:26.056732 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d79089-7cc0-413e-ab7a-5366fe857546 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:14:26.065118 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d79089-7cc0-413e-ab7a-5366fe857546 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:14:26.067029 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d79089-7cc0-413e-ab7a-5366fe857546 service neutron] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:14:26.075903 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 718/1455] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:14:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:14:28.311043 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09379e25-9985-4df6-9221-c42f969ccb77 None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:14:28.311570 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09379e25-9985-4df6-9221-c42f969ccb77 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:14:28.311570 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09379e25-9985-4df6-9221-c42f969ccb77 None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:14:28.312947 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 738/1456] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 19:14:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:14:28.318607 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a19108-9518-4da9-8b24-d9bc54273943 None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:14:28.319079 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a19108-9518-4da9-8b24-d9bc54273943 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:14:28.319182 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a19108-9518-4da9-8b24-d9bc54273943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:14:28.336254 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-06a19108-9518-4da9-8b24-d9bc54273943 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:14:28.337447 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-06a19108-9518-4da9-8b24-d9bc54273943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:14:28.344983 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 719/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 19:14:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:14:28.381846 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09379e25-9985-4df6-9221-c42f969ccb77 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:14:28.392068 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09379e25-9985-4df6-9221-c42f969ccb77 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:14:28.395518 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7b7248-473d-4942-95d2-b200ec6d7f85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f1dc79540b48c0866478cc48cd8205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:14:28.396142 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7b7248-473d-4942-95d2-b200ec6d7f85 service neutron] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:14:28.396438 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7b7248-473d-4942-95d2-b200ec6d7f85 service neutron] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:14:28.396731 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7b7248-473d-4942-95d2-b200ec6d7f85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:14:28.405266 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7b7248-473d-4942-95d2-b200ec6d7f85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:14:28.406673 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7b7248-473d-4942-95d2-b200ec6d7f85 service neutron] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:14:28.416160 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 739/1458] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:14:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:14:30.677018 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2d5a13-cee8-49d4-a3d9-c31abe7a82b9 None None] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:14:30.677585 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2d5a13-cee8-49d4-a3d9-c31abe7a82b9 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:14:30.677585 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2d5a13-cee8-49d4-a3d9-c31abe7a82b9 None None] PATH_INFO: `/` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:14:30.678922 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 720/1459] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 19:14:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:14:30.684265 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9bb135-d517-440a-b544-83e689d1154c None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:14:30.684684 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9bb135-d517-440a-b544-83e689d1154c None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:14:30.684885 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9bb135-d517-440a-b544-83e689d1154c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:14:30.702447 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-4d9bb135-d517-440a-b544-83e689d1154c None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:14:30.703887 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-4d9bb135-d517-440a-b544-83e689d1154c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:14:30.712336 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 740/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 19:14:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:14:30.747784 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2d5a13-cee8-49d4-a3d9-c31abe7a82b9 None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:14:30.758583 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2d5a13-cee8-49d4-a3d9-c31abe7a82b9 None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:14:30.762100 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f910f8b5-f224-4444-80be-5e32585ddc5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f1dc79540b48c0866478cc48cd8205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:14:30.762728 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f910f8b5-f224-4444-80be-5e32585ddc5e service neutron] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:14:30.763010 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f910f8b5-f224-4444-80be-5e32585ddc5e service neutron] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:14:30.763286 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f910f8b5-f224-4444-80be-5e32585ddc5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:14:30.772531 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f910f8b5-f224-4444-80be-5e32585ddc5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:14:30.773957 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f910f8b5-f224-4444-80be-5e32585ddc5e service neutron] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:14:30.783044 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 721/1461] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:14:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 19:14:33.026116 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35bbcf2-123d-4fcc-8d2d-ddd6a03ae6bd None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:14:33.026642 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35bbcf2-123d-4fcc-8d2d-ddd6a03ae6bd None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:14:33.026642 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35bbcf2-123d-4fcc-8d2d-ddd6a03ae6bd None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:14:33.028019 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 741/1462] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 19:14:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:14:33.033254 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6a2d06-535f-4a21-8d5d-466eb53d652e None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:14:33.033683 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6a2d06-535f-4a21-8d5d-466eb53d652e None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:14:33.034327 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6a2d06-535f-4a21-8d5d-466eb53d652e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:14:33.052532 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-0a6a2d06-535f-4a21-8d5d-466eb53d652e None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:14:33.053725 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-0a6a2d06-535f-4a21-8d5d-466eb53d652e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:14:33.061717 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 722/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 19:14:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:14:33.097968 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35bbcf2-123d-4fcc-8d2d-ddd6a03ae6bd None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:14:33.108381 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35bbcf2-123d-4fcc-8d2d-ddd6a03ae6bd None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:14:33.112058 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85e4708-91c6-48c4-b3a9-dfb7113fca0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f1dc79540b48c0866478cc48cd8205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:14:33.113276 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85e4708-91c6-48c4-b3a9-dfb7113fca0c service neutron] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:14:33.113563 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85e4708-91c6-48c4-b3a9-dfb7113fca0c service neutron] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:14:33.113840 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85e4708-91c6-48c4-b3a9-dfb7113fca0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:14:33.122672 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85e4708-91c6-48c4-b3a9-dfb7113fca0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:14:33.124075 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85e4708-91c6-48c4-b3a9-dfb7113fca0c service neutron] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:14:33.133038 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 742/1464] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:14:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:14:35.385976 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de8c3a2-eff2-4223-944f-16cd15f75c1c None None] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:14:35.386563 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de8c3a2-eff2-4223-944f-16cd15f75c1c None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:14:35.386563 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de8c3a2-eff2-4223-944f-16cd15f75c1c None None] PATH_INFO: `/` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:14:35.387866 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 723/1465] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 19:14:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:14:35.393153 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab630a06-5c33-49ae-b940-e1ad0b0dd1e0 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:14:35.394079 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab630a06-5c33-49ae-b940-e1ad0b0dd1e0 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:14:35.394361 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab630a06-5c33-49ae-b940-e1ad0b0dd1e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:14:35.411457 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-ab630a06-5c33-49ae-b940-e1ad0b0dd1e0 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:14:35.412667 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-ab630a06-5c33-49ae-b940-e1ad0b0dd1e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:14:35.420359 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 743/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 19:14:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:14:35.456702 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de8c3a2-eff2-4223-944f-16cd15f75c1c None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:14:35.467310 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de8c3a2-eff2-4223-944f-16cd15f75c1c None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:14:35.470850 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3a4c0f-797b-4040-b4b5-d8f67e74fc95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f1dc79540b48c0866478cc48cd8205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:14:35.471484 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3a4c0f-797b-4040-b4b5-d8f67e74fc95 service neutron] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:14:35.471767 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3a4c0f-797b-4040-b4b5-d8f67e74fc95 service neutron] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:14:35.472043 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3a4c0f-797b-4040-b4b5-d8f67e74fc95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:14:35.480713 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3a4c0f-797b-4040-b4b5-d8f67e74fc95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:14:35.482144 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3a4c0f-797b-4040-b4b5-d8f67e74fc95 service neutron] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:14:35.491591 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 724/1467] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:14:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 19:14:37.710370 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a72c44a-50ca-4a5f-84b6-0922c8dcbe30 None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:14:37.710897 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a72c44a-50ca-4a5f-84b6-0922c8dcbe30 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:14:37.710996 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a72c44a-50ca-4a5f-84b6-0922c8dcbe30 None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:14:37.712298 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 744/1468] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 19:14:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:14:37.717565 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a905582-0255-4229-8699-bd0c8cb317ee None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:14:37.718009 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a905582-0255-4229-8699-bd0c8cb317ee None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:14:37.718149 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a905582-0255-4229-8699-bd0c8cb317ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:14:37.735769 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-0a905582-0255-4229-8699-bd0c8cb317ee None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:14:37.736993 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-0a905582-0255-4229-8699-bd0c8cb317ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:14:37.744565 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 725/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 19:14:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:14:37.780038 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a72c44a-50ca-4a5f-84b6-0922c8dcbe30 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:14:37.790773 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a72c44a-50ca-4a5f-84b6-0922c8dcbe30 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:14:37.794248 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69420e6-81c4-4c1a-a155-4959350790a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f1dc79540b48c0866478cc48cd8205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:14:37.794870 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69420e6-81c4-4c1a-a155-4959350790a5 service neutron] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:14:37.795145 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69420e6-81c4-4c1a-a155-4959350790a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:14:37.795413 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69420e6-81c4-4c1a-a155-4959350790a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:14:37.805653 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69420e6-81c4-4c1a-a155-4959350790a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:14:37.807065 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69420e6-81c4-4c1a-a155-4959350790a5 service neutron] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:14:37.816001 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 745/1470] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:14:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:15:11.901343 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8389d9e-d628-4728-a071-48e6e6e3cf2f None None] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:15:11.901940 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8389d9e-d628-4728-a071-48e6e6e3cf2f None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:15:11.901940 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8389d9e-d628-4728-a071-48e6e6e3cf2f None None] PATH_INFO: `/` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:15:11.903357 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 726/1471] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:15:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:15:11.908402 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e76906b-163c-4613-a24a-2b0bac5038c8 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:15:11.908860 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e76906b-163c-4613-a24a-2b0bac5038c8 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:15:11.908984 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e76906b-163c-4613-a24a-2b0bac5038c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:15:11.925984 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-2e76906b-163c-4613-a24a-2b0bac5038c8 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:15:11.927158 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-2e76906b-163c-4613-a24a-2b0bac5038c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:15:11.934820 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 746/1472] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:15:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:15:11.981852 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f450bc-e1a9-4d6b-8d6e-f3fdde078b50 None None] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:15:11.982145 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f450bc-e1a9-4d6b-8d6e-f3fdde078b50 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:15:11.982422 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f450bc-e1a9-4d6b-8d6e-f3fdde078b50 None None] PATH_INFO: `/` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:15:11.983753 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 727/1473] 10.222.0.70 () {54 vars in 962 bytes} [Tue May 10 19:15:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:15:11.988701 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4249da41-3351-474e-ae5b-b93fb3fe47b8 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:15:11.988992 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4249da41-3351-474e-ae5b-b93fb3fe47b8 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:15:11.989277 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4249da41-3351-474e-ae5b-b93fb3fe47b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:15:12.007129 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-4249da41-3351-474e-ae5b-b93fb3fe47b8 None None] MFA Rules not processed for user `24ca97ff2a1745e58dedba4cef61b3f0`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:15:12.008357 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-4249da41-3351-474e-ae5b-b93fb3fe47b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:15:12.014686 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 747/1474] 10.222.0.70 () {58 vars in 1059 bytes} [Tue May 10 19:15:11 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:15:12.022283 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f450bc-e1a9-4d6b-8d6e-f3fdde078b50 None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:15:12.032447 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f450bc-e1a9-4d6b-8d6e-f3fdde078b50 None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:15:12.035881 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bb01be-56c9-42eb-b12e-9e2bd25e0f61 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24ca97ff2a1745e58dedba4cef61b3f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:15:12.036530 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bb01be-56c9-42eb-b12e-9e2bd25e0f61 service glance] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:15:12.036815 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bb01be-56c9-42eb-b12e-9e2bd25e0f61 service glance] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:15:12.037089 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bb01be-56c9-42eb-b12e-9e2bd25e0f61 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:15:12.045573 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bb01be-56c9-42eb-b12e-9e2bd25e0f61 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:15:12.046997 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bb01be-56c9-42eb-b12e-9e2bd25e0f61 service glance] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:15:12.055905 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 728/1475] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:15:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:15:14.389404 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f33ef39-96cb-4b54-8d18-c620f757576c None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:15:14.390001 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f33ef39-96cb-4b54-8d18-c620f757576c None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:15:14.390001 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f33ef39-96cb-4b54-8d18-c620f757576c None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:15:14.391322 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 748/1476] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:15:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:15:14.397120 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d001e0-dfa3-4bae-8d51-7f32552626fa None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:15:14.397502 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d001e0-dfa3-4bae-8d51-7f32552626fa None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:15:14.397701 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d001e0-dfa3-4bae-8d51-7f32552626fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:15:14.415063 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-39d001e0-dfa3-4bae-8d51-7f32552626fa None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:15:14.416230 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-39d001e0-dfa3-4bae-8d51-7f32552626fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:15:14.424403 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 729/1477] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:15:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:15:14.447500 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f33ef39-96cb-4b54-8d18-c620f757576c None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:15:14.459805 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f33ef39-96cb-4b54-8d18-c620f757576c None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:15:14.464243 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1aca3a5-5132-42f2-ae22-8fb45b0ea5cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:15:14.464914 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aca3a5-5132-42f2-ae22-8fb45b0ea5cf admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:15:14.465199 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aca3a5-5132-42f2-ae22-8fb45b0ea5cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:15:14.465474 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aca3a5-5132-42f2-ae22-8fb45b0ea5cf admin admin] PATH_INFO: `/v3/projects` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:15:14.466202 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1aca3a5-5132-42f2-ae22-8fb45b0ea5cf admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:15:14.467961 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: WARNING py.warnings [None req-d1aca3a5-5132-42f2-ae22-8fb45b0ea5cf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 10 19:15:14.467961 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: warnings.warn(msg) May 10 19:15:14.467961 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: May 10 19:15:14.469130 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1aca3a5-5132-42f2-ae22-8fb45b0ea5cf admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:15:14.488064 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 749/1478] 10.222.0.70 () {56 vars in 1108 bytes} [Tue May 10 19:15:14 2022] GET /identity/v3/projects => generated 2553 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:15:16.723594 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c256cbb3-1bcd-4046-ba42-9111037cddc8 None None] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:15:16.724165 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c256cbb3-1bcd-4046-ba42-9111037cddc8 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:15:16.724165 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c256cbb3-1bcd-4046-ba42-9111037cddc8 None None] PATH_INFO: `/` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:15:16.725548 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 730/1479] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:15:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:15:16.730939 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa7ec24-2596-4ed7-902d-82accb1b3907 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:15:16.731346 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa7ec24-2596-4ed7-902d-82accb1b3907 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:15:16.731504 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa7ec24-2596-4ed7-902d-82accb1b3907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:15:16.749491 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-efa7ec24-2596-4ed7-902d-82accb1b3907 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:15:16.750677 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-efa7ec24-2596-4ed7-902d-82accb1b3907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:15:16.758943 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 750/1480] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:15:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:15:16.800191 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c256cbb3-1bcd-4046-ba42-9111037cddc8 None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:15:16.814521 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c256cbb3-1bcd-4046-ba42-9111037cddc8 None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:15:16.819667 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7b2c24-85ed-445a-94b3-46b0d48a1167 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9f310a468ec4058b3c95356ea60ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:15:16.820290 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7b2c24-85ed-445a-94b3-46b0d48a1167 service nova] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:15:16.820606 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7b2c24-85ed-445a-94b3-46b0d48a1167 service nova] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:15:16.820881 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7b2c24-85ed-445a-94b3-46b0d48a1167 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:15:16.828821 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7b2c24-85ed-445a-94b3-46b0d48a1167 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:15:16.830387 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7b2c24-85ed-445a-94b3-46b0d48a1167 service nova] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:15:16.839262 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 731/1481] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:15:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:15:19.223811 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09da88a8-0afb-4fd8-95e5-9a2301a12a44 None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:15:19.224366 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09da88a8-0afb-4fd8-95e5-9a2301a12a44 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:15:19.224366 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09da88a8-0afb-4fd8-95e5-9a2301a12a44 None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:15:19.225773 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 751/1482] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:15:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:15:19.230932 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1dc213-bc33-44e7-954b-66163408b1fa None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:15:19.231371 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1dc213-bc33-44e7-954b-66163408b1fa None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:15:19.231484 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1dc213-bc33-44e7-954b-66163408b1fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:15:19.249241 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-3d1dc213-bc33-44e7-954b-66163408b1fa None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:15:19.250456 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-3d1dc213-bc33-44e7-954b-66163408b1fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:15:19.259039 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 732/1483] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:15:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:15:19.294130 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09da88a8-0afb-4fd8-95e5-9a2301a12a44 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:15:19.304950 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09da88a8-0afb-4fd8-95e5-9a2301a12a44 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:15:19.314847 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249ae82c-a172-41ae-a05d-152081cb472d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f1dc79540b48c0866478cc48cd8205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:15:19.315487 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249ae82c-a172-41ae-a05d-152081cb472d service neutron] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:15:19.315770 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249ae82c-a172-41ae-a05d-152081cb472d service neutron] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:15:19.316047 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249ae82c-a172-41ae-a05d-152081cb472d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:15:19.326375 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249ae82c-a172-41ae-a05d-152081cb472d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:15:19.327808 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249ae82c-a172-41ae-a05d-152081cb472d service neutron] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:15:19.337261 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 752/1484] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:15:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:15:21.597561 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5358bb2-0b70-43bc-a72b-e03cfc11f858 None None] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:15:21.598087 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5358bb2-0b70-43bc-a72b-e03cfc11f858 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:15:21.598087 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5358bb2-0b70-43bc-a72b-e03cfc11f858 None None] PATH_INFO: `/` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:15:21.599381 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 733/1485] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:15:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:15:21.604587 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1f12c8-55c5-4916-a1bd-68c59d6c5cee None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:15:21.604976 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1f12c8-55c5-4916-a1bd-68c59d6c5cee None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:15:21.605154 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1f12c8-55c5-4916-a1bd-68c59d6c5cee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:15:21.625825 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-0a1f12c8-55c5-4916-a1bd-68c59d6c5cee None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:15:21.627077 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-0a1f12c8-55c5-4916-a1bd-68c59d6c5cee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:15:21.634762 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 753/1486] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:15:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:15:21.671700 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5358bb2-0b70-43bc-a72b-e03cfc11f858 None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:15:21.682592 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5358bb2-0b70-43bc-a72b-e03cfc11f858 None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:15:21.686099 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9508d2f7-46fa-4dff-a7da-10eca92f007b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f1dc79540b48c0866478cc48cd8205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:15:21.686720 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9508d2f7-46fa-4dff-a7da-10eca92f007b service neutron] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:15:21.686999 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9508d2f7-46fa-4dff-a7da-10eca92f007b service neutron] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:15:21.687272 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9508d2f7-46fa-4dff-a7da-10eca92f007b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:15:21.695712 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9508d2f7-46fa-4dff-a7da-10eca92f007b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:15:21.697154 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9508d2f7-46fa-4dff-a7da-10eca92f007b service neutron] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:15:21.706313 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 734/1487] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:15:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:15:24.065889 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d322f99-8c5e-4633-ae3e-9fbfd2c1a29d None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:15:24.066499 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d322f99-8c5e-4633-ae3e-9fbfd2c1a29d None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:15:24.066499 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d322f99-8c5e-4633-ae3e-9fbfd2c1a29d None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:15:24.067804 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 754/1488] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:15:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:15:24.073133 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7300fce-1708-42dd-b952-261e232df0f4 None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:15:24.073572 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7300fce-1708-42dd-b952-261e232df0f4 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:15:24.073678 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7300fce-1708-42dd-b952-261e232df0f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:15:24.091683 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-c7300fce-1708-42dd-b952-261e232df0f4 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:15:24.092920 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-c7300fce-1708-42dd-b952-261e232df0f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:15:24.100696 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 735/1489] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:15:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:15:24.139664 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d322f99-8c5e-4633-ae3e-9fbfd2c1a29d None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:15:24.150663 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d322f99-8c5e-4633-ae3e-9fbfd2c1a29d None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:15:24.154165 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd84989-af41-4fd5-9d22-9f44ef131a1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f1dc79540b48c0866478cc48cd8205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:15:24.154795 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd84989-af41-4fd5-9d22-9f44ef131a1a service neutron] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:15:24.155077 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd84989-af41-4fd5-9d22-9f44ef131a1a service neutron] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:15:24.155354 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd84989-af41-4fd5-9d22-9f44ef131a1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:15:24.163941 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd84989-af41-4fd5-9d22-9f44ef131a1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:15:24.165513 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd84989-af41-4fd5-9d22-9f44ef131a1a service neutron] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:15:24.175189 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 755/1490] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:15:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:15:26.571435 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e733239e-f9fd-44ba-a7d5-9c16880789a2 None None] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:15:26.572005 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e733239e-f9fd-44ba-a7d5-9c16880789a2 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:15:26.572005 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e733239e-f9fd-44ba-a7d5-9c16880789a2 None None] PATH_INFO: `/` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:15:26.573438 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 736/1491] 10.222.0.70 () {54 vars in 926 bytes} [Tue May 10 19:15:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:15:26.579662 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a3cefc-e6b6-4892-aea9-bc8550862a9e None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:15:26.580116 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a3cefc-e6b6-4892-aea9-bc8550862a9e None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:15:26.580238 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a3cefc-e6b6-4892-aea9-bc8550862a9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:15:26.597972 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-a1a3cefc-e6b6-4892-aea9-bc8550862a9e None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:15:26.599149 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-a1a3cefc-e6b6-4892-aea9-bc8550862a9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:15:26.606815 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 756/1492] 10.222.0.70 () {58 vars in 1023 bytes} [Tue May 10 19:15:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:15:26.646803 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e733239e-f9fd-44ba-a7d5-9c16880789a2 None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:15:26.657099 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e733239e-f9fd-44ba-a7d5-9c16880789a2 None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:15:26.661185 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f0b28e-55e1-433c-94ff-898ca8454e13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f1dc79540b48c0866478cc48cd8205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:15:26.661809 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f0b28e-55e1-433c-94ff-898ca8454e13 service neutron] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:15:26.662087 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f0b28e-55e1-433c-94ff-898ca8454e13 service neutron] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:15:26.662396 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f0b28e-55e1-433c-94ff-898ca8454e13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:15:26.670946 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f0b28e-55e1-433c-94ff-898ca8454e13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:15:26.672367 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f0b28e-55e1-433c-94ff-898ca8454e13 service neutron] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:15:26.681611 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 737/1493] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:15:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:16:54.240509 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456013f6-a50c-4ffc-bfa3-1362b5a63edf None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:16:54.241063 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456013f6-a50c-4ffc-bfa3-1362b5a63edf None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:16:54.241063 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456013f6-a50c-4ffc-bfa3-1362b5a63edf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:16:54.257954 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-456013f6-a50c-4ffc-bfa3-1362b5a63edf None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:16:54.259108 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-456013f6-a50c-4ffc-bfa3-1362b5a63edf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:16:54.267165 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 757/1494] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:16:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:16:54.276089 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795c37da-cfaf-49fd-af91-ce9015f58dfb None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:16:54.276603 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795c37da-cfaf-49fd-af91-ce9015f58dfb None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:16:54.276710 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795c37da-cfaf-49fd-af91-ce9015f58dfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:16:54.294378 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-795c37da-cfaf-49fd-af91-ce9015f58dfb None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:16:54.295542 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-795c37da-cfaf-49fd-af91-ce9015f58dfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:16:54.303217 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 738/1495] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:16:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:16:54.307521 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456013f6-a50c-4ffc-bfa3-1362b5a63edf None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:16:54.316666 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456013f6-a50c-4ffc-bfa3-1362b5a63edf None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:16:54.321063 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ca36d0-1c71-4a36-994d-7f5fbf57d852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:16:54.321683 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ca36d0-1c71-4a36-994d-7f5fbf57d852 admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:16:54.321959 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ca36d0-1c71-4a36-994d-7f5fbf57d852 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:16:54.322226 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ca36d0-1c71-4a36-994d-7f5fbf57d852 admin admin] PATH_INFO: `/v3/domains` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:16:54.322930 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ca36d0-1c71-4a36-994d-7f5fbf57d852 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:16:54.323227 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ca36d0-1c71-4a36-994d-7f5fbf57d852 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:16:54.324221 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: WARNING py.warnings [None req-64ca36d0-1c71-4a36-994d-7f5fbf57d852 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 19:16:54.324221 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: warnings.warn(msg) May 10 19:16:54.324221 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: May 10 19:16:54.325132 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ca36d0-1c71-4a36-994d-7f5fbf57d852 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:16:54.336733 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 758/1496] 10.222.0.70 () {58 vars in 1152 bytes} [Tue May 10 19:16:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:16:54.344646 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795c37da-cfaf-49fd-af91-ce9015f58dfb None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:16:54.353507 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795c37da-cfaf-49fd-af91-ce9015f58dfb None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:16:54.358429 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd9ad78-cb9c-47f2-aaa4-9d682b9c6d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:16:54.359086 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd9ad78-cb9c-47f2-aaa4-9d682b9c6d5c admin admin] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:16:54.359368 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd9ad78-cb9c-47f2-aaa4-9d682b9c6d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:16:54.359641 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd9ad78-cb9c-47f2-aaa4-9d682b9c6d5c admin admin] PATH_INFO: `/v3/projects` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:16:54.360327 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd9ad78-cb9c-47f2-aaa4-9d682b9c6d5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:16:54.362096 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: WARNING py.warnings [None req-8fd9ad78-cb9c-47f2-aaa4-9d682b9c6d5c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 10 19:16:54.362096 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: warnings.warn(msg) May 10 19:16:54.362096 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: May 10 19:16:54.363272 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd9ad78-cb9c-47f2-aaa4-9d682b9c6d5c admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:16:54.397285 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 739/1497] 10.222.0.70 () {60 vars in 1152 bytes} [Tue May 10 19:16:54 2022] POST /identity/v3/projects => generated 377 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 19:16:54.401616 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ca36d0-1c71-4a36-994d-7f5fbf57d852 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:16:54.411231 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ca36d0-1c71-4a36-994d-7f5fbf57d852 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:16:54.465438 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa2d9b9-9fdf-443a-a1bf-fcd2aee8f017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:16:54.466100 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa2d9b9-9fdf-443a-a1bf-fcd2aee8f017 admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:16:54.466386 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa2d9b9-9fdf-443a-a1bf-fcd2aee8f017 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:16:54.466664 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa2d9b9-9fdf-443a-a1bf-fcd2aee8f017 admin admin] PATH_INFO: `/v3/users` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:16:54.467342 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa2d9b9-9fdf-443a-a1bf-fcd2aee8f017 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:16:54.468355 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: WARNING py.warnings [None req-4fa2d9b9-9fdf-443a-a1bf-fcd2aee8f017 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 10 19:16:54.468355 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: warnings.warn(msg) May 10 19:16:54.468355 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: May 10 19:16:54.469574 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa2d9b9-9fdf-443a-a1bf-fcd2aee8f017 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:16:54.488568 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 759/1498] 10.222.0.70 () {60 vars in 1143 bytes} [Tue May 10 19:16:54 2022] POST /identity/v3/users => generated 289 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:16:54.492642 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd9ad78-cb9c-47f2-aaa4-9d682b9c6d5c admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:16:54.503001 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd9ad78-cb9c-47f2-aaa4-9d682b9c6d5c admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:16:54.507410 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d05d07-d499-4334-a0b0-863a3fe81cd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:16:54.508058 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d05d07-d499-4334-a0b0-863a3fe81cd7 admin admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:16:54.508341 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d05d07-d499-4334-a0b0-863a3fe81cd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:16:54.508649 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d05d07-d499-4334-a0b0-863a3fe81cd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:16:54.509362 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d05d07-d499-4334-a0b0-863a3fe81cd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:16:54.510374 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: WARNING py.warnings [None req-27d05d07-d499-4334-a0b0-863a3fe81cd7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 19:16:54.510374 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: warnings.warn(msg) May 10 19:16:54.510374 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: May 10 19:16:54.511244 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d05d07-d499-4334-a0b0-863a3fe81cd7 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:16:54.523649 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 740/1499] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:16:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:16:54.527660 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa2d9b9-9fdf-443a-a1bf-fcd2aee8f017 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:16:54.537038 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa2d9b9-9fdf-443a-a1bf-fcd2aee8f017 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:16:54.541423 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd18cbb-cd72-4d1e-913c-9015fff65699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:16:54.542088 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd18cbb-cd72-4d1e-913c-9015fff65699 admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:16:54.542386 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd18cbb-cd72-4d1e-913c-9015fff65699 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:16:54.542638 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd18cbb-cd72-4d1e-913c-9015fff65699 admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:16:54.543440 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd18cbb-cd72-4d1e-913c-9015fff65699 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:16:54.544495 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: WARNING py.warnings [None req-1cd18cbb-cd72-4d1e-913c-9015fff65699 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 19:16:54.544495 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: warnings.warn(msg) May 10 19:16:54.544495 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: May 10 19:16:54.545915 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd18cbb-cd72-4d1e-913c-9015fff65699 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:16:54.558719 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 760/1500] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:16:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 19:16:54.563223 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d05d07-d499-4334-a0b0-863a3fe81cd7 admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:16:54.572811 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d05d07-d499-4334-a0b0-863a3fe81cd7 admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:16:54.577329 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00708b12-a51d-48ce-8165-86aec612ebd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:16:54.578463 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00708b12-a51d-48ce-8165-86aec612ebd4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:16:54.578747 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00708b12-a51d-48ce-8165-86aec612ebd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:16:54.579023 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00708b12-a51d-48ce-8165-86aec612ebd4 admin admin] PATH_INFO: `/v3/projects/579cd71f1bf14011a8f5c94ee5fccbb0/users/c04725fce9b24738aec423e32618966f/roles/5c07cf5bfbd3427db18428aa50420962` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:16:54.593647 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00708b12-a51d-48ce-8165-86aec612ebd4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=579cd71f1bf14011a8f5c94ee5fccbb0, user_id=c04725fce9b24738aec423e32618966f, role_id=5c07cf5bfbd3427db18428aa50420962)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:16:54.594720 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: WARNING py.warnings [None req-00708b12-a51d-48ce-8165-86aec612ebd4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 10 19:16:54.594720 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: warnings.warn(msg) May 10 19:16:54.594720 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: May 10 19:16:54.596666 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00708b12-a51d-48ce-8165-86aec612ebd4 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:16:54.609883 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 741/1501] 10.222.0.70 () {60 vars in 1482 bytes} [Tue May 10 19:16:54 2022] PUT /identity/v3/projects/579cd71f1bf14011a8f5c94ee5fccbb0/users/c04725fce9b24738aec423e32618966f/roles/5c07cf5bfbd3427db18428aa50420962 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 19:16:54.621759 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cae96ac-c846-4849-9004-f33691000871 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:16:54.622093 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cae96ac-c846-4849-9004-f33691000871 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:16:54.622465 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cae96ac-c846-4849-9004-f33691000871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:16:54.648906 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-4cae96ac-c846-4849-9004-f33691000871 None None] MFA Rules not processed for user `c04725fce9b24738aec423e32618966f`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:16:54.650097 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-4cae96ac-c846-4849-9004-f33691000871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:16:54.711047 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 761/1502] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:16:54 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:16:54.726339 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a91759-29db-48b8-96d5-d39457ccd468 None None] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:16:54.726632 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a91759-29db-48b8-96d5-d39457ccd468 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:16:54.726914 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a91759-29db-48b8-96d5-d39457ccd468 None None] PATH_INFO: `/` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:16:54.728318 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 742/1503] 10.222.0.70 () {54 vars in 963 bytes} [Tue May 10 19:16:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:16:54.734038 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39ce07c-2278-448e-98a9-5b839a9339f1 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:16:54.734330 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39ce07c-2278-448e-98a9-5b839a9339f1 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:16:54.734608 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39ce07c-2278-448e-98a9-5b839a9339f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:16:54.752027 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-d39ce07c-2278-448e-98a9-5b839a9339f1 None None] MFA Rules not processed for user `15df2a8967aa43299c10e365f4200d37`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:16:54.753216 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-d39ce07c-2278-448e-98a9-5b839a9339f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:16:54.800758 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 762/1504] 10.222.0.70 () {58 vars in 1060 bytes} [Tue May 10 19:16:54 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:16:54.808067 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a91759-29db-48b8-96d5-d39457ccd468 None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:16:54.818423 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a91759-29db-48b8-96d5-d39457ccd468 None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:16:54.821990 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85aa97ff-8f34-4301-90bc-965fa91f2a3c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15df2a8967aa43299c10e365f4200d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:16:54.822613 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aa97ff-8f34-4301-90bc-965fa91f2a3c service cinder] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:16:54.822896 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aa97ff-8f34-4301-90bc-965fa91f2a3c service cinder] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:16:54.823170 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aa97ff-8f34-4301-90bc-965fa91f2a3c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:16:54.831328 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85aa97ff-8f34-4301-90bc-965fa91f2a3c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:16:54.832793 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85aa97ff-8f34-4301-90bc-965fa91f2a3c service cinder] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:16:54.841424 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 743/1505] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:16:54 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 19:16:54.883299 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125e3ad0-e8c1-4abf-967b-e59cdf21bf6c None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:16:54.883589 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125e3ad0-e8c1-4abf-967b-e59cdf21bf6c None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:16:54.883863 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125e3ad0-e8c1-4abf-967b-e59cdf21bf6c None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:16:54.885167 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 763/1506] 10.222.0.70 () {52 vars in 829 bytes} [Tue May 10 19:16:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:16:54.888699 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85aa97ff-8f34-4301-90bc-965fa91f2a3c service cinder] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:16:54.946934 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85aa97ff-8f34-4301-90bc-965fa91f2a3c service cinder] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:16:54.952193 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a956c4-a4cd-4b43-ac29-549f475b5d6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:16:54.955329 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a956c4-a4cd-4b43-ac29-549f475b5d6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:16:54.955329 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a956c4-a4cd-4b43-ac29-549f475b5d6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:16:54.955329 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a956c4-a4cd-4b43-ac29-549f475b5d6e admin admin] PATH_INFO: `/v3/users/c04725fce9b24738aec423e32618966f` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:16:54.956826 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a956c4-a4cd-4b43-ac29-549f475b5d6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c04725fce9b24738aec423e32618966f)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:16:54.958707 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: WARNING py.warnings [None req-c0a956c4-a4cd-4b43-ac29-549f475b5d6e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 10 19:16:54.958707 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: warnings.warn(msg) May 10 19:16:54.958707 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: May 10 19:16:54.959784 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a956c4-a4cd-4b43-ac29-549f475b5d6e admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:16:55.022420 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-c0a956c4-a4cd-4b43-ac29-549f475b5d6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c04725fce9b24738aec423e32618966f'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:16:55.040121 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-c0a956c4-a4cd-4b43-ac29-549f475b5d6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c04725fce9b24738aec423e32618966f'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:16:55.051683 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-c0a956c4-a4cd-4b43-ac29-549f475b5d6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c04725fce9b24738aec423e32618966f'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:16:55.052467 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-c0a956c4-a4cd-4b43-ac29-549f475b5d6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c04725fce9b24738aec423e32618966f'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:16:55.061824 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-c0a956c4-a4cd-4b43-ac29-549f475b5d6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c04725fce9b24738aec423e32618966f'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:16:55.067929 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 744/1507] 10.222.0.70 () {58 vars in 1223 bytes} [Tue May 10 19:16:54 2022] DELETE /identity/v3/users/c04725fce9b24738aec423e32618966f => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 19:16:55.072495 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b897f2-5c6d-4e41-a6c1-b804cad0b678 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:16:55.072789 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b897f2-5c6d-4e41-a6c1-b804cad0b678 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:16:55.073061 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b897f2-5c6d-4e41-a6c1-b804cad0b678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:16:55.090443 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-96b897f2-5c6d-4e41-a6c1-b804cad0b678 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:16:55.091617 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-96b897f2-5c6d-4e41-a6c1-b804cad0b678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:16:55.146645 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 764/1508] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:16:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:16:55.156691 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a956c4-a4cd-4b43-ac29-549f475b5d6e admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:16:55.158108 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-c0a956c4-a4cd-4b43-ac29-549f475b5d6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:16:55.214942 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a956c4-a4cd-4b43-ac29-549f475b5d6e admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:16:55.219105 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28cfe9a-338f-4af1-9a10-13333ae45adb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f1dc79540b48c0866478cc48cd8205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:16:55.219751 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28cfe9a-338f-4af1-9a10-13333ae45adb service neutron] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:16:55.220037 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28cfe9a-338f-4af1-9a10-13333ae45adb service neutron] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:16:55.220314 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28cfe9a-338f-4af1-9a10-13333ae45adb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:16:55.229171 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28cfe9a-338f-4af1-9a10-13333ae45adb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:16:55.230660 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28cfe9a-338f-4af1-9a10-13333ae45adb service neutron] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:16:55.239898 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 745/1509] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:16:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:16:55.560952 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b897f2-5c6d-4e41-a6c1-b804cad0b678 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:16:55.563108 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-96b897f2-5c6d-4e41-a6c1-b804cad0b678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:16:55.575089 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b897f2-5c6d-4e41-a6c1-b804cad0b678 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:16:55.580473 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2269da-9f23-4b79-9bb5-2fd3457b9aa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:16:55.581304 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2269da-9f23-4b79-9bb5-2fd3457b9aa5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:16:55.581583 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2269da-9f23-4b79-9bb5-2fd3457b9aa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:16:55.581856 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2269da-9f23-4b79-9bb5-2fd3457b9aa5 admin admin] PATH_INFO: `/v3/projects/579cd71f1bf14011a8f5c94ee5fccbb0` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:16:55.583049 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2269da-9f23-4b79-9bb5-2fd3457b9aa5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=579cd71f1bf14011a8f5c94ee5fccbb0)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:16:55.584063 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: WARNING py.warnings [None req-eb2269da-9f23-4b79-9bb5-2fd3457b9aa5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 10 19:16:55.584063 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: warnings.warn(msg) May 10 19:16:55.584063 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: May 10 19:16:55.585291 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2269da-9f23-4b79-9bb5-2fd3457b9aa5 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:16:55.643508 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-eb2269da-9f23-4b79-9bb5-2fd3457b9aa5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '579cd71f1bf14011a8f5c94ee5fccbb0', 'request_id': 'req-eb2269da-9f23-4b79-9bb5-2fd3457b9aa5'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:16:55.649231 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-eb2269da-9f23-4b79-9bb5-2fd3457b9aa5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '579cd71f1bf14011a8f5c94ee5fccbb0', 'request_id': 'req-eb2269da-9f23-4b79-9bb5-2fd3457b9aa5'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:16:55.658901 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-eb2269da-9f23-4b79-9bb5-2fd3457b9aa5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '579cd71f1bf14011a8f5c94ee5fccbb0', 'request_id': 'req-eb2269da-9f23-4b79-9bb5-2fd3457b9aa5'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:16:55.676403 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-eb2269da-9f23-4b79-9bb5-2fd3457b9aa5 admin admin] The token cache is being invalidate because project 579cd71f1bf14011a8f5c94ee5fccbb0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79994) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:16:55.676718 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-eb2269da-9f23-4b79-9bb5-2fd3457b9aa5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:16:55.677337 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-eb2269da-9f23-4b79-9bb5-2fd3457b9aa5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:16:55.678945 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 765/1510] 10.222.0.70 () {58 vars in 1232 bytes} [Tue May 10 19:16:55 2022] DELETE /identity/v3/projects/579cd71f1bf14011a8f5c94ee5fccbb0 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 19:18:40.958423 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b396fb02-c7e7-4ff9-ad13-798ae1b579f4 None None] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:18:40.958912 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b396fb02-c7e7-4ff9-ad13-798ae1b579f4 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:18:40.959017 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b396fb02-c7e7-4ff9-ad13-798ae1b579f4 None None] PATH_INFO: `/` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:18:40.960346 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 746/1511] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 10 19:18:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:18:40.965131 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad02376-e9fa-4493-b5a2-850ed6042a10 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:18:40.965613 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad02376-e9fa-4493-b5a2-850ed6042a10 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:18:40.965719 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad02376-e9fa-4493-b5a2-850ed6042a10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:18:40.984940 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-bad02376-e9fa-4493-b5a2-850ed6042a10 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:18:40.986278 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-bad02376-e9fa-4493-b5a2-850ed6042a10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:18:41.045066 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 766/1512] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 10 19:18:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:18:41.061305 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a596c078-b31d-4aff-b511-c89282ef8ab9 None None] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:18:41.061592 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a596c078-b31d-4aff-b511-c89282ef8ab9 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:18:41.061870 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a596c078-b31d-4aff-b511-c89282ef8ab9 None None] PATH_INFO: `/v3` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:18:41.063130 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 747/1513] 10.222.0.73 () {54 vars in 925 bytes} [Tue May 10 19:18:41 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:18:41.069145 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cb10c3-a654-4973-a8de-4152a11a3502 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:18:41.069436 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cb10c3-a654-4973-a8de-4152a11a3502 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:18:41.069712 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cb10c3-a654-4973-a8de-4152a11a3502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:18:41.092738 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-10cb10c3-a654-4973-a8de-4152a11a3502 None None] MFA Rules not processed for user `11b95d3824f34cfcada6915ee57a7e08`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:18:41.093944 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-10cb10c3-a654-4973-a8de-4152a11a3502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:18:41.166874 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 767/1514] 10.222.0.73 () {58 vars in 1015 bytes} [Tue May 10 19:18:41 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:18:41.218693 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a596c078-b31d-4aff-b511-c89282ef8ab9 None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:18:41.220267 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-a596c078-b31d-4aff-b511-c89282ef8ab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:18:41.295276 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a596c078-b31d-4aff-b511-c89282ef8ab9 None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:18:41.300664 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888f4426-ae0a-4232-9ace-2c86fc4c7ca7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9f310a468ec4058b3c95356ea60ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:18:41.301309 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888f4426-ae0a-4232-9ace-2c86fc4c7ca7 service nova] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:18:41.301594 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888f4426-ae0a-4232-9ace-2c86fc4c7ca7 service nova] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:18:41.301870 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888f4426-ae0a-4232-9ace-2c86fc4c7ca7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:18:41.309742 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888f4426-ae0a-4232-9ace-2c86fc4c7ca7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:18:41.311841 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888f4426-ae0a-4232-9ace-2c86fc4c7ca7 service nova] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:18:41.320963 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 748/1515] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:18:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 19:18:42.224350 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b473d0-8bd8-4434-8818-15e148fdd680 None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:18:42.224934 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b473d0-8bd8-4434-8818-15e148fdd680 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:18:42.224934 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b473d0-8bd8-4434-8818-15e148fdd680 None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:18:42.226221 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 768/1516] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 10 19:18:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:18:42.231035 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff93644-1a87-4659-aaae-8a1a3ed50bc2 None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:18:42.231478 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff93644-1a87-4659-aaae-8a1a3ed50bc2 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:18:42.231618 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff93644-1a87-4659-aaae-8a1a3ed50bc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:18:42.249089 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-7ff93644-1a87-4659-aaae-8a1a3ed50bc2 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:18:42.250271 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-7ff93644-1a87-4659-aaae-8a1a3ed50bc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:18:42.258200 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 749/1517] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 10 19:18:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:18:42.407711 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b473d0-8bd8-4434-8818-15e148fdd680 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:18:42.421443 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b473d0-8bd8-4434-8818-15e148fdd680 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:18:42.426615 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4810c5-e18d-41f0-8764-d38d56809004 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9f310a468ec4058b3c95356ea60ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:18:42.427241 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4810c5-e18d-41f0-8764-d38d56809004 service nova] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:18:42.427520 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4810c5-e18d-41f0-8764-d38d56809004 service nova] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:18:42.427791 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4810c5-e18d-41f0-8764-d38d56809004 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:18:42.435527 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4810c5-e18d-41f0-8764-d38d56809004 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:18:42.437149 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4810c5-e18d-41f0-8764-d38d56809004 service nova] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:18:42.446089 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 769/1518] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:18:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:18:44.945488 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f47a3ff-e6be-48e9-9588-e49d535e3b22 None None] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:18:44.946026 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f47a3ff-e6be-48e9-9588-e49d535e3b22 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:18:44.946173 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f47a3ff-e6be-48e9-9588-e49d535e3b22 None None] PATH_INFO: `/` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:18:44.947567 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 750/1519] 10.222.0.70 () {54 vars in 960 bytes} [Tue May 10 19:18:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:18:44.952935 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f902ae-d946-4741-b09f-1a3cc7a5b941 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:18:44.953357 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f902ae-d946-4741-b09f-1a3cc7a5b941 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:18:44.953484 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f902ae-d946-4741-b09f-1a3cc7a5b941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:18:44.971286 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-91f902ae-d946-4741-b09f-1a3cc7a5b941 None None] MFA Rules not processed for user `11b95d3824f34cfcada6915ee57a7e08`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:18:44.972476 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-91f902ae-d946-4741-b09f-1a3cc7a5b941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:18:44.980700 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 770/1520] 10.222.0.70 () {58 vars in 1057 bytes} [Tue May 10 19:18:44 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:18:44.989900 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f47a3ff-e6be-48e9-9588-e49d535e3b22 None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:18:45.002734 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f47a3ff-e6be-48e9-9588-e49d535e3b22 None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:18:45.007540 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014e1444-2b7b-4f03-a9c0-4857f84b35c0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b95d3824f34cfcada6915ee57a7e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:18:45.008165 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014e1444-2b7b-4f03-a9c0-4857f84b35c0 service placement] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:18:45.008472 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014e1444-2b7b-4f03-a9c0-4857f84b35c0 service placement] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:18:45.008750 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014e1444-2b7b-4f03-a9c0-4857f84b35c0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:18:45.016590 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014e1444-2b7b-4f03-a9c0-4857f84b35c0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:18:45.018173 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014e1444-2b7b-4f03-a9c0-4857f84b35c0 service placement] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:18:45.027291 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 751/1521] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:18:44 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:18:53.742938 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8e939f-0039-4c29-b427-4ea38e596ba7 None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:18:53.743514 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8e939f-0039-4c29-b427-4ea38e596ba7 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:18:53.743514 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8e939f-0039-4c29-b427-4ea38e596ba7 None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:18:53.744942 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 771/1522] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 10 19:18:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:18:53.749808 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d60f0c4-d5d5-4455-80c9-9a063cf607e4 None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:18:53.750229 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d60f0c4-d5d5-4455-80c9-9a063cf607e4 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:18:53.750873 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d60f0c4-d5d5-4455-80c9-9a063cf607e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:18:53.768831 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-2d60f0c4-d5d5-4455-80c9-9a063cf607e4 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:18:53.770000 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-2d60f0c4-d5d5-4455-80c9-9a063cf607e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:18:53.777516 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 752/1523] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 10 19:18:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:18:53.927218 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8e939f-0039-4c29-b427-4ea38e596ba7 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:18:53.941741 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8e939f-0039-4c29-b427-4ea38e596ba7 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:18:53.947122 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eba35c0-106a-4d22-9d73-94136b753496 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9f310a468ec4058b3c95356ea60ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:18:53.947759 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eba35c0-106a-4d22-9d73-94136b753496 service nova] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:18:53.948045 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eba35c0-106a-4d22-9d73-94136b753496 service nova] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:18:53.948321 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eba35c0-106a-4d22-9d73-94136b753496 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:18:53.957550 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eba35c0-106a-4d22-9d73-94136b753496 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:18:53.959149 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eba35c0-106a-4d22-9d73-94136b753496 service nova] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:18:53.968395 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 772/1524] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:18:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:18:54.852090 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2d263a-beac-4b56-a0bf-fc267dbb86a6 None None] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:18:54.852695 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2d263a-beac-4b56-a0bf-fc267dbb86a6 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:18:54.852695 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2d263a-beac-4b56-a0bf-fc267dbb86a6 None None] PATH_INFO: `/` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:18:54.854017 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 753/1525] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 10 19:18:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:18:54.858756 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed80f8a-c2f3-40b2-8326-73f3d03abd2e None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:18:54.859139 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed80f8a-c2f3-40b2-8326-73f3d03abd2e None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:18:54.859317 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed80f8a-c2f3-40b2-8326-73f3d03abd2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:18:54.876787 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-8ed80f8a-c2f3-40b2-8326-73f3d03abd2e None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:18:54.877967 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-8ed80f8a-c2f3-40b2-8326-73f3d03abd2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:18:54.885559 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 773/1526] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 10 19:18:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:18:55.035979 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2d263a-beac-4b56-a0bf-fc267dbb86a6 None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:18:55.049714 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2d263a-beac-4b56-a0bf-fc267dbb86a6 None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:18:55.054969 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54022644-c106-4445-be7f-69d5d6e9280c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9f310a468ec4058b3c95356ea60ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:18:55.055597 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54022644-c106-4445-be7f-69d5d6e9280c service nova] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:18:55.055881 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54022644-c106-4445-be7f-69d5d6e9280c service nova] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:18:55.056154 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54022644-c106-4445-be7f-69d5d6e9280c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:18:55.063975 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54022644-c106-4445-be7f-69d5d6e9280c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:18:55.065598 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54022644-c106-4445-be7f-69d5d6e9280c service nova] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:18:55.074822 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 754/1527] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:18:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:18:59.429856 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aac4bd-bdaa-4f87-a19c-6a3711cdd5f3 None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:18:59.430357 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aac4bd-bdaa-4f87-a19c-6a3711cdd5f3 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:18:59.430465 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aac4bd-bdaa-4f87-a19c-6a3711cdd5f3 None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:18:59.431757 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 774/1528] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 19:18:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:18:59.436919 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba59391-86bb-421b-b924-27cf304535c7 None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:18:59.437367 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba59391-86bb-421b-b924-27cf304535c7 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:18:59.437487 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba59391-86bb-421b-b924-27cf304535c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:18:59.455391 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-0ba59391-86bb-421b-b924-27cf304535c7 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:18:59.456590 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-0ba59391-86bb-421b-b924-27cf304535c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:18:59.464139 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 755/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 19:18:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:18:59.499464 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aac4bd-bdaa-4f87-a19c-6a3711cdd5f3 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:18:59.501278 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-07aac4bd-bdaa-4f87-a19c-6a3711cdd5f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:18:59.555469 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aac4bd-bdaa-4f87-a19c-6a3711cdd5f3 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:18:59.559013 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96192e62-fe9b-4477-9399-5528a67e9efc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f1dc79540b48c0866478cc48cd8205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:18:59.559651 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96192e62-fe9b-4477-9399-5528a67e9efc service neutron] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:18:59.559934 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96192e62-fe9b-4477-9399-5528a67e9efc service neutron] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:18:59.560207 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96192e62-fe9b-4477-9399-5528a67e9efc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:18:59.568823 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96192e62-fe9b-4477-9399-5528a67e9efc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:18:59.570256 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96192e62-fe9b-4477-9399-5528a67e9efc service neutron] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:18:59.580053 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 775/1530] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:18:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:19:01.775473 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb6f84e-7120-49c2-a1aa-41c6731818c6 None None] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:19:01.775980 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb6f84e-7120-49c2-a1aa-41c6731818c6 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:19:01.776107 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb6f84e-7120-49c2-a1aa-41c6731818c6 None None] PATH_INFO: `/` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:19:01.777421 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 756/1531] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 19:19:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:19:01.783275 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e3c0c7-dfba-48fb-94a1-3a8c7e52f89e None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:19:01.783686 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e3c0c7-dfba-48fb-94a1-3a8c7e52f89e None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:19:01.783836 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e3c0c7-dfba-48fb-94a1-3a8c7e52f89e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:19:01.801302 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-45e3c0c7-dfba-48fb-94a1-3a8c7e52f89e None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:19:01.802508 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-45e3c0c7-dfba-48fb-94a1-3a8c7e52f89e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:19:01.810217 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 776/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 19:19:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:19:01.845889 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb6f84e-7120-49c2-a1aa-41c6731818c6 None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:19:01.856334 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb6f84e-7120-49c2-a1aa-41c6731818c6 None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:19:01.859929 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfad46be-3f16-4482-b13b-6c4db7aad97c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f1dc79540b48c0866478cc48cd8205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:19:01.860594 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfad46be-3f16-4482-b13b-6c4db7aad97c service neutron] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:19:01.860883 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfad46be-3f16-4482-b13b-6c4db7aad97c service neutron] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:19:01.861223 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfad46be-3f16-4482-b13b-6c4db7aad97c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:19:01.870175 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfad46be-3f16-4482-b13b-6c4db7aad97c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:19:01.871616 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfad46be-3f16-4482-b13b-6c4db7aad97c service neutron] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:19:01.881277 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 757/1533] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:19:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:19:05.714407 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedb7687-c45b-48a6-97fa-e42a10613a79 None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:19:05.714925 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedb7687-c45b-48a6-97fa-e42a10613a79 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:19:05.715047 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedb7687-c45b-48a6-97fa-e42a10613a79 None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:19:05.716302 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 777/1534] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 19:19:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:19:05.722169 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670e8f74-2e2c-4341-8ab2-e6e9c2dfeba6 None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:19:05.722608 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670e8f74-2e2c-4341-8ab2-e6e9c2dfeba6 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:19:05.722739 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670e8f74-2e2c-4341-8ab2-e6e9c2dfeba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:19:05.741279 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-670e8f74-2e2c-4341-8ab2-e6e9c2dfeba6 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:19:05.742451 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-670e8f74-2e2c-4341-8ab2-e6e9c2dfeba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:19:05.755685 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 758/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 19:19:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:19:06.026745 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedb7687-c45b-48a6-97fa-e42a10613a79 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:19:06.028388 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-dedb7687-c45b-48a6-97fa-e42a10613a79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:19:06.082986 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedb7687-c45b-48a6-97fa-e42a10613a79 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:19:06.086544 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc86c16-0dd8-46ee-a1e1-691f137e6824 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15df2a8967aa43299c10e365f4200d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:19:06.087177 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc86c16-0dd8-46ee-a1e1-691f137e6824 service cinder] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:19:06.087460 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc86c16-0dd8-46ee-a1e1-691f137e6824 service cinder] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:19:06.087733 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc86c16-0dd8-46ee-a1e1-691f137e6824 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:19:06.096950 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc86c16-0dd8-46ee-a1e1-691f137e6824 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:19:06.098364 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc86c16-0dd8-46ee-a1e1-691f137e6824 service cinder] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:19:06.107369 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 778/1536] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:19:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:19:08.382268 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ad3e7e-b1aa-4087-afb5-63d18072f0d3 None None] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:19:08.382793 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ad3e7e-b1aa-4087-afb5-63d18072f0d3 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:19:08.382793 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ad3e7e-b1aa-4087-afb5-63d18072f0d3 None None] PATH_INFO: `/` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:19:08.384096 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 759/1537] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 19:19:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:19:08.389422 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c8aca2-877f-425e-94ac-7bda01b90269 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:19:08.389870 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c8aca2-877f-425e-94ac-7bda01b90269 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:19:08.389976 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c8aca2-877f-425e-94ac-7bda01b90269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:19:08.407568 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-45c8aca2-877f-425e-94ac-7bda01b90269 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:19:08.408831 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-45c8aca2-877f-425e-94ac-7bda01b90269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:19:08.416746 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 779/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 19:19:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:19:08.688469 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ad3e7e-b1aa-4087-afb5-63d18072f0d3 None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:19:08.690145 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-52ad3e7e-b1aa-4087-afb5-63d18072f0d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:19:08.703617 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ad3e7e-b1aa-4087-afb5-63d18072f0d3 None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:19:08.707081 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2296eb89-24c0-465d-8e32-b150184e7961 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15df2a8967aa43299c10e365f4200d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:19:08.707712 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2296eb89-24c0-465d-8e32-b150184e7961 service cinder] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:19:08.708019 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2296eb89-24c0-465d-8e32-b150184e7961 service cinder] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:19:08.708297 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2296eb89-24c0-465d-8e32-b150184e7961 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:19:08.716957 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2296eb89-24c0-465d-8e32-b150184e7961 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:19:08.722100 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2296eb89-24c0-465d-8e32-b150184e7961 service cinder] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:19:08.728256 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 760/1539] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:19:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:20:40.654837 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae110e6c-c676-479f-8fc1-d839fb3adaf3 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:20:40.655516 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae110e6c-c676-479f-8fc1-d839fb3adaf3 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:20:40.655516 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae110e6c-c676-479f-8fc1-d839fb3adaf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:20:40.657487 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf08761-b1c7-4a1e-ad5f-ed2eefdf1f70 None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:20:40.658551 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf08761-b1c7-4a1e-ad5f-ed2eefdf1f70 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:20:40.659056 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf08761-b1c7-4a1e-ad5f-ed2eefdf1f70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:20:40.684498 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-faf08761-b1c7-4a1e-ad5f-ed2eefdf1f70 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:20:40.686330 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-faf08761-b1c7-4a1e-ad5f-ed2eefdf1f70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:20:40.688849 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-ae110e6c-c676-479f-8fc1-d839fb3adaf3 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:20:40.690018 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-ae110e6c-c676-479f-8fc1-d839fb3adaf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:20:40.703329 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 761/1540] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:20:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:20:40.704933 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64442d6a-8f69-4007-9f5e-2fa2860ffba0 None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:20:40.705076 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 780/1541] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:20:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:20:40.705776 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64442d6a-8f69-4007-9f5e-2fa2860ffba0 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:20:40.705776 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64442d6a-8f69-4007-9f5e-2fa2860ffba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:20:40.714442 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f19fdb-a725-4749-ac5a-9f2aae6ccf1e None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:20:40.714758 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f19fdb-a725-4749-ac5a-9f2aae6ccf1e None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:20:40.715604 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f19fdb-a725-4749-ac5a-9f2aae6ccf1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:20:40.740049 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-29f19fdb-a725-4749-ac5a-9f2aae6ccf1e None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:20:40.741266 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-29f19fdb-a725-4749-ac5a-9f2aae6ccf1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:20:40.741534 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-64442d6a-8f69-4007-9f5e-2fa2860ffba0 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:20:40.742756 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-64442d6a-8f69-4007-9f5e-2fa2860ffba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:20:40.756852 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 781/1542] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:20:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:20:40.758370 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1db7892-3416-46c1-89d2-bc6ca48bc425 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:20:40.758632 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 762/1543] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:20:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:20:40.758976 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1db7892-3416-46c1-89d2-bc6ca48bc425 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:20:40.759487 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1db7892-3416-46c1-89d2-bc6ca48bc425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:20:40.759984 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48f5a41-88a8-4482-9e55-c25d5badc8d7 None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:20:40.760275 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48f5a41-88a8-4482-9e55-c25d5badc8d7 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:20:40.760585 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48f5a41-88a8-4482-9e55-c25d5badc8d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:20:40.792679 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-c1db7892-3416-46c1-89d2-bc6ca48bc425 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:20:40.793894 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-c1db7892-3416-46c1-89d2-bc6ca48bc425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:20:40.797744 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-f48f5a41-88a8-4482-9e55-c25d5badc8d7 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:20:40.798984 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-f48f5a41-88a8-4482-9e55-c25d5badc8d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:20:40.808986 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 782/1544] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:20:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:20:40.810755 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1db7892-3416-46c1-89d2-bc6ca48bc425 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:20:40.831689 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1db7892-3416-46c1-89d2-bc6ca48bc425 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:20:40.838634 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 763/1545] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:20:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:20:40.839984 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea72246-19ac-4a4a-8f32-bd58b71e3aaa None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:20:40.840278 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea72246-19ac-4a4a-8f32-bd58b71e3aaa None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:20:40.840586 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea72246-19ac-4a4a-8f32-bd58b71e3aaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:20:40.842085 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380e5436-16b5-4800-a20f-f53d3f742ce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:20:40.842949 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380e5436-16b5-4800-a20f-f53d3f742ce2 admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:20:40.843300 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380e5436-16b5-4800-a20f-f53d3f742ce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:20:40.843493 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380e5436-16b5-4800-a20f-f53d3f742ce2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:20:40.844229 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380e5436-16b5-4800-a20f-f53d3f742ce2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:20:40.844606 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380e5436-16b5-4800-a20f-f53d3f742ce2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:20:40.846216 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380e5436-16b5-4800-a20f-f53d3f742ce2 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:20:40.871829 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 783/1546] 10.222.0.70 () {58 vars in 1152 bytes} [Tue May 10 19:20:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:20:40.872895 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380e5436-16b5-4800-a20f-f53d3f742ce2 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:20:40.886650 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380e5436-16b5-4800-a20f-f53d3f742ce2 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:20:40.891105 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-4ea72246-19ac-4a4a-8f32-bd58b71e3aaa None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:20:40.891105 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-4ea72246-19ac-4a4a-8f32-bd58b71e3aaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:20:40.910063 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b8e534-a595-4c15-8a37-bfc5503b85a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:20:40.910670 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b8e534-a595-4c15-8a37-bfc5503b85a8 admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:20:40.910990 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b8e534-a595-4c15-8a37-bfc5503b85a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:20:40.911358 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b8e534-a595-4c15-8a37-bfc5503b85a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:20:40.912096 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b8e534-a595-4c15-8a37-bfc5503b85a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:20:40.912457 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b8e534-a595-4c15-8a37-bfc5503b85a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:20:40.914631 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b8e534-a595-4c15-8a37-bfc5503b85a8 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:20:40.929849 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 764/1547] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:20:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:20:40.931179 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55faf5d8-1604-4eaa-b4cd-41622728eaed None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:20:40.931471 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55faf5d8-1604-4eaa-b4cd-41622728eaed None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:20:40.931753 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55faf5d8-1604-4eaa-b4cd-41622728eaed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:20:40.936343 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 784/1548] 10.222.0.70 () {58 vars in 1152 bytes} [Tue May 10 19:20:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:20:40.941355 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b8e534-a595-4c15-8a37-bfc5503b85a8 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:20:40.955051 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-55faf5d8-1604-4eaa-b4cd-41622728eaed None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:20:40.956510 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-55faf5d8-1604-4eaa-b4cd-41622728eaed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:20:40.960639 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b8e534-a595-4c15-8a37-bfc5503b85a8 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:20:40.966512 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab117de-d61a-45e5-9f43-3765a0dce54d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:20:40.967186 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab117de-d61a-45e5-9f43-3765a0dce54d admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:20:40.967465 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab117de-d61a-45e5-9f43-3765a0dce54d admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:20:40.967737 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab117de-d61a-45e5-9f43-3765a0dce54d admin admin] PATH_INFO: `/v3/projects` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:20:40.968484 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab117de-d61a-45e5-9f43-3765a0dce54d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:20:40.969103 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 765/1549] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:20:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:20:40.969561 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: WARNING py.warnings [None req-6ab117de-d61a-45e5-9f43-3765a0dce54d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 10 19:20:40.969561 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: warnings.warn(msg) May 10 19:20:40.969561 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: May 10 19:20:40.970697 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55faf5d8-1604-4eaa-b4cd-41622728eaed None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:20:40.970820 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab117de-d61a-45e5-9f43-3765a0dce54d admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:20:40.986171 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55faf5d8-1604-4eaa-b4cd-41622728eaed None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:20:40.992969 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31978b29-1ae1-4006-a728-0315dda56acf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:20:40.993758 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31978b29-1ae1-4006-a728-0315dda56acf admin admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:20:40.994131 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31978b29-1ae1-4006-a728-0315dda56acf admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:20:40.996657 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31978b29-1ae1-4006-a728-0315dda56acf admin admin] PATH_INFO: `/v3/domains` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:20:40.997486 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31978b29-1ae1-4006-a728-0315dda56acf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:20:40.997856 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31978b29-1ae1-4006-a728-0315dda56acf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:20:40.998939 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: WARNING py.warnings [None req-31978b29-1ae1-4006-a728-0315dda56acf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 19:20:40.998939 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: warnings.warn(msg) May 10 19:20:40.998939 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: May 10 19:20:40.999901 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31978b29-1ae1-4006-a728-0315dda56acf admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:20:41.003874 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 785/1550] 10.222.0.70 () {60 vars in 1152 bytes} [Tue May 10 19:20:40 2022] POST /identity/v3/projects => generated 385 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:20:41.005201 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b783443-e9ef-4dce-9c68-e4b900f77c35 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:20:41.005482 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b783443-e9ef-4dce-9c68-e4b900f77c35 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:20:41.005757 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b783443-e9ef-4dce-9c68-e4b900f77c35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:20:41.016783 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 766/1551] 10.222.0.70 () {58 vars in 1152 bytes} [Tue May 10 19:20:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:20:41.017826 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31978b29-1ae1-4006-a728-0315dda56acf admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:20:41.026009 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-2b783443-e9ef-4dce-9c68-e4b900f77c35 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:20:41.027460 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-2b783443-e9ef-4dce-9c68-e4b900f77c35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:20:41.027831 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31978b29-1ae1-4006-a728-0315dda56acf admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:20:41.082366 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7b81ed-33ea-4c4c-bec0-22433815d462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:20:41.083031 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7b81ed-33ea-4c4c-bec0-22433815d462 admin admin] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:20:41.083324 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7b81ed-33ea-4c4c-bec0-22433815d462 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:20:41.083480 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 786/1552] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:20:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:20:41.083584 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7b81ed-33ea-4c4c-bec0-22433815d462 admin admin] PATH_INFO: `/v3/projects` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:20:41.084277 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7b81ed-33ea-4c4c-bec0-22433815d462 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:20:41.084722 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3708ed-655c-45dd-b78f-9809f568d726 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:20:41.085007 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3708ed-655c-45dd-b78f-9809f568d726 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:20:41.085280 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3708ed-655c-45dd-b78f-9809f568d726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:20:41.086337 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7b81ed-33ea-4c4c-bec0-22433815d462 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:20:41.108572 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-6f3708ed-655c-45dd-b78f-9809f568d726 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:20:41.109811 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-6f3708ed-655c-45dd-b78f-9809f568d726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:20:41.116808 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 767/1553] 10.222.0.70 () {60 vars in 1152 bytes} [Tue May 10 19:20:41 2022] POST /identity/v3/projects => generated 381 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:20:41.117843 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7b81ed-33ea-4c4c-bec0-22433815d462 admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:20:41.117975 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 787/1554] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:20:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:20:41.118992 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8d4d36-1de7-43d9-8d75-ef1c2124ae56 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:20:41.119280 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8d4d36-1de7-43d9-8d75-ef1c2124ae56 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:20:41.119551 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8d4d36-1de7-43d9-8d75-ef1c2124ae56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:20:41.137003 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-1e8d4d36-1de7-43d9-8d75-ef1c2124ae56 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:20:41.138721 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-1e8d4d36-1de7-43d9-8d75-ef1c2124ae56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:20:41.183795 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7b81ed-33ea-4c4c-bec0-22433815d462 admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:20:41.192364 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11622cd7-36c8-453c-981f-9c1d97b358de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:20:41.193069 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11622cd7-36c8-453c-981f-9c1d97b358de admin admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:20:41.193348 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11622cd7-36c8-453c-981f-9c1d97b358de admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:20:41.193629 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11622cd7-36c8-453c-981f-9c1d97b358de admin admin] PATH_INFO: `/v3/domains` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:20:41.194312 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 788/1555] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:20:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:20:41.194465 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11622cd7-36c8-453c-981f-9c1d97b358de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:20:41.194644 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11622cd7-36c8-453c-981f-9c1d97b358de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:20:41.195125 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8d4d36-1de7-43d9-8d75-ef1c2124ae56 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:20:41.196256 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11622cd7-36c8-453c-981f-9c1d97b358de admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:20:41.205562 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8d4d36-1de7-43d9-8d75-ef1c2124ae56 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:20:41.209234 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 768/1556] 10.222.0.70 () {58 vars in 1152 bytes} [Tue May 10 19:20:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:20:41.210220 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74422356-8508-4f8e-b8ee-6b8590ebd372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:20:41.210459 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1010042-8a61-4378-ae2c-a6708a3d0147 None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:20:41.210828 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1010042-8a61-4378-ae2c-a6708a3d0147 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:20:41.210968 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74422356-8508-4f8e-b8ee-6b8590ebd372 admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:20:41.211203 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74422356-8508-4f8e-b8ee-6b8590ebd372 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:20:41.211316 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1010042-8a61-4378-ae2c-a6708a3d0147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:20:41.211483 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74422356-8508-4f8e-b8ee-6b8590ebd372 admin admin] PATH_INFO: `/v3/users` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:20:41.212209 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74422356-8508-4f8e-b8ee-6b8590ebd372 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:20:41.214176 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74422356-8508-4f8e-b8ee-6b8590ebd372 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:20:41.229923 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-d1010042-8a61-4378-ae2c-a6708a3d0147 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:20:41.231117 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-d1010042-8a61-4378-ae2c-a6708a3d0147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:20:41.234609 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 789/1557] 10.222.0.70 () {60 vars in 1143 bytes} [Tue May 10 19:20:41 2022] POST /identity/v3/users => generated 293 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:20:41.235383 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74422356-8508-4f8e-b8ee-6b8590ebd372 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:20:41.241378 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 769/1558] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:20:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:20:41.242552 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efe3cf1-cae6-445a-a92a-b6b44f219fda None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:20:41.242840 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efe3cf1-cae6-445a-a92a-b6b44f219fda None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:20:41.243113 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efe3cf1-cae6-445a-a92a-b6b44f219fda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:20:41.252145 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74422356-8508-4f8e-b8ee-6b8590ebd372 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:20:41.257121 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe17900a-0499-4b68-a670-f88853cf0193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:20:41.257770 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe17900a-0499-4b68-a670-f88853cf0193 admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:20:41.258073 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe17900a-0499-4b68-a670-f88853cf0193 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:20:41.258357 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe17900a-0499-4b68-a670-f88853cf0193 admin admin] PATH_INFO: `/v3/projects` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:20:41.259023 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe17900a-0499-4b68-a670-f88853cf0193 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:20:41.260944 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe17900a-0499-4b68-a670-f88853cf0193 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:20:41.261365 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-9efe3cf1-cae6-445a-a92a-b6b44f219fda None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:20:41.262521 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-9efe3cf1-cae6-445a-a92a-b6b44f219fda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:20:41.271217 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 770/1559] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:20:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:20:41.275090 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efe3cf1-cae6-445a-a92a-b6b44f219fda None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:20:41.281853 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efe3cf1-cae6-445a-a92a-b6b44f219fda None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:20:41.286685 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89de6b6e-de45-495f-b0b1-ab0bc3ec5315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:20:41.287262 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 790/1560] 10.222.0.70 () {60 vars in 1152 bytes} [Tue May 10 19:20:41 2022] POST /identity/v3/projects => generated 365 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:20:41.287398 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89de6b6e-de45-495f-b0b1-ab0bc3ec5315 admin admin] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:20:41.287613 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89de6b6e-de45-495f-b0b1-ab0bc3ec5315 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:20:41.287890 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89de6b6e-de45-495f-b0b1-ab0bc3ec5315 admin admin] PATH_INFO: `/v3/users` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:20:41.288402 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da08094f-fdee-4a61-b75c-6b5badaddb38 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:20:41.288613 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89de6b6e-de45-495f-b0b1-ab0bc3ec5315 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:20:41.288724 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da08094f-fdee-4a61-b75c-6b5badaddb38 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:20:41.288983 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da08094f-fdee-4a61-b75c-6b5badaddb38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:20:41.289668 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: WARNING py.warnings [None req-89de6b6e-de45-495f-b0b1-ab0bc3ec5315 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 10 19:20:41.289668 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: warnings.warn(msg) May 10 19:20:41.289668 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: May 10 19:20:41.290867 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89de6b6e-de45-495f-b0b1-ab0bc3ec5315 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:20:41.307193 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-da08094f-fdee-4a61-b75c-6b5badaddb38 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:20:41.308389 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-da08094f-fdee-4a61-b75c-6b5badaddb38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:20:41.314962 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 771/1561] 10.222.0.70 () {60 vars in 1143 bytes} [Tue May 10 19:20:41 2022] POST /identity/v3/users => generated 291 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:20:41.314962 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15b015a-bf02-4966-9bc0-8a0a5b81bbde None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:20:41.314962 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15b015a-bf02-4966-9bc0-8a0a5b81bbde None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:20:41.314962 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15b015a-bf02-4966-9bc0-8a0a5b81bbde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:20:41.331833 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-b15b015a-bf02-4966-9bc0-8a0a5b81bbde None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:20:41.333128 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-b15b015a-bf02-4966-9bc0-8a0a5b81bbde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:20:41.365557 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 791/1562] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:20:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:20:41.366431 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da08094f-fdee-4a61-b75c-6b5badaddb38 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:20:41.375813 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da08094f-fdee-4a61-b75c-6b5badaddb38 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:20:41.380223 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523f7db3-4a7b-4d68-b1a7-5e8797b31ad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:20:41.381425 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523f7db3-4a7b-4d68-b1a7-5e8797b31ad8 admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:20:41.381425 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523f7db3-4a7b-4d68-b1a7-5e8797b31ad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:20:41.382498 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523f7db3-4a7b-4d68-b1a7-5e8797b31ad8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:20:41.383177 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523f7db3-4a7b-4d68-b1a7-5e8797b31ad8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:20:41.385111 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523f7db3-4a7b-4d68-b1a7-5e8797b31ad8 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:20:41.390360 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 772/1563] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:20:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:20:41.391435 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15b015a-bf02-4966-9bc0-8a0a5b81bbde None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:20:41.400796 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15b015a-bf02-4966-9bc0-8a0a5b81bbde None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:20:41.405594 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8042c0d2-8ea1-49e2-83a9-5e6fdc15817d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:20:41.406239 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8042c0d2-8ea1-49e2-83a9-5e6fdc15817d admin admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:20:41.406665 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8042c0d2-8ea1-49e2-83a9-5e6fdc15817d admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:20:41.406851 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8042c0d2-8ea1-49e2-83a9-5e6fdc15817d admin admin] PATH_INFO: `/v3/roles` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:20:41.407643 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8042c0d2-8ea1-49e2-83a9-5e6fdc15817d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:20:41.409292 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8042c0d2-8ea1-49e2-83a9-5e6fdc15817d admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:20:41.412136 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 792/1564] 10.222.0.70 () {60 vars in 1152 bytes} [Tue May 10 19:20:41 2022] POST /identity/v3/projects => generated 377 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:20:41.413484 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2005efb0-6631-4d8d-b2dd-a97bcab7543a None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:20:41.413777 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2005efb0-6631-4d8d-b2dd-a97bcab7543a None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:20:41.414057 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2005efb0-6631-4d8d-b2dd-a97bcab7543a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:20:41.420410 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 773/1565] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:20:41 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:20:41.421501 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8042c0d2-8ea1-49e2-83a9-5e6fdc15817d admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:20:41.431069 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-2005efb0-6631-4d8d-b2dd-a97bcab7543a None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:20:41.431888 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8042c0d2-8ea1-49e2-83a9-5e6fdc15817d admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:20:41.432264 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-2005efb0-6631-4d8d-b2dd-a97bcab7543a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:20:41.485828 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494ff87b-c52f-4c21-9c7c-bc9a8fdf7534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:20:41.486492 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494ff87b-c52f-4c21-9c7c-bc9a8fdf7534 admin admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:20:41.486910 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494ff87b-c52f-4c21-9c7c-bc9a8fdf7534 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:20:41.487139 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494ff87b-c52f-4c21-9c7c-bc9a8fdf7534 admin admin] PATH_INFO: `/v3/domains` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:20:41.487846 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494ff87b-c52f-4c21-9c7c-bc9a8fdf7534 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:20:41.488147 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494ff87b-c52f-4c21-9c7c-bc9a8fdf7534 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:20:41.489698 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 793/1566] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:20:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:20:41.489825 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494ff87b-c52f-4c21-9c7c-bc9a8fdf7534 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:20:41.493344 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2005efb0-6631-4d8d-b2dd-a97bcab7543a None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:20:41.502860 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2005efb0-6631-4d8d-b2dd-a97bcab7543a None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:20:41.503013 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 774/1567] 10.222.0.70 () {58 vars in 1152 bytes} [Tue May 10 19:20:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:20:41.503735 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494ff87b-c52f-4c21-9c7c-bc9a8fdf7534 admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:20:41.507435 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7180cdc-2a18-4927-bbd3-2c98e0044b0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:20:41.508096 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7180cdc-2a18-4927-bbd3-2c98e0044b0e admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:20:41.508408 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7180cdc-2a18-4927-bbd3-2c98e0044b0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:20:41.508690 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7180cdc-2a18-4927-bbd3-2c98e0044b0e admin admin] PATH_INFO: `/v3/users` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:20:41.509849 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7180cdc-2a18-4927-bbd3-2c98e0044b0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:20:41.511359 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7180cdc-2a18-4927-bbd3-2c98e0044b0e admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:20:41.513018 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494ff87b-c52f-4c21-9c7c-bc9a8fdf7534 admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:20:41.517816 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61043224-b8e0-492f-87ac-8ce09bed01cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:20:41.518474 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61043224-b8e0-492f-87ac-8ce09bed01cd admin admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:20:41.518738 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61043224-b8e0-492f-87ac-8ce09bed01cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:20:41.519168 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61043224-b8e0-492f-87ac-8ce09bed01cd admin admin] PATH_INFO: `/v3/roles` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:20:41.519885 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61043224-b8e0-492f-87ac-8ce09bed01cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:20:41.521501 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61043224-b8e0-492f-87ac-8ce09bed01cd admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:20:41.533389 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 775/1568] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:20:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:20:41.534360 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61043224-b8e0-492f-87ac-8ce09bed01cd admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:20:41.535455 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 794/1569] 10.222.0.70 () {60 vars in 1143 bytes} [Tue May 10 19:20:41 2022] POST /identity/v3/users => generated 283 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:20:41.536582 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7180cdc-2a18-4927-bbd3-2c98e0044b0e admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:20:41.546636 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7180cdc-2a18-4927-bbd3-2c98e0044b0e admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:20:41.548360 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61043224-b8e0-492f-87ac-8ce09bed01cd admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:20:41.552301 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28d35f1-b0fd-4b64-aeff-038ef027c61e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:20:41.553012 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28d35f1-b0fd-4b64-aeff-038ef027c61e admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:20:41.553298 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28d35f1-b0fd-4b64-aeff-038ef027c61e admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:20:41.553427 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b9630f-f3ca-4a54-8143-4518774a0806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:20:41.553571 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28d35f1-b0fd-4b64-aeff-038ef027c61e admin admin] PATH_INFO: `/v3/domains` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:20:41.554181 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b9630f-f3ca-4a54-8143-4518774a0806 admin admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:20:41.554306 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28d35f1-b0fd-4b64-aeff-038ef027c61e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:20:41.554466 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b9630f-f3ca-4a54-8143-4518774a0806 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:20:41.554585 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28d35f1-b0fd-4b64-aeff-038ef027c61e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:20:41.554792 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b9630f-f3ca-4a54-8143-4518774a0806 admin admin] PATH_INFO: `/v3/domains` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:20:41.555480 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b9630f-f3ca-4a54-8143-4518774a0806 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:20:41.555814 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b9630f-f3ca-4a54-8143-4518774a0806 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:20:41.556190 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28d35f1-b0fd-4b64-aeff-038ef027c61e admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:20:41.557468 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b9630f-f3ca-4a54-8143-4518774a0806 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:20:41.569845 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 795/1570] 10.222.0.70 () {58 vars in 1152 bytes} [Tue May 10 19:20:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:20:41.572912 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 776/1571] 10.222.0.70 () {58 vars in 1152 bytes} [Tue May 10 19:20:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:20:41.573938 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b9630f-f3ca-4a54-8143-4518774a0806 admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:20:41.582511 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28d35f1-b0fd-4b64-aeff-038ef027c61e admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:20:41.585369 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b9630f-f3ca-4a54-8143-4518774a0806 admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:20:41.590394 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f146ad0-42f3-41f4-ac08-b7fa3382ce74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:20:41.592032 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f146ad0-42f3-41f4-ac08-b7fa3382ce74 admin admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:20:41.592331 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f146ad0-42f3-41f4-ac08-b7fa3382ce74 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:20:41.592698 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f146ad0-42f3-41f4-ac08-b7fa3382ce74 admin admin] PATH_INFO: `/v3/roles` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:20:41.593423 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f146ad0-42f3-41f4-ac08-b7fa3382ce74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:20:41.595110 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f146ad0-42f3-41f4-ac08-b7fa3382ce74 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:20:41.595249 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28d35f1-b0fd-4b64-aeff-038ef027c61e admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:20:41.600016 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6861d2-b0cd-4886-8912-f2671f0f37d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:20:41.600730 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6861d2-b0cd-4886-8912-f2671f0f37d2 admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:20:41.601015 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6861d2-b0cd-4886-8912-f2671f0f37d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:20:41.601297 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6861d2-b0cd-4886-8912-f2671f0f37d2 admin admin] PATH_INFO: `/v3/users` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:20:41.601989 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6861d2-b0cd-4886-8912-f2671f0f37d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:20:41.603926 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6861d2-b0cd-4886-8912-f2671f0f37d2 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:20:41.605525 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 777/1572] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:20:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:20:41.609175 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f146ad0-42f3-41f4-ac08-b7fa3382ce74 admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:20:41.616395 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f146ad0-42f3-41f4-ac08-b7fa3382ce74 admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:20:41.621245 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44149b38-ac0e-471d-9305-7257ef152cc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:20:41.621885 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44149b38-ac0e-471d-9305-7257ef152cc9 admin admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:20:41.622214 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44149b38-ac0e-471d-9305-7257ef152cc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:20:41.622488 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44149b38-ac0e-471d-9305-7257ef152cc9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:20:41.623189 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44149b38-ac0e-471d-9305-7257ef152cc9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:20:41.623487 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44149b38-ac0e-471d-9305-7257ef152cc9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:20:41.624975 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 796/1573] 10.222.0.70 () {60 vars in 1143 bytes} [Tue May 10 19:20:41 2022] POST /identity/v3/users => generated 289 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:20:41.625112 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44149b38-ac0e-471d-9305-7257ef152cc9 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:20:41.625771 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6861d2-b0cd-4886-8912-f2671f0f37d2 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:20:41.636749 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 778/1574] 10.222.0.70 () {58 vars in 1152 bytes} [Tue May 10 19:20:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:20:41.637240 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6861d2-b0cd-4886-8912-f2671f0f37d2 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:20:41.637591 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44149b38-ac0e-471d-9305-7257ef152cc9 admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:20:41.642775 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7348ec91-555a-4d75-8894-1856ff780dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:20:41.643428 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7348ec91-555a-4d75-8894-1856ff780dcc admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:20:41.643712 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7348ec91-555a-4d75-8894-1856ff780dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:20:41.643987 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7348ec91-555a-4d75-8894-1856ff780dcc admin admin] PATH_INFO: `/v3/projects` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:20:41.644959 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7348ec91-555a-4d75-8894-1856ff780dcc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:20:41.647070 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7348ec91-555a-4d75-8894-1856ff780dcc admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:20:41.650047 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44149b38-ac0e-471d-9305-7257ef152cc9 admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:20:41.657020 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3a47ce-b571-418a-a943-2f08edde6a90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:20:41.657928 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3a47ce-b571-418a-a943-2f08edde6a90 admin admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:20:41.658517 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3a47ce-b571-418a-a943-2f08edde6a90 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:20:41.658517 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3a47ce-b571-418a-a943-2f08edde6a90 admin admin] PATH_INFO: `/v3/roles` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:20:41.659273 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3a47ce-b571-418a-a943-2f08edde6a90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:20:41.661710 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3a47ce-b571-418a-a943-2f08edde6a90 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:20:41.673932 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 779/1575] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:20:41 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:20:41.674982 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3a47ce-b571-418a-a943-2f08edde6a90 admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:20:41.680627 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 797/1576] 10.222.0.70 () {60 vars in 1152 bytes} [Tue May 10 19:20:41 2022] POST /identity/v3/projects => generated 385 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:20:41.681594 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7348ec91-555a-4d75-8894-1856ff780dcc admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:20:41.688449 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3a47ce-b571-418a-a943-2f08edde6a90 admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:20:41.741057 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7348ec91-555a-4d75-8894-1856ff780dcc admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:20:41.745226 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2458bb-612b-4cf6-b091-83b3f22dfbd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:20:41.745436 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2dcd31-17d5-4df2-bc2c-907994a3f35a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:20:41.745973 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2458bb-612b-4cf6-b091-83b3f22dfbd3 admin admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:20:41.746107 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2dcd31-17d5-4df2-bc2c-907994a3f35a admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:20:41.746261 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2458bb-612b-4cf6-b091-83b3f22dfbd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:20:41.746364 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2dcd31-17d5-4df2-bc2c-907994a3f35a admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:20:41.746539 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2458bb-612b-4cf6-b091-83b3f22dfbd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:20:41.746633 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2dcd31-17d5-4df2-bc2c-907994a3f35a admin admin] PATH_INFO: `/v3/projects` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:20:41.747298 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2dcd31-17d5-4df2-bc2c-907994a3f35a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:20:41.747416 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2458bb-612b-4cf6-b091-83b3f22dfbd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:20:41.748934 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2458bb-612b-4cf6-b091-83b3f22dfbd3 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:20:41.749196 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2dcd31-17d5-4df2-bc2c-907994a3f35a admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:20:41.759510 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 780/1577] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:20:41 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:20:41.760299 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2458bb-612b-4cf6-b091-83b3f22dfbd3 admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:20:41.771063 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2458bb-612b-4cf6-b091-83b3f22dfbd3 admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:20:41.778167 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 798/1578] 10.222.0.70 () {60 vars in 1152 bytes} [Tue May 10 19:20:41 2022] POST /identity/v3/projects => generated 389 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:20:41.778339 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12e7fde-030d-45b0-962a-3028ba1ef7a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:20:41.779009 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2dcd31-17d5-4df2-bc2c-907994a3f35a admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:20:41.779128 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12e7fde-030d-45b0-962a-3028ba1ef7a7 admin admin] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:20:41.779128 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12e7fde-030d-45b0-962a-3028ba1ef7a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:20:41.779128 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12e7fde-030d-45b0-962a-3028ba1ef7a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:20:41.779128 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12e7fde-030d-45b0-962a-3028ba1ef7a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:20:41.779902 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12e7fde-030d-45b0-962a-3028ba1ef7a7 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:20:41.805187 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 781/1579] 10.222.0.70 () {60 vars in 1152 bytes} [Tue May 10 19:20:41 2022] POST /identity/v3/projects => generated 377 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:20:41.806007 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12e7fde-030d-45b0-962a-3028ba1ef7a7 admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:20:41.840820 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2dcd31-17d5-4df2-bc2c-907994a3f35a admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:20:41.871229 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12e7fde-030d-45b0-962a-3028ba1ef7a7 admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:20:41.876527 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782c7f4a-ef39-477e-8356-af54c1af8253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:20:41.877198 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782c7f4a-ef39-477e-8356-af54c1af8253 admin admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:20:41.877478 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782c7f4a-ef39-477e-8356-af54c1af8253 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:20:41.877752 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782c7f4a-ef39-477e-8356-af54c1af8253 admin admin] PATH_INFO: `/v3/roles` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:20:41.878477 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782c7f4a-ef39-477e-8356-af54c1af8253 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:20:41.880061 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782c7f4a-ef39-477e-8356-af54c1af8253 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:20:41.890296 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 782/1580] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:20:41 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:20:41.891308 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782c7f4a-ef39-477e-8356-af54c1af8253 admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:20:41.903449 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11f75da-95f5-44c9-a0e9-1ae396808025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:20:41.904359 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11f75da-95f5-44c9-a0e9-1ae396808025 admin admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:20:41.904684 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11f75da-95f5-44c9-a0e9-1ae396808025 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:20:41.904961 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11f75da-95f5-44c9-a0e9-1ae396808025 admin admin] PATH_INFO: `/v3/projects/f128bb7b2cb14b47bc0226972d09bdcc/users/f18fcb5814b24a049f00bfac8209175f/roles/5c07cf5bfbd3427db18428aa50420962` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:20:41.905369 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782c7f4a-ef39-477e-8356-af54c1af8253 admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:20:41.910140 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918d1db6-0e48-4621-8501-c362e4370d98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:20:41.910841 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918d1db6-0e48-4621-8501-c362e4370d98 admin admin] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:20:41.911132 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918d1db6-0e48-4621-8501-c362e4370d98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:20:41.911411 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918d1db6-0e48-4621-8501-c362e4370d98 admin admin] PATH_INFO: `/v3/projects` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:20:41.912151 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918d1db6-0e48-4621-8501-c362e4370d98 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:20:41.914217 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918d1db6-0e48-4621-8501-c362e4370d98 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:20:41.919803 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11f75da-95f5-44c9-a0e9-1ae396808025 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f128bb7b2cb14b47bc0226972d09bdcc, user_id=f18fcb5814b24a049f00bfac8209175f, role_id=5c07cf5bfbd3427db18428aa50420962)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:20:41.921075 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: WARNING py.warnings [None req-f11f75da-95f5-44c9-a0e9-1ae396808025 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 10 19:20:41.921075 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: warnings.warn(msg) May 10 19:20:41.921075 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: May 10 19:20:41.922987 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11f75da-95f5-44c9-a0e9-1ae396808025 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:20:41.937497 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 799/1581] 10.222.0.70 () {60 vars in 1482 bytes} [Tue May 10 19:20:41 2022] PUT /identity/v3/projects/f128bb7b2cb14b47bc0226972d09bdcc/users/f18fcb5814b24a049f00bfac8209175f/roles/5c07cf5bfbd3427db18428aa50420962 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:20:41.938325 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11f75da-95f5-44c9-a0e9-1ae396808025 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:20:41.949705 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 783/1582] 10.222.0.70 () {60 vars in 1152 bytes} [Tue May 10 19:20:41 2022] POST /identity/v3/projects => generated 393 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:20:41.951794 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918d1db6-0e48-4621-8501-c362e4370d98 admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:20:42.006819 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11f75da-95f5-44c9-a0e9-1ae396808025 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:20:42.011336 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7011403a-ede4-4797-973f-09a6c1b2a37a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:20:42.011896 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918d1db6-0e48-4621-8501-c362e4370d98 admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:20:42.012226 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7011403a-ede4-4797-973f-09a6c1b2a37a admin admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:20:42.012553 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7011403a-ede4-4797-973f-09a6c1b2a37a admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:20:42.013411 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7011403a-ede4-4797-973f-09a6c1b2a37a admin admin] PATH_INFO: `/v3/projects/81ecb3bf630d4eb5b8c8a5fe1a80bda7/users/9b440b092de246199794536a17a71cf6/roles/5c07cf5bfbd3427db18428aa50420962` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:20:42.017028 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd064ed-0385-40ae-8918-54efa3f0528d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:20:42.017691 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd064ed-0385-40ae-8918-54efa3f0528d admin admin] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:20:42.017973 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd064ed-0385-40ae-8918-54efa3f0528d admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:20:42.018249 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd064ed-0385-40ae-8918-54efa3f0528d admin admin] PATH_INFO: `/v3/users` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:20:42.018935 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd064ed-0385-40ae-8918-54efa3f0528d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:20:42.020967 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd064ed-0385-40ae-8918-54efa3f0528d admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:20:42.027387 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7011403a-ede4-4797-973f-09a6c1b2a37a admin admin] RBAC: Authorizing `identity:create_grant(project_id=81ecb3bf630d4eb5b8c8a5fe1a80bda7, user_id=9b440b092de246199794536a17a71cf6, role_id=5c07cf5bfbd3427db18428aa50420962)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:20:42.030128 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7011403a-ede4-4797-973f-09a6c1b2a37a admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:20:42.041028 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 784/1583] 10.222.0.70 () {60 vars in 1143 bytes} [Tue May 10 19:20:41 2022] POST /identity/v3/users => generated 293 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:20:42.042020 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd064ed-0385-40ae-8918-54efa3f0528d admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:20:42.052632 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 800/1584] 10.222.0.70 () {60 vars in 1482 bytes} [Tue May 10 19:20:41 2022] PUT /identity/v3/projects/81ecb3bf630d4eb5b8c8a5fe1a80bda7/users/9b440b092de246199794536a17a71cf6/roles/5c07cf5bfbd3427db18428aa50420962 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:20:42.052632 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7011403a-ede4-4797-973f-09a6c1b2a37a admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:20:42.052892 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd064ed-0385-40ae-8918-54efa3f0528d admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:20:42.104802 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7011403a-ede4-4797-973f-09a6c1b2a37a admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:20:42.108232 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57712a51-7496-4616-b278-861b0c420743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:20:42.108940 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57712a51-7496-4616-b278-861b0c420743 admin admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:20:42.109226 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57712a51-7496-4616-b278-861b0c420743 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:20:42.109503 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57712a51-7496-4616-b278-861b0c420743 admin admin] PATH_INFO: `/v3/roles` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:20:42.110227 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57712a51-7496-4616-b278-861b0c420743 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:20:42.110321 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab699335-396c-4d40-8ab1-8b18ce709cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:20:42.110924 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab699335-396c-4d40-8ab1-8b18ce709cf3 admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:20:42.111204 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab699335-396c-4d40-8ab1-8b18ce709cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:20:42.111473 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab699335-396c-4d40-8ab1-8b18ce709cf3 admin admin] PATH_INFO: `/v3/users` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:20:42.111830 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57712a51-7496-4616-b278-861b0c420743 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:20:42.112177 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab699335-396c-4d40-8ab1-8b18ce709cf3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:20:42.114103 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab699335-396c-4d40-8ab1-8b18ce709cf3 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:20:42.121398 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 785/1585] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:20:42 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:20:42.122214 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57712a51-7496-4616-b278-861b0c420743 admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:20:42.133702 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57712a51-7496-4616-b278-861b0c420743 admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:20:42.137298 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 801/1586] 10.222.0.70 () {60 vars in 1143 bytes} [Tue May 10 19:20:42 2022] POST /identity/v3/users => generated 295 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:20:42.137298 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab699335-396c-4d40-8ab1-8b18ce709cf3 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:20:42.138471 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925e3cef-18ae-4849-b10a-522e564be5ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:20:42.139113 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925e3cef-18ae-4849-b10a-522e564be5ba admin admin] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:20:42.139391 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925e3cef-18ae-4849-b10a-522e564be5ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:20:42.139661 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925e3cef-18ae-4849-b10a-522e564be5ba admin admin] PATH_INFO: `/v3/users` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:20:42.140335 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925e3cef-18ae-4849-b10a-522e564be5ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:20:42.142252 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925e3cef-18ae-4849-b10a-522e564be5ba admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:20:42.144379 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab699335-396c-4d40-8ab1-8b18ce709cf3 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:20:42.148973 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a8f983-f40c-4cea-b200-4f0eba07b7d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:20:42.149620 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a8f983-f40c-4cea-b200-4f0eba07b7d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:20:42.149990 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a8f983-f40c-4cea-b200-4f0eba07b7d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:20:42.150173 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a8f983-f40c-4cea-b200-4f0eba07b7d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:20:42.150910 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a8f983-f40c-4cea-b200-4f0eba07b7d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:20:42.152655 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a8f983-f40c-4cea-b200-4f0eba07b7d2 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:20:42.161900 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 786/1587] 10.222.0.70 () {60 vars in 1143 bytes} [Tue May 10 19:20:42 2022] POST /identity/v3/users => generated 289 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:20:42.163215 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdf7e53-b8cc-48f4-9081-fae2981279ef None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:20:42.163341 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 802/1588] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:20:42 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:20:42.163687 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdf7e53-b8cc-48f4-9081-fae2981279ef None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:20:42.163942 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdf7e53-b8cc-48f4-9081-fae2981279ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:20:42.164072 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a8f983-f40c-4cea-b200-4f0eba07b7d2 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:20:42.174204 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a8f983-f40c-4cea-b200-4f0eba07b7d2 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:20:42.178872 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4bf0bd-cfb4-4a19-aaee-c33841cd3a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:20:42.179516 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4bf0bd-cfb4-4a19-aaee-c33841cd3a96 admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:20:42.179798 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4bf0bd-cfb4-4a19-aaee-c33841cd3a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:20:42.180072 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4bf0bd-cfb4-4a19-aaee-c33841cd3a96 admin admin] PATH_INFO: `/v3/users` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:20:42.180778 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4bf0bd-cfb4-4a19-aaee-c33841cd3a96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:20:42.182681 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4bf0bd-cfb4-4a19-aaee-c33841cd3a96 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:20:42.190052 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-8cdf7e53-b8cc-48f4-9081-fae2981279ef None None] MFA Rules not processed for user `f18fcb5814b24a049f00bfac8209175f`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:20:42.191408 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-8cdf7e53-b8cc-48f4-9081-fae2981279ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:20:42.202033 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 803/1589] 10.222.0.70 () {60 vars in 1143 bytes} [Tue May 10 19:20:42 2022] POST /identity/v3/users => generated 297 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:20:42.202832 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4bf0bd-cfb4-4a19-aaee-c33841cd3a96 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:20:42.212357 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4bf0bd-cfb4-4a19-aaee-c33841cd3a96 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:20:42.217591 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265dbb28-963d-4580-aaee-25e36fb53d2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:20:42.218236 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265dbb28-963d-4580-aaee-25e36fb53d2a admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:20:42.218517 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265dbb28-963d-4580-aaee-25e36fb53d2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:20:42.218814 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265dbb28-963d-4580-aaee-25e36fb53d2a admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:20:42.219561 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265dbb28-963d-4580-aaee-25e36fb53d2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:20:42.221199 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265dbb28-963d-4580-aaee-25e36fb53d2a admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:20:42.232129 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 804/1590] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:20:42 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:20:42.233405 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89102eee-6def-4ff7-9f99-1d174d003e68 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:20:42.233664 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89102eee-6def-4ff7-9f99-1d174d003e68 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:20:42.233938 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89102eee-6def-4ff7-9f99-1d174d003e68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:20:42.255541 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 787/1591] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:20:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:20:42.256413 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdf7e53-b8cc-48f4-9081-fae2981279ef None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:20:42.258720 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-89102eee-6def-4ff7-9f99-1d174d003e68 None None] MFA Rules not processed for user `9b440b092de246199794536a17a71cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:20:42.259895 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-89102eee-6def-4ff7-9f99-1d174d003e68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:20:42.266620 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdf7e53-b8cc-48f4-9081-fae2981279ef None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:20:42.271470 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a260bbfa-efaf-46f8-b24f-2408f31cbe65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:20:42.272386 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a260bbfa-efaf-46f8-b24f-2408f31cbe65 admin admin] REQUEST_METHOD: `PUT` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:20:42.272681 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a260bbfa-efaf-46f8-b24f-2408f31cbe65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:20:42.273009 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a260bbfa-efaf-46f8-b24f-2408f31cbe65 admin admin] PATH_INFO: `/v3/projects/a2b9c0e8217b473296fcf3c5779cfaee/users/c141278987f64fc7a55ba62bca6f403c/roles/5c07cf5bfbd3427db18428aa50420962` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:20:42.287741 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a260bbfa-efaf-46f8-b24f-2408f31cbe65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2b9c0e8217b473296fcf3c5779cfaee, user_id=c141278987f64fc7a55ba62bca6f403c, role_id=5c07cf5bfbd3427db18428aa50420962)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:20:42.290405 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a260bbfa-efaf-46f8-b24f-2408f31cbe65 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:20:42.304034 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 788/1592] 10.222.0.70 () {60 vars in 1482 bytes} [Tue May 10 19:20:42 2022] PUT /identity/v3/projects/a2b9c0e8217b473296fcf3c5779cfaee/users/c141278987f64fc7a55ba62bca6f403c/roles/5c07cf5bfbd3427db18428aa50420962 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:20:42.304989 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a260bbfa-efaf-46f8-b24f-2408f31cbe65 admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:20:42.323725 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 805/1593] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:20:42 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:20:42.324373 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89102eee-6def-4ff7-9f99-1d174d003e68 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:20:42.334319 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89102eee-6def-4ff7-9f99-1d174d003e68 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:20:42.366257 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a260bbfa-efaf-46f8-b24f-2408f31cbe65 admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:20:42.370998 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dc9d05-6948-4891-b00f-a7b1ae7bb606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:20:42.371714 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dc9d05-6948-4891-b00f-a7b1ae7bb606 admin admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:20:42.372003 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dc9d05-6948-4891-b00f-a7b1ae7bb606 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:20:42.372304 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dc9d05-6948-4891-b00f-a7b1ae7bb606 admin admin] PATH_INFO: `/v3/roles` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:20:42.373085 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dc9d05-6948-4891-b00f-a7b1ae7bb606 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:20:42.374684 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dc9d05-6948-4891-b00f-a7b1ae7bb606 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:20:42.387025 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 789/1594] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:20:42 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:20:42.387025 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dc9d05-6948-4891-b00f-a7b1ae7bb606 admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:20:42.387317 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f044f010-a711-41e7-ab28-a95237b5af22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:20:42.388482 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f044f010-a711-41e7-ab28-a95237b5af22 admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:20:42.388675 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f044f010-a711-41e7-ab28-a95237b5af22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:20:42.388951 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f044f010-a711-41e7-ab28-a95237b5af22 admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:20:42.389663 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f044f010-a711-41e7-ab28-a95237b5af22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:20:42.391246 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f044f010-a711-41e7-ab28-a95237b5af22 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:20:42.394430 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dc9d05-6948-4891-b00f-a7b1ae7bb606 admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:20:42.398864 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763bdf62-c66f-4956-bd89-5a7f35b51047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:20:42.399710 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763bdf62-c66f-4956-bd89-5a7f35b51047 admin admin] REQUEST_METHOD: `PUT` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:20:42.400000 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763bdf62-c66f-4956-bd89-5a7f35b51047 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:20:42.400276 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763bdf62-c66f-4956-bd89-5a7f35b51047 admin admin] PATH_INFO: `/v3/projects/2f6baa22c9994643b63ecfe6b43988f6/users/7081de6673aa463292118a0673959ea9/roles/5c07cf5bfbd3427db18428aa50420962` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:20:42.403844 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 806/1595] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:20:42 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:20:42.403844 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f044f010-a711-41e7-ab28-a95237b5af22 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:20:42.410680 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f044f010-a711-41e7-ab28-a95237b5af22 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:20:42.415539 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763bdf62-c66f-4956-bd89-5a7f35b51047 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f6baa22c9994643b63ecfe6b43988f6, user_id=7081de6673aa463292118a0673959ea9, role_id=5c07cf5bfbd3427db18428aa50420962)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:20:42.415914 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deab3c64-fb30-4a4a-a696-a3dfbd82c5c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:20:42.416586 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deab3c64-fb30-4a4a-a696-a3dfbd82c5c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:20:42.416867 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deab3c64-fb30-4a4a-a696-a3dfbd82c5c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:20:42.417138 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deab3c64-fb30-4a4a-a696-a3dfbd82c5c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:20:42.417834 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deab3c64-fb30-4a4a-a696-a3dfbd82c5c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:20:42.418266 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763bdf62-c66f-4956-bd89-5a7f35b51047 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:20:42.419883 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deab3c64-fb30-4a4a-a696-a3dfbd82c5c5 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:20:42.429864 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 807/1596] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:20:42 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:20:42.430613 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deab3c64-fb30-4a4a-a696-a3dfbd82c5c5 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:20:42.435434 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 790/1597] 10.222.0.70 () {60 vars in 1482 bytes} [Tue May 10 19:20:42 2022] PUT /identity/v3/projects/2f6baa22c9994643b63ecfe6b43988f6/users/7081de6673aa463292118a0673959ea9/roles/5c07cf5bfbd3427db18428aa50420962 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:20:42.437046 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75838c1-d718-452b-b845-d96044308a66 None None] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:20:42.437338 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75838c1-d718-452b-b845-d96044308a66 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:20:42.437613 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75838c1-d718-452b-b845-d96044308a66 None None] PATH_INFO: `/` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:20:42.439007 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 791/1598] 10.222.0.70 () {54 vars in 961 bytes} [Tue May 10 19:20:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:20:42.439867 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87315a54-565e-4f3c-a8d2-caf09b026bf0 None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:20:42.440142 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87315a54-565e-4f3c-a8d2-caf09b026bf0 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:20:42.440321 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deab3c64-fb30-4a4a-a696-a3dfbd82c5c5 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:20:42.440464 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87315a54-565e-4f3c-a8d2-caf09b026bf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:20:42.466922 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-87315a54-565e-4f3c-a8d2-caf09b026bf0 None None] MFA Rules not processed for user `c141278987f64fc7a55ba62bca6f403c`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:20:42.468137 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-87315a54-565e-4f3c-a8d2-caf09b026bf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:20:42.497298 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da24a92-9452-4bd0-aa4c-64fa8afb956c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:20:42.497971 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da24a92-9452-4bd0-aa4c-64fa8afb956c admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:20:42.498255 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da24a92-9452-4bd0-aa4c-64fa8afb956c admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:20:42.498531 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da24a92-9452-4bd0-aa4c-64fa8afb956c admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:20:42.499253 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da24a92-9452-4bd0-aa4c-64fa8afb956c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:20:42.500904 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da24a92-9452-4bd0-aa4c-64fa8afb956c admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:20:42.510322 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 808/1599] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:20:42 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:20:42.513769 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da24a92-9452-4bd0-aa4c-64fa8afb956c admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:20:42.522929 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da24a92-9452-4bd0-aa4c-64fa8afb956c admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:20:42.527581 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aac000-0bb4-4318-a890-faeb6e2eed05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:20:42.527959 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 792/1600] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:20:42 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:20:42.528207 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aac000-0bb4-4318-a890-faeb6e2eed05 admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:20:42.529269 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aac000-0bb4-4318-a890-faeb6e2eed05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:20:42.529447 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87315a54-565e-4f3c-a8d2-caf09b026bf0 None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:20:42.529564 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aac000-0bb4-4318-a890-faeb6e2eed05 admin admin] PATH_INFO: `/v3/projects` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:20:42.530224 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09aac000-0bb4-4318-a890-faeb6e2eed05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:20:42.532122 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09aac000-0bb4-4318-a890-faeb6e2eed05 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:20:42.542043 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87315a54-565e-4f3c-a8d2-caf09b026bf0 None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:20:42.547525 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27517a4-1016-4028-a7c8-cd3ec0acbc17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:20:42.548138 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27517a4-1016-4028-a7c8-cd3ec0acbc17 admin admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:20:42.548438 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27517a4-1016-4028-a7c8-cd3ec0acbc17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:20:42.548713 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27517a4-1016-4028-a7c8-cd3ec0acbc17 admin admin] PATH_INFO: `/v3/roles` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:20:42.549498 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27517a4-1016-4028-a7c8-cd3ec0acbc17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:20:42.551203 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27517a4-1016-4028-a7c8-cd3ec0acbc17 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:20:42.558113 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 809/1601] 10.222.0.70 () {60 vars in 1152 bytes} [Tue May 10 19:20:42 2022] POST /identity/v3/projects => generated 381 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:20:42.558932 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aac000-0bb4-4318-a890-faeb6e2eed05 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:20:42.561055 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 793/1602] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:20:42 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:20:42.561901 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27517a4-1016-4028-a7c8-cd3ec0acbc17 admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:20:42.573526 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27517a4-1016-4028-a7c8-cd3ec0acbc17 admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:20:42.621867 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aac000-0bb4-4318-a890-faeb6e2eed05 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:20:42.626260 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be32374-0bf1-4964-9972-d73e0014aa08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:20:42.626537 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ee338f-c63c-446e-93d4-8f8102bd41da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:20:42.626950 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be32374-0bf1-4964-9972-d73e0014aa08 admin admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:20:42.627205 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ee338f-c63c-446e-93d4-8f8102bd41da admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:20:42.627369 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be32374-0bf1-4964-9972-d73e0014aa08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:20:42.627492 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be32374-0bf1-4964-9972-d73e0014aa08 admin admin] PATH_INFO: `/v3/roles` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:20:42.627623 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ee338f-c63c-446e-93d4-8f8102bd41da admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:20:42.627769 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ee338f-c63c-446e-93d4-8f8102bd41da admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:20:42.628193 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be32374-0bf1-4964-9972-d73e0014aa08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:20:42.628691 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ee338f-c63c-446e-93d4-8f8102bd41da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:20:42.629814 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be32374-0bf1-4964-9972-d73e0014aa08 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:20:42.630271 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ee338f-c63c-446e-93d4-8f8102bd41da admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:20:42.639641 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 794/1603] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:20:42 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:20:42.641002 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a303e664-81d9-4565-8ca7-59b19f8852e4 None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:20:42.641294 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a303e664-81d9-4565-8ca7-59b19f8852e4 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:20:42.641566 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a303e664-81d9-4565-8ca7-59b19f8852e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:20:42.643314 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 810/1604] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:20:42 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:20:42.644641 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84b81c0-6300-44b1-8946-e0df99f8aea6 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:20:42.644933 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84b81c0-6300-44b1-8946-e0df99f8aea6 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:20:42.645210 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84b81c0-6300-44b1-8946-e0df99f8aea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:20:42.658852 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-a303e664-81d9-4565-8ca7-59b19f8852e4 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:20:42.660020 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-a303e664-81d9-4565-8ca7-59b19f8852e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:20:42.662793 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-e84b81c0-6300-44b1-8946-e0df99f8aea6 None None] MFA Rules not processed for user `b9f310a468ec4058b3c95356ea60ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:20:42.663952 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-e84b81c0-6300-44b1-8946-e0df99f8aea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:20:42.668057 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 795/1605] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:20:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:20:42.668788 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a303e664-81d9-4565-8ca7-59b19f8852e4 None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:20:42.678606 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a303e664-81d9-4565-8ca7-59b19f8852e4 None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:20:42.683219 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17439583-d6a7-4080-a326-7905acf48765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:20:42.684099 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17439583-d6a7-4080-a326-7905acf48765 admin admin] REQUEST_METHOD: `PUT` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:20:42.684386 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17439583-d6a7-4080-a326-7905acf48765 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:20:42.684733 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17439583-d6a7-4080-a326-7905acf48765 admin admin] PATH_INFO: `/v3/projects/758b8f4f3d1c4242822940f17246d98f/users/db6fd87ab33946808f4153585fc1d07a/roles/5c07cf5bfbd3427db18428aa50420962` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:20:42.698603 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17439583-d6a7-4080-a326-7905acf48765 admin admin] RBAC: Authorizing `identity:create_grant(project_id=758b8f4f3d1c4242822940f17246d98f, user_id=db6fd87ab33946808f4153585fc1d07a, role_id=5c07cf5bfbd3427db18428aa50420962)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:20:42.702154 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17439583-d6a7-4080-a326-7905acf48765 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:20:42.714651 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 796/1606] 10.222.0.70 () {60 vars in 1482 bytes} [Tue May 10 19:20:42 2022] PUT /identity/v3/projects/758b8f4f3d1c4242822940f17246d98f/users/db6fd87ab33946808f4153585fc1d07a/roles/5c07cf5bfbd3427db18428aa50420962 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:20:42.719160 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17439583-d6a7-4080-a326-7905acf48765 admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:20:42.732223 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 811/1607] 10.222.0.70 () {58 vars in 1058 bytes} [Tue May 10 19:20:42 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:20:42.733138 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84b81c0-6300-44b1-8946-e0df99f8aea6 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:20:42.742662 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84b81c0-6300-44b1-8946-e0df99f8aea6 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:20:42.774764 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17439583-d6a7-4080-a326-7905acf48765 admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:20:42.778258 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cba20d-2e6f-4d9c-87f1-3ffb443567a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15df2a8967aa43299c10e365f4200d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:20:42.779496 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cba20d-2e6f-4d9c-87f1-3ffb443567a0 service cinder] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:20:42.779709 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cba20d-2e6f-4d9c-87f1-3ffb443567a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:20:42.780146 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cba20d-2e6f-4d9c-87f1-3ffb443567a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:20:42.796903 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb896f2-2686-4273-a513-6af3a4c8f5a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:20:42.797577 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb896f2-2686-4273-a513-6af3a4c8f5a6 admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:20:42.797860 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb896f2-2686-4273-a513-6af3a4c8f5a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:20:42.798135 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb896f2-2686-4273-a513-6af3a4c8f5a6 admin admin] PATH_INFO: `/v3/users` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:20:42.798846 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb896f2-2686-4273-a513-6af3a4c8f5a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:20:42.800785 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb896f2-2686-4273-a513-6af3a4c8f5a6 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:20:42.820381 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 812/1608] 10.222.0.70 () {60 vars in 1143 bytes} [Tue May 10 19:20:42 2022] POST /identity/v3/users => generated 297 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:20:42.821203 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb896f2-2686-4273-a513-6af3a4c8f5a6 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:20:42.830686 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb896f2-2686-4273-a513-6af3a4c8f5a6 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:20:42.835264 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f84715-4c04-4b7c-b761-17f09cf91a65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:20:42.836117 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f84715-4c04-4b7c-b761-17f09cf91a65 admin admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:20:42.836368 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cba20d-2e6f-4d9c-87f1-3ffb443567a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:20:42.836496 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f84715-4c04-4b7c-b761-17f09cf91a65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:20:42.836691 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f84715-4c04-4b7c-b761-17f09cf91a65 admin admin] PATH_INFO: `/v3/projects/8588427eb06848b9ad22fab88b7c91e3/users/90bbeed46811450f953507e570a2bd94/roles/5c07cf5bfbd3427db18428aa50420962` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:20:42.837853 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cba20d-2e6f-4d9c-87f1-3ffb443567a0 service cinder] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:20:42.847196 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 797/1609] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:20:42 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:20:42.847975 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cba20d-2e6f-4d9c-87f1-3ffb443567a0 service cinder] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:20:42.851696 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f84715-4c04-4b7c-b761-17f09cf91a65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8588427eb06848b9ad22fab88b7c91e3, user_id=90bbeed46811450f953507e570a2bd94, role_id=5c07cf5bfbd3427db18428aa50420962)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:20:42.854607 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f84715-4c04-4b7c-b761-17f09cf91a65 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:20:42.859082 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cba20d-2e6f-4d9c-87f1-3ffb443567a0 service cinder] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:20:42.864806 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f7e350-eb43-4cad-acc7-15bf5180704b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:20:42.865714 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f7e350-eb43-4cad-acc7-15bf5180704b admin admin] REQUEST_METHOD: `PUT` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:20:42.865962 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f7e350-eb43-4cad-acc7-15bf5180704b admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:20:42.866230 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f7e350-eb43-4cad-acc7-15bf5180704b admin admin] PATH_INFO: `/v3/projects/b01ea9fc16b94ff0899ce6ae2f229400/users/4c7ce54253764d788ea48b5ff9b43d54/roles/5c07cf5bfbd3427db18428aa50420962` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:20:42.870116 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 813/1610] 10.222.0.70 () {60 vars in 1482 bytes} [Tue May 10 19:20:42 2022] PUT /identity/v3/projects/8588427eb06848b9ad22fab88b7c91e3/users/90bbeed46811450f953507e570a2bd94/roles/5c07cf5bfbd3427db18428aa50420962 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:20:42.870860 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f84715-4c04-4b7c-b761-17f09cf91a65 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:20:42.881770 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f7e350-eb43-4cad-acc7-15bf5180704b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b01ea9fc16b94ff0899ce6ae2f229400, user_id=4c7ce54253764d788ea48b5ff9b43d54, role_id=5c07cf5bfbd3427db18428aa50420962)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:20:42.884581 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f7e350-eb43-4cad-acc7-15bf5180704b admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:20:42.898255 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 798/1611] 10.222.0.70 () {60 vars in 1482 bytes} [Tue May 10 19:20:42 2022] PUT /identity/v3/projects/b01ea9fc16b94ff0899ce6ae2f229400/users/4c7ce54253764d788ea48b5ff9b43d54/roles/5c07cf5bfbd3427db18428aa50420962 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:20:42.899090 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f7e350-eb43-4cad-acc7-15bf5180704b admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:20:42.900930 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-81f7e350-eb43-4cad-acc7-15bf5180704b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:20:42.933776 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f84715-4c04-4b7c-b761-17f09cf91a65 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:20:42.973764 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f7e350-eb43-4cad-acc7-15bf5180704b admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:20:42.978132 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175909b9-5b91-4c4c-9c76-9510c6179966 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f1dc79540b48c0866478cc48cd8205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:20:42.979063 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175909b9-5b91-4c4c-9c76-9510c6179966 service neutron] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:20:42.979576 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175909b9-5b91-4c4c-9c76-9510c6179966 service neutron] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:20:42.980076 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175909b9-5b91-4c4c-9c76-9510c6179966 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:20:43.004207 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1b93de-def2-4561-a085-2d5dfd5f0c43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:20:43.005184 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1b93de-def2-4561-a085-2d5dfd5f0c43 admin admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:20:43.005468 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1b93de-def2-4561-a085-2d5dfd5f0c43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:20:43.005743 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1b93de-def2-4561-a085-2d5dfd5f0c43 admin admin] PATH_INFO: `/v3/projects/8c2669245ca948cfa795863fa7e43496/users/a7188fbb905a4ef984d8d3eda8d443d9/roles/5c07cf5bfbd3427db18428aa50420962` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:20:43.021326 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1b93de-def2-4561-a085-2d5dfd5f0c43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c2669245ca948cfa795863fa7e43496, user_id=a7188fbb905a4ef984d8d3eda8d443d9, role_id=5c07cf5bfbd3427db18428aa50420962)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:20:43.023979 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1b93de-def2-4561-a085-2d5dfd5f0c43 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:20:43.039024 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 814/1612] 10.222.0.70 () {60 vars in 1482 bytes} [Tue May 10 19:20:42 2022] PUT /identity/v3/projects/8c2669245ca948cfa795863fa7e43496/users/a7188fbb905a4ef984d8d3eda8d443d9/roles/5c07cf5bfbd3427db18428aa50420962 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:20:43.043534 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a4986c-fc1e-41ed-9f8a-24e316a7b280 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:20:43.043666 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175909b9-5b91-4c4c-9c76-9510c6179966 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:20:43.043849 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a4986c-fc1e-41ed-9f8a-24e316a7b280 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:20:43.044139 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a4986c-fc1e-41ed-9f8a-24e316a7b280 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:20:43.045113 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175909b9-5b91-4c4c-9c76-9510c6179966 service neutron] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:20:43.055642 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 799/1613] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:20:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:20:43.056520 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175909b9-5b91-4c4c-9c76-9510c6179966 service neutron] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:20:43.062310 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-88a4986c-fc1e-41ed-9f8a-24e316a7b280 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:20:43.063569 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-88a4986c-fc1e-41ed-9f8a-24e316a7b280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:20:43.135457 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 815/1614] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:20:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:20:43.135457 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a4986c-fc1e-41ed-9f8a-24e316a7b280 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:20:43.135764 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175909b9-5b91-4c4c-9c76-9510c6179966 service neutron] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:20:43.151403 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a4986c-fc1e-41ed-9f8a-24e316a7b280 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:20:43.158106 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c2c76a-6f55-4967-9041-88a4bda7630b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:20:43.159193 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c2c76a-6f55-4967-9041-88a4bda7630b admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:20:43.159666 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c2c76a-6f55-4967-9041-88a4bda7630b admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:20:43.160184 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c2c76a-6f55-4967-9041-88a4bda7630b admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:20:43.161890 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c2c76a-6f55-4967-9041-88a4bda7630b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:20:43.164038 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c2c76a-6f55-4967-9041-88a4bda7630b admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:20:43.180211 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 816/1615] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:20:43 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:20:43.182692 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4614c745-55e6-4661-95ae-ff878d92f066 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:20:43.183213 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4614c745-55e6-4661-95ae-ff878d92f066 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:20:43.183933 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4614c745-55e6-4661-95ae-ff878d92f066 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:20:43.209817 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620fd6dc-6349-4df8-9f1b-477fcc70e41b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9f310a468ec4058b3c95356ea60ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:20:43.210689 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620fd6dc-6349-4df8-9f1b-477fcc70e41b service nova] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:20:43.211093 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620fd6dc-6349-4df8-9f1b-477fcc70e41b service nova] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:20:43.211407 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620fd6dc-6349-4df8-9f1b-477fcc70e41b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:20:43.220603 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-4614c745-55e6-4661-95ae-ff878d92f066 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:20:43.223400 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-4614c745-55e6-4661-95ae-ff878d92f066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:20:43.244738 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 817/1616] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:20:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:20:43.246944 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94b4341-5f47-42a2-940d-8e8bec9e2df6 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:20:43.247888 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94b4341-5f47-42a2-940d-8e8bec9e2df6 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:20:43.248017 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94b4341-5f47-42a2-940d-8e8bec9e2df6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:20:43.273411 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-a94b4341-5f47-42a2-940d-8e8bec9e2df6 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:20:43.275227 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-a94b4341-5f47-42a2-940d-8e8bec9e2df6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:20:43.283843 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620fd6dc-6349-4df8-9f1b-477fcc70e41b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:20:43.285222 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 818/1617] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:20:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:20:43.286621 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b17b06c-f996-4db7-99d2-127deaa9e6c3 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:20:43.286915 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b17b06c-f996-4db7-99d2-127deaa9e6c3 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:20:43.287195 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b17b06c-f996-4db7-99d2-127deaa9e6c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:20:43.289496 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620fd6dc-6349-4df8-9f1b-477fcc70e41b service nova] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:20:43.300284 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 800/1618] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:20:43 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:20:43.301549 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620fd6dc-6349-4df8-9f1b-477fcc70e41b service nova] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:20:43.325803 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-3b17b06c-f996-4db7-99d2-127deaa9e6c3 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:20:43.327712 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-3b17b06c-f996-4db7-99d2-127deaa9e6c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:20:43.347104 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 819/1619] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:20:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:20:43.348241 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b17b06c-f996-4db7-99d2-127deaa9e6c3 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:20:43.362725 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b17b06c-f996-4db7-99d2-127deaa9e6c3 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:20:43.369103 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576a9608-3f7b-4b0e-b162-4674ff158b0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:20:43.371591 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576a9608-3f7b-4b0e-b162-4674ff158b0f admin admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:20:43.371591 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576a9608-3f7b-4b0e-b162-4674ff158b0f admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:20:43.371591 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576a9608-3f7b-4b0e-b162-4674ff158b0f admin admin] PATH_INFO: `/v3/projects/dcabdfc9b23c48978db0597903dd9b32/users/ceb3eef9b11b47738cce0ebca8e12bb1/roles/634ba284303b4626b5a0402772c68f5c` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:20:43.390587 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576a9608-3f7b-4b0e-b162-4674ff158b0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcabdfc9b23c48978db0597903dd9b32, user_id=ceb3eef9b11b47738cce0ebca8e12bb1, role_id=634ba284303b4626b5a0402772c68f5c)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:20:43.393909 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576a9608-3f7b-4b0e-b162-4674ff158b0f admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:20:43.405783 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620fd6dc-6349-4df8-9f1b-477fcc70e41b service nova] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:20:43.422683 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 820/1620] 10.222.0.70 () {60 vars in 1482 bytes} [Tue May 10 19:20:43 2022] PUT /identity/v3/projects/dcabdfc9b23c48978db0597903dd9b32/users/ceb3eef9b11b47738cce0ebca8e12bb1/roles/634ba284303b4626b5a0402772c68f5c => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:20:43.423951 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576a9608-3f7b-4b0e-b162-4674ff158b0f admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:20:43.485429 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00413c48-4823-465f-ab2c-4def9064806d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f1dc79540b48c0866478cc48cd8205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:20:43.486383 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00413c48-4823-465f-ab2c-4def9064806d service neutron] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:20:43.486960 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00413c48-4823-465f-ab2c-4def9064806d service neutron] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:20:43.487387 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00413c48-4823-465f-ab2c-4def9064806d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:20:43.502647 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576a9608-3f7b-4b0e-b162-4674ff158b0f admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:20:43.515598 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19b5d9e-f70c-4835-a159-d6d5c5a1df88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f1dc79540b48c0866478cc48cd8205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:20:43.516611 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19b5d9e-f70c-4835-a159-d6d5c5a1df88 service neutron] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:20:43.516900 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19b5d9e-f70c-4835-a159-d6d5c5a1df88 service neutron] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:20:43.517183 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19b5d9e-f70c-4835-a159-d6d5c5a1df88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:20:43.567774 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00413c48-4823-465f-ab2c-4def9064806d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:20:43.569526 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00413c48-4823-465f-ab2c-4def9064806d service neutron] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:20:43.581330 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 801/1621] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:20:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:20:43.581620 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00413c48-4823-465f-ab2c-4def9064806d service neutron] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:20:43.589927 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00413c48-4823-465f-ab2c-4def9064806d service neutron] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:20:43.595467 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7840a966-d419-4f8f-b832-61c3ae4f0ab2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f1dc79540b48c0866478cc48cd8205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:20:43.596132 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7840a966-d419-4f8f-b832-61c3ae4f0ab2 service neutron] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:20:43.596512 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7840a966-d419-4f8f-b832-61c3ae4f0ab2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:20:43.597038 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7840a966-d419-4f8f-b832-61c3ae4f0ab2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:20:43.608067 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7840a966-d419-4f8f-b832-61c3ae4f0ab2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:20:43.609608 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7840a966-d419-4f8f-b832-61c3ae4f0ab2 service neutron] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:20:43.621450 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 802/1622] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:20:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:20:43.623185 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7840a966-d419-4f8f-b832-61c3ae4f0ab2 service neutron] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:20:43.632383 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7840a966-d419-4f8f-b832-61c3ae4f0ab2 service neutron] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:20:43.634303 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19b5d9e-f70c-4835-a159-d6d5c5a1df88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:20:43.635936 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19b5d9e-f70c-4835-a159-d6d5c5a1df88 service neutron] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:20:43.637126 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970a66ed-2875-43fe-abec-26e955304252 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f1dc79540b48c0866478cc48cd8205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:20:43.637992 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970a66ed-2875-43fe-abec-26e955304252 service neutron] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:20:43.638278 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970a66ed-2875-43fe-abec-26e955304252 service neutron] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:20:43.638553 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970a66ed-2875-43fe-abec-26e955304252 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:20:43.650838 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970a66ed-2875-43fe-abec-26e955304252 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:20:43.652377 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970a66ed-2875-43fe-abec-26e955304252 service neutron] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:20:43.664750 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 803/1623] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:20:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:20:43.665658 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970a66ed-2875-43fe-abec-26e955304252 service neutron] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:20:43.673829 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 821/1624] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:20:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:20:43.675249 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8655e29a-5f69-47ba-8612-2a1c3af7d7d9 None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:20:43.675541 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8655e29a-5f69-47ba-8612-2a1c3af7d7d9 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:20:43.675823 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8655e29a-5f69-47ba-8612-2a1c3af7d7d9 None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:20:43.678205 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970a66ed-2875-43fe-abec-26e955304252 service neutron] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:20:43.681046 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 822/1625] 10.222.0.70 () {54 vars in 912 bytes} [Tue May 10 19:20:43 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:20:43.683622 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b144347d-394a-45ca-bf6f-bd7daf467d47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:20:43.684504 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b144347d-394a-45ca-bf6f-bd7daf467d47 admin admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:20:43.684832 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b144347d-394a-45ca-bf6f-bd7daf467d47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:20:43.685110 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b144347d-394a-45ca-bf6f-bd7daf467d47 admin admin] PATH_INFO: `/v3/roles` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:20:43.685834 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b144347d-394a-45ca-bf6f-bd7daf467d47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:20:43.685960 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c9f8fd-2b4a-40b0-bfbb-bcdabf122c6d None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:20:43.686132 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c9f8fd-2b4a-40b0-bfbb-bcdabf122c6d None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:20:43.686407 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c9f8fd-2b4a-40b0-bfbb-bcdabf122c6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:20:43.687487 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b144347d-394a-45ca-bf6f-bd7daf467d47 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:20:43.702341 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 804/1626] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:20:43 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:20:43.705470 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b144347d-394a-45ca-bf6f-bd7daf467d47 admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:20:43.717254 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-31c9f8fd-2b4a-40b0-bfbb-bcdabf122c6d None None] MFA Rules not processed for user `b9f310a468ec4058b3c95356ea60ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:20:43.717982 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-31c9f8fd-2b4a-40b0-bfbb-bcdabf122c6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:20:43.723925 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b144347d-394a-45ca-bf6f-bd7daf467d47 admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:20:43.736976 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823f8b45-97b2-4da1-83aa-dba37cc7a369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:20:43.737884 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823f8b45-97b2-4da1-83aa-dba37cc7a369 admin admin] REQUEST_METHOD: `PUT` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:20:43.738186 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823f8b45-97b2-4da1-83aa-dba37cc7a369 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:20:43.738445 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823f8b45-97b2-4da1-83aa-dba37cc7a369 admin admin] PATH_INFO: `/v3/projects/dcabdfc9b23c48978db0597903dd9b32/users/ceb3eef9b11b47738cce0ebca8e12bb1/roles/634ba284303b4626b5a0402772c68f5c` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:20:43.743209 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823f8b45-97b2-4da1-83aa-dba37cc7a369 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcabdfc9b23c48978db0597903dd9b32, user_id=ceb3eef9b11b47738cce0ebca8e12bb1, role_id=634ba284303b4626b5a0402772c68f5c)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:20:43.745848 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823f8b45-97b2-4da1-83aa-dba37cc7a369 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:20:43.777398 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 805/1627] 10.222.0.70 () {60 vars in 1482 bytes} [Tue May 10 19:20:43 2022] PUT /identity/v3/projects/dcabdfc9b23c48978db0597903dd9b32/users/ceb3eef9b11b47738cce0ebca8e12bb1/roles/634ba284303b4626b5a0402772c68f5c => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:20:43.780365 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56021739-9706-40b5-96ce-a09fc674b9cf None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:20:43.780851 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56021739-9706-40b5-96ce-a09fc674b9cf None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:20:43.781133 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56021739-9706-40b5-96ce-a09fc674b9cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:20:43.790051 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 823/1628] 10.222.0.70 () {58 vars in 1009 bytes} [Tue May 10 19:20:43 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:20:43.803765 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c9f8fd-2b4a-40b0-bfbb-bcdabf122c6d None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:20:43.817930 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-56021739-9706-40b5-96ce-a09fc674b9cf None None] MFA Rules not processed for user `ceb3eef9b11b47738cce0ebca8e12bb1`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:20:43.819146 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-56021739-9706-40b5-96ce-a09fc674b9cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:20:43.877832 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c9f8fd-2b4a-40b0-bfbb-bcdabf122c6d None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:20:43.908455 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 806/1629] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:20:43 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:20:43.918201 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56021739-9706-40b5-96ce-a09fc674b9cf None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:20:43.932790 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0cf774-cfc9-444a-85e5-daaafedb34cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15df2a8967aa43299c10e365f4200d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:20:43.933711 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0cf774-cfc9-444a-85e5-daaafedb34cf service cinder] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:20:43.934087 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0cf774-cfc9-444a-85e5-daaafedb34cf service cinder] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:20:43.934458 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0cf774-cfc9-444a-85e5-daaafedb34cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:20:43.989696 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56021739-9706-40b5-96ce-a09fc674b9cf None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:20:43.994700 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fff276b-b03f-4cf2-85c6-6c88a027cb69 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15df2a8967aa43299c10e365f4200d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:20:43.995572 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fff276b-b03f-4cf2-85c6-6c88a027cb69 service cinder] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:20:43.995870 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fff276b-b03f-4cf2-85c6-6c88a027cb69 service cinder] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:20:43.996172 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fff276b-b03f-4cf2-85c6-6c88a027cb69 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:20:44.006687 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fff276b-b03f-4cf2-85c6-6c88a027cb69 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:20:44.008152 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fff276b-b03f-4cf2-85c6-6c88a027cb69 service cinder] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:20:44.021071 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 807/1630] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:20:43 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 19:20:44.025780 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0cf774-cfc9-444a-85e5-daaafedb34cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:20:44.027303 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0cf774-cfc9-444a-85e5-daaafedb34cf service cinder] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:20:44.039479 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 824/1631] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:20:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 19:20:44.273246 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fff276b-b03f-4cf2-85c6-6c88a027cb69 service cinder] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:20:44.283556 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fff276b-b03f-4cf2-85c6-6c88a027cb69 service cinder] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:20:44.289922 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4b30c4-65a8-4552-b8b7-3cfcba00872e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15df2a8967aa43299c10e365f4200d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:20:44.290908 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4b30c4-65a8-4552-b8b7-3cfcba00872e service cinder] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:20:44.291280 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4b30c4-65a8-4552-b8b7-3cfcba00872e service cinder] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:20:44.291632 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4b30c4-65a8-4552-b8b7-3cfcba00872e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:20:44.405760 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4b30c4-65a8-4552-b8b7-3cfcba00872e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:20:44.407200 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4b30c4-65a8-4552-b8b7-3cfcba00872e service cinder] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:20:44.422611 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 808/1632] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:20:44 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:20:44.673986 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dfa10d-05b2-4961-b159-11dc319701f3 None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:20:44.674164 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dfa10d-05b2-4961-b159-11dc319701f3 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:20:44.674530 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dfa10d-05b2-4961-b159-11dc319701f3 None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:20:44.676369 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 825/1633] 10.222.0.70 () {54 vars in 961 bytes} [Tue May 10 19:20:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:20:44.683475 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a1d4a6-67cd-4696-b6cd-edc50972a228 None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:20:44.684079 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a1d4a6-67cd-4696-b6cd-edc50972a228 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:20:44.684367 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a1d4a6-67cd-4696-b6cd-edc50972a228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:20:44.703190 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-11a1d4a6-67cd-4696-b6cd-edc50972a228 None None] MFA Rules not processed for user `b9f310a468ec4058b3c95356ea60ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:20:44.704394 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-11a1d4a6-67cd-4696-b6cd-edc50972a228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:20:44.715164 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 809/1634] 10.222.0.70 () {58 vars in 1058 bytes} [Tue May 10 19:20:44 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:20:44.722003 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96850efa-39e4-49a1-943d-0f17ec6c15e5 None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:20:44.722296 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96850efa-39e4-49a1-943d-0f17ec6c15e5 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:20:44.723029 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96850efa-39e4-49a1-943d-0f17ec6c15e5 None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:20:44.724556 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 826/1635] 10.222.0.70 () {54 vars in 912 bytes} [Tue May 10 19:20:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:20:44.737608 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfd8f7c-95d3-48e9-b521-6a978fbdb8ee None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:20:44.738049 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfd8f7c-95d3-48e9-b521-6a978fbdb8ee None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:20:44.738400 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfd8f7c-95d3-48e9-b521-6a978fbdb8ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:20:44.758619 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-3dfd8f7c-95d3-48e9-b521-6a978fbdb8ee None None] MFA Rules not processed for user `b9f310a468ec4058b3c95356ea60ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:20:44.760403 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-3dfd8f7c-95d3-48e9-b521-6a978fbdb8ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:20:44.777100 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 810/1636] 10.222.0.70 () {58 vars in 1009 bytes} [Tue May 10 19:20:44 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:20:44.790175 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96850efa-39e4-49a1-943d-0f17ec6c15e5 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:20:44.810454 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96850efa-39e4-49a1-943d-0f17ec6c15e5 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:20:44.825783 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5568fb7-bb3f-4201-a0c1-b3ad6752d17f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15df2a8967aa43299c10e365f4200d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:20:44.826810 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5568fb7-bb3f-4201-a0c1-b3ad6752d17f service cinder] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:20:44.827172 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5568fb7-bb3f-4201-a0c1-b3ad6752d17f service cinder] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:20:44.827501 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5568fb7-bb3f-4201-a0c1-b3ad6752d17f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:20:44.841575 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5568fb7-bb3f-4201-a0c1-b3ad6752d17f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:20:44.843253 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5568fb7-bb3f-4201-a0c1-b3ad6752d17f service cinder] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:20:44.855593 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 827/1637] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:20:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:20:45.357667 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d4bedd-8953-48e8-841d-357ac92d458d None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:20:45.358204 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d4bedd-8953-48e8-841d-357ac92d458d None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:20:45.358480 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d4bedd-8953-48e8-841d-357ac92d458d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:20:45.426416 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-98d4bedd-8953-48e8-841d-357ac92d458d None None] MFA Rules not processed for user `7081de6673aa463292118a0673959ea9`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:20:45.431077 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-98d4bedd-8953-48e8-841d-357ac92d458d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:20:45.565273 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 811/1638] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:20:45 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:20:45.578301 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ae5c97-2c57-47f7-92e8-898206c11ef7 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:20:45.578611 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ae5c97-2c57-47f7-92e8-898206c11ef7 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:20:45.578956 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ae5c97-2c57-47f7-92e8-898206c11ef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:20:45.608343 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-84ae5c97-2c57-47f7-92e8-898206c11ef7 None None] MFA Rules not processed for user `7081de6673aa463292118a0673959ea9`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:20:45.609540 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-84ae5c97-2c57-47f7-92e8-898206c11ef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:20:45.629695 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 828/1639] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:20:45 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:20:45.642852 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d4bedd-8953-48e8-841d-357ac92d458d None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:20:45.656780 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d4bedd-8953-48e8-841d-357ac92d458d None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:20:45.663156 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603c19cb-51c6-4658-99dd-1d73bad776da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9f310a468ec4058b3c95356ea60ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:20:45.663958 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603c19cb-51c6-4658-99dd-1d73bad776da service nova] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:20:45.664346 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603c19cb-51c6-4658-99dd-1d73bad776da service nova] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:20:45.664857 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603c19cb-51c6-4658-99dd-1d73bad776da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:20:45.673685 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603c19cb-51c6-4658-99dd-1d73bad776da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:20:45.675479 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603c19cb-51c6-4658-99dd-1d73bad776da service nova] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:20:45.701844 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 812/1640] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:20:45 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:20:46.649282 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f67e5b3-0fe8-4086-bf70-649530a31403 None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:20:46.650340 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f67e5b3-0fe8-4086-bf70-649530a31403 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:20:46.652171 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f67e5b3-0fe8-4086-bf70-649530a31403 None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:20:46.656966 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 829/1641] 10.222.0.70 () {54 vars in 912 bytes} [Tue May 10 19:20:46 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:20:46.662365 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389dd305-0310-4f34-8f82-18498ad6b8e5 None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:20:46.663069 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389dd305-0310-4f34-8f82-18498ad6b8e5 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:20:46.663616 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389dd305-0310-4f34-8f82-18498ad6b8e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:20:46.705301 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-389dd305-0310-4f34-8f82-18498ad6b8e5 None None] MFA Rules not processed for user `91f1dc79540b48c0866478cc48cd8205`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:20:46.707378 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-389dd305-0310-4f34-8f82-18498ad6b8e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:20:46.775793 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 813/1642] 10.222.0.70 () {58 vars in 1009 bytes} [Tue May 10 19:20:46 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:20:46.799668 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f67e5b3-0fe8-4086-bf70-649530a31403 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:20:46.821467 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f67e5b3-0fe8-4086-bf70-649530a31403 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:20:46.828321 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61810fc1-4adc-47cb-8006-94e2b4a23c20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f1dc79540b48c0866478cc48cd8205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:20:46.829562 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61810fc1-4adc-47cb-8006-94e2b4a23c20 service neutron] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:20:46.830149 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61810fc1-4adc-47cb-8006-94e2b4a23c20 service neutron] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:20:46.830974 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61810fc1-4adc-47cb-8006-94e2b4a23c20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:20:46.847998 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61810fc1-4adc-47cb-8006-94e2b4a23c20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:20:46.850253 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61810fc1-4adc-47cb-8006-94e2b4a23c20 service neutron] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:20:46.861157 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 830/1643] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:20:46 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:20:48.036644 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2175aecc-a8a4-4034-afcc-5cdc387fb697 None None] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:20:48.037732 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2175aecc-a8a4-4034-afcc-5cdc387fb697 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:20:48.038234 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2175aecc-a8a4-4034-afcc-5cdc387fb697 None None] PATH_INFO: `/` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:20:48.040340 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 814/1644] 10.222.0.70 () {54 vars in 960 bytes} [Tue May 10 19:20:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:20:48.047563 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40e8237-101f-46d9-88d7-ebe013d72019 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:20:48.048479 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40e8237-101f-46d9-88d7-ebe013d72019 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:20:48.049140 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40e8237-101f-46d9-88d7-ebe013d72019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:20:48.074204 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-e40e8237-101f-46d9-88d7-ebe013d72019 None None] MFA Rules not processed for user `11b95d3824f34cfcada6915ee57a7e08`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:20:48.076066 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-e40e8237-101f-46d9-88d7-ebe013d72019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:20:48.179111 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2175aecc-a8a4-4034-afcc-5cdc387fb697 None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:20:48.182962 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 831/1645] 10.222.0.70 () {58 vars in 1057 bytes} [Tue May 10 19:20:48 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:20:48.199873 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2175aecc-a8a4-4034-afcc-5cdc387fb697 None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:20:48.206959 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db078de6-a03e-47bf-8ef5-13825d02acfb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b95d3824f34cfcada6915ee57a7e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:20:48.208025 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db078de6-a03e-47bf-8ef5-13825d02acfb service placement] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:20:48.209550 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db078de6-a03e-47bf-8ef5-13825d02acfb service placement] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:20:48.210087 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db078de6-a03e-47bf-8ef5-13825d02acfb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:20:48.212467 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-db078de6-a03e-47bf-8ef5-13825d02acfb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:20:48.229758 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db078de6-a03e-47bf-8ef5-13825d02acfb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:20:48.231431 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db078de6-a03e-47bf-8ef5-13825d02acfb service placement] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:20:48.244819 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 815/1646] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:20:48 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 19:20:51.632825 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40e8237-101f-46d9-88d7-ebe013d72019 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:20:51.774937 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40e8237-101f-46d9-88d7-ebe013d72019 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:20:51.789019 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1426e273-2cfb-4187-bfe1-1de8a0abe895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:20:51.789960 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1426e273-2cfb-4187-bfe1-1de8a0abe895 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:20:51.790388 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1426e273-2cfb-4187-bfe1-1de8a0abe895 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:20:51.790672 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1426e273-2cfb-4187-bfe1-1de8a0abe895 admin admin] PATH_INFO: `/v3/users/f18fcb5814b24a049f00bfac8209175f` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:20:51.794573 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1426e273-2cfb-4187-bfe1-1de8a0abe895 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f18fcb5814b24a049f00bfac8209175f)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:20:51.795641 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: WARNING py.warnings [None req-1426e273-2cfb-4187-bfe1-1de8a0abe895 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 10 19:20:51.795641 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: warnings.warn(msg) May 10 19:20:51.795641 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: May 10 19:20:51.799474 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1426e273-2cfb-4187-bfe1-1de8a0abe895 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:20:52.016808 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-1426e273-2cfb-4187-bfe1-1de8a0abe895 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f18fcb5814b24a049f00bfac8209175f'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:20:52.067641 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-1426e273-2cfb-4187-bfe1-1de8a0abe895 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f18fcb5814b24a049f00bfac8209175f'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:20:52.068397 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-1426e273-2cfb-4187-bfe1-1de8a0abe895 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f18fcb5814b24a049f00bfac8209175f'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:20:52.083813 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-1426e273-2cfb-4187-bfe1-1de8a0abe895 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f18fcb5814b24a049f00bfac8209175f'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:20:52.106340 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-1426e273-2cfb-4187-bfe1-1de8a0abe895 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f18fcb5814b24a049f00bfac8209175f'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:20:52.118403 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 832/1647] 10.222.0.70 () {58 vars in 1223 bytes} [Tue May 10 19:20:51 2022] DELETE /identity/v3/users/f18fcb5814b24a049f00bfac8209175f => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:20:52.123535 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae319ca5-6160-4da9-a166-726e30ec084d None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:20:52.124029 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae319ca5-6160-4da9-a166-726e30ec084d None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:20:52.124208 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae319ca5-6160-4da9-a166-726e30ec084d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:20:52.157356 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-ae319ca5-6160-4da9-a166-726e30ec084d None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:20:52.158592 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-ae319ca5-6160-4da9-a166-726e30ec084d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:20:52.271957 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 816/1648] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:20:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:20:52.310388 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1426e273-2cfb-4187-bfe1-1de8a0abe895 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:20:52.312743 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-1426e273-2cfb-4187-bfe1-1de8a0abe895 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:20:52.440360 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1426e273-2cfb-4187-bfe1-1de8a0abe895 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:20:52.460747 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a931b885-9725-4ec1-9ce6-a28d4499b50d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f1dc79540b48c0866478cc48cd8205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:20:52.461487 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a931b885-9725-4ec1-9ce6-a28d4499b50d service neutron] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:20:52.461774 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a931b885-9725-4ec1-9ce6-a28d4499b50d service neutron] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:20:52.462053 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a931b885-9725-4ec1-9ce6-a28d4499b50d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:20:52.487146 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a931b885-9725-4ec1-9ce6-a28d4499b50d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:20:52.490455 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a931b885-9725-4ec1-9ce6-a28d4499b50d service neutron] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:20:52.524700 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 833/1649] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:20:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:20:54.190075 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1dca35-32e5-452e-848f-90350e175f29 None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:20:54.190547 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1dca35-32e5-452e-848f-90350e175f29 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:20:54.190704 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1dca35-32e5-452e-848f-90350e175f29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:20:54.224003 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-aa1dca35-32e5-452e-848f-90350e175f29 None None] MFA Rules not processed for user `058e52f1bf0b4aba965d945815d4acb3`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:20:54.230525 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-aa1dca35-32e5-452e-848f-90350e175f29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:20:54.390748 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 817/1650] 10.222.0.70 () {58 vars in 1009 bytes} [Tue May 10 19:20:54 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:20:54.791543 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a931b885-9725-4ec1-9ce6-a28d4499b50d service neutron] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:20:54.794643 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-a931b885-9725-4ec1-9ce6-a28d4499b50d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:20:55.058255 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a931b885-9725-4ec1-9ce6-a28d4499b50d service neutron] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:20:55.079590 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862813a2-a919-446a-95db-aa2fba3b0bf7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0454aa03fa31487ea1464b9d0008212c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:20:55.080271 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862813a2-a919-446a-95db-aa2fba3b0bf7 service swift] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:20:55.080721 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862813a2-a919-446a-95db-aa2fba3b0bf7 service swift] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:20:55.081008 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862813a2-a919-446a-95db-aa2fba3b0bf7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:20:55.117796 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862813a2-a919-446a-95db-aa2fba3b0bf7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:20:55.117796 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862813a2-a919-446a-95db-aa2fba3b0bf7 service swift] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:20:55.157078 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 834/1651] 10.222.0.70 () {60 vars in 1384 bytes} [Tue May 10 19:20:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 19:20:56.095255 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1dca35-32e5-452e-848f-90350e175f29 None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:20:56.096864 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-aa1dca35-32e5-452e-848f-90350e175f29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:20:56.144540 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1dca35-32e5-452e-848f-90350e175f29 None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:20:56.155478 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763e8880-cba0-4651-b653-bde2f0a2db3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:20:56.156381 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763e8880-cba0-4651-b653-bde2f0a2db3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:20:56.157082 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763e8880-cba0-4651-b653-bde2f0a2db3f admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:20:56.157518 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763e8880-cba0-4651-b653-bde2f0a2db3f admin admin] PATH_INFO: `/v3/projects/f128bb7b2cb14b47bc0226972d09bdcc` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:20:56.159228 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862813a2-a919-446a-95db-aa2fba3b0bf7 service swift] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:20:56.160533 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763e8880-cba0-4651-b653-bde2f0a2db3f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f128bb7b2cb14b47bc0226972d09bdcc)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:20:56.161408 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-862813a2-a919-446a-95db-aa2fba3b0bf7 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:20:56.161925 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: WARNING py.warnings [None req-763e8880-cba0-4651-b653-bde2f0a2db3f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 10 19:20:56.161925 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: warnings.warn(msg) May 10 19:20:56.161925 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: May 10 19:20:56.165108 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763e8880-cba0-4651-b653-bde2f0a2db3f admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:20:56.206221 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862813a2-a919-446a-95db-aa2fba3b0bf7 service swift] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:20:56.225282 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b951120-d373-4c38-b803-35532bdba8ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:20:56.226192 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b951120-d373-4c38-b803-35532bdba8ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:20:56.226477 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b951120-d373-4c38-b803-35532bdba8ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:20:56.226756 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b951120-d373-4c38-b803-35532bdba8ee admin admin] PATH_INFO: `/v3/users/c141278987f64fc7a55ba62bca6f403c` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:20:56.238308 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b951120-d373-4c38-b803-35532bdba8ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=c141278987f64fc7a55ba62bca6f403c)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:20:56.244982 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b951120-d373-4c38-b803-35532bdba8ee admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:20:56.389859 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-763e8880-cba0-4651-b653-bde2f0a2db3f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f128bb7b2cb14b47bc0226972d09bdcc', 'request_id': 'req-763e8880-cba0-4651-b653-bde2f0a2db3f'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:20:56.415518 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-763e8880-cba0-4651-b653-bde2f0a2db3f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f128bb7b2cb14b47bc0226972d09bdcc', 'request_id': 'req-763e8880-cba0-4651-b653-bde2f0a2db3f'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:20:56.432826 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-763e8880-cba0-4651-b653-bde2f0a2db3f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f128bb7b2cb14b47bc0226972d09bdcc', 'request_id': 'req-763e8880-cba0-4651-b653-bde2f0a2db3f'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:20:56.449351 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-0b951120-d373-4c38-b803-35532bdba8ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c141278987f64fc7a55ba62bca6f403c'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:20:56.496786 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-0b951120-d373-4c38-b803-35532bdba8ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c141278987f64fc7a55ba62bca6f403c'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:20:56.498831 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-0b951120-d373-4c38-b803-35532bdba8ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c141278987f64fc7a55ba62bca6f403c'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:20:56.521510 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-0b951120-d373-4c38-b803-35532bdba8ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c141278987f64fc7a55ba62bca6f403c'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:20:56.530804 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-763e8880-cba0-4651-b653-bde2f0a2db3f admin admin] The token cache is being invalidate because project f128bb7b2cb14b47bc0226972d09bdcc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79993) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:20:56.531343 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-763e8880-cba0-4651-b653-bde2f0a2db3f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:20:56.533057 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-763e8880-cba0-4651-b653-bde2f0a2db3f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:20:56.536230 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 818/1652] 10.222.0.70 () {58 vars in 1232 bytes} [Tue May 10 19:20:56 2022] DELETE /identity/v3/projects/f128bb7b2cb14b47bc0226972d09bdcc => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:20:56.541577 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d66f32-ee0f-4944-b452-a48a8a5b48e0 None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:20:56.542505 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-0b951120-d373-4c38-b803-35532bdba8ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c141278987f64fc7a55ba62bca6f403c'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:20:56.542954 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d66f32-ee0f-4944-b452-a48a8a5b48e0 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:20:56.543582 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d66f32-ee0f-4944-b452-a48a8a5b48e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:20:56.578682 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 835/1653] 10.222.0.70 () {58 vars in 1223 bytes} [Tue May 10 19:20:56 2022] DELETE /identity/v3/users/c141278987f64fc7a55ba62bca6f403c => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:20:56.585173 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dd758c-31db-4e1a-aece-47598ffe2863 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:20:56.587231 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dd758c-31db-4e1a-aece-47598ffe2863 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:20:56.588523 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dd758c-31db-4e1a-aece-47598ffe2863 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:20:56.635518 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-93d66f32-ee0f-4944-b452-a48a8a5b48e0 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:20:56.636799 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-93d66f32-ee0f-4944-b452-a48a8a5b48e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:20:56.667821 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-c9dd758c-31db-4e1a-aece-47598ffe2863 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:20:56.670342 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-c9dd758c-31db-4e1a-aece-47598ffe2863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:20:56.861728 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 819/1654] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:20:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:20:56.863255 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803ee1fc-dc41-40af-a055-398d4d8a6917 None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:20:56.863546 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803ee1fc-dc41-40af-a055-398d4d8a6917 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:20:56.866700 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803ee1fc-dc41-40af-a055-398d4d8a6917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:20:56.951281 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-803ee1fc-dc41-40af-a055-398d4d8a6917 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:20:56.951534 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 836/1655] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:20:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 368 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:20:56.954281 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-803ee1fc-dc41-40af-a055-398d4d8a6917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:20:56.981810 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dd758c-31db-4e1a-aece-47598ffe2863 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:20:56.989099 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 820/1656] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:20:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:20:56.999455 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dd758c-31db-4e1a-aece-47598ffe2863 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:20:57.005788 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c97887-d520-41f1-8b8e-a7b40ac8fa73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:20:57.006970 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c97887-d520-41f1-8b8e-a7b40ac8fa73 admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:20:57.007387 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c97887-d520-41f1-8b8e-a7b40ac8fa73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:20:57.007801 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c97887-d520-41f1-8b8e-a7b40ac8fa73 admin admin] PATH_INFO: `/v3/domains` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:20:57.008792 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c97887-d520-41f1-8b8e-a7b40ac8fa73 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:20:57.009256 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c97887-d520-41f1-8b8e-a7b40ac8fa73 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:20:57.011704 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c97887-d520-41f1-8b8e-a7b40ac8fa73 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:20:57.028545 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803ee1fc-dc41-40af-a055-398d4d8a6917 None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:20:57.030165 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-803ee1fc-dc41-40af-a055-398d4d8a6917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:20:57.038972 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 837/1657] 10.222.0.70 () {58 vars in 1152 bytes} [Tue May 10 19:20:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:20:57.039902 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c97887-d520-41f1-8b8e-a7b40ac8fa73 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:20:57.064334 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c97887-d520-41f1-8b8e-a7b40ac8fa73 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:20:57.074309 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a51f09b-0795-4229-971f-f40fcd6d78c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:20:57.075139 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a51f09b-0795-4229-971f-f40fcd6d78c7 admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:20:57.075423 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a51f09b-0795-4229-971f-f40fcd6d78c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:20:57.078286 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a51f09b-0795-4229-971f-f40fcd6d78c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:20:57.079022 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a51f09b-0795-4229-971f-f40fcd6d78c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:20:57.096343 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a51f09b-0795-4229-971f-f40fcd6d78c7 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:20:57.206242 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 838/1658] 10.222.0.70 () {60 vars in 1152 bytes} [Tue May 10 19:20:57 2022] POST /identity/v3/projects => generated 357 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:20:57.207520 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a51f09b-0795-4229-971f-f40fcd6d78c7 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:20:57.212401 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-5a51f09b-0795-4229-971f-f40fcd6d78c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:20:57.219320 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803ee1fc-dc41-40af-a055-398d4d8a6917 None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:20:57.346576 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbcc969-4c79-4281-82ea-cb79f30217c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f1dc79540b48c0866478cc48cd8205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:20:57.347496 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbcc969-4c79-4281-82ea-cb79f30217c3 service neutron] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:20:57.347939 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbcc969-4c79-4281-82ea-cb79f30217c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:20:57.348373 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbcc969-4c79-4281-82ea-cb79f30217c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:20:57.384690 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a51f09b-0795-4229-971f-f40fcd6d78c7 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:20:57.398782 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3b3c5b-ca4f-4509-8cd0-6434e60e4bfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:20:57.400005 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3b3c5b-ca4f-4509-8cd0-6434e60e4bfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:20:57.400511 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3b3c5b-ca4f-4509-8cd0-6434e60e4bfd admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:20:57.400922 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3b3c5b-ca4f-4509-8cd0-6434e60e4bfd admin admin] PATH_INFO: `/v3/users/9b440b092de246199794536a17a71cf6` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:20:57.402777 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3b3c5b-ca4f-4509-8cd0-6434e60e4bfd admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b440b092de246199794536a17a71cf6)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:20:57.405763 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3b3c5b-ca4f-4509-8cd0-6434e60e4bfd admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:20:57.486697 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-6b3b3c5b-ca4f-4509-8cd0-6434e60e4bfd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b440b092de246199794536a17a71cf6'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:20:57.521257 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-6b3b3c5b-ca4f-4509-8cd0-6434e60e4bfd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b440b092de246199794536a17a71cf6'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:20:57.522944 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-6b3b3c5b-ca4f-4509-8cd0-6434e60e4bfd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b440b092de246199794536a17a71cf6'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:20:57.538574 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbcc969-4c79-4281-82ea-cb79f30217c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:20:57.540575 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbcc969-4c79-4281-82ea-cb79f30217c3 service neutron] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:20:57.549553 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-6b3b3c5b-ca4f-4509-8cd0-6434e60e4bfd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b440b092de246199794536a17a71cf6'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:20:57.577937 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-6b3b3c5b-ca4f-4509-8cd0-6434e60e4bfd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b440b092de246199794536a17a71cf6'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:20:57.585511 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 821/1659] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:20:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 558 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 19:20:57.586712 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbcc969-4c79-4281-82ea-cb79f30217c3 service neutron] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:20:57.590085 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 839/1660] 10.222.0.70 () {58 vars in 1223 bytes} [Tue May 10 19:20:57 2022] DELETE /identity/v3/users/9b440b092de246199794536a17a71cf6 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:20:57.597105 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b11a86a-215f-43dd-bdd1-2c96a8ab1ebe None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:20:57.597769 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b11a86a-215f-43dd-bdd1-2c96a8ab1ebe None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:20:57.597965 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b11a86a-215f-43dd-bdd1-2c96a8ab1ebe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:20:57.623874 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbcc969-4c79-4281-82ea-cb79f30217c3 service neutron] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:20:57.636089 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-9b11a86a-215f-43dd-bdd1-2c96a8ab1ebe None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:20:57.638061 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-9b11a86a-215f-43dd-bdd1-2c96a8ab1ebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:20:57.734600 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 840/1661] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:20:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:20:57.828009 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c872c5e-b04a-43ad-a632-c0c05a8dd7ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:20:57.837011 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c872c5e-b04a-43ad-a632-c0c05a8dd7ec admin admin] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:20:57.837306 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c872c5e-b04a-43ad-a632-c0c05a8dd7ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:20:57.837587 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c872c5e-b04a-43ad-a632-c0c05a8dd7ec admin admin] PATH_INFO: `/v3/users` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:20:57.838331 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c872c5e-b04a-43ad-a632-c0c05a8dd7ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:20:57.843752 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c872c5e-b04a-43ad-a632-c0c05a8dd7ec admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:20:57.925671 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 822/1662] 10.222.0.70 () {60 vars in 1143 bytes} [Tue May 10 19:20:57 2022] POST /identity/v3/users => generated 279 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:20:57.930019 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b11a86a-215f-43dd-bdd1-2c96a8ab1ebe None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:20:57.931891 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-9b11a86a-215f-43dd-bdd1-2c96a8ab1ebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:20:57.952822 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b11a86a-215f-43dd-bdd1-2c96a8ab1ebe None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:20:57.990605 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc8bc90-8f21-4e8b-9532-19f2c29a674f None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:20:57.991106 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc8bc90-8f21-4e8b-9532-19f2c29a674f None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:20:57.991538 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc8bc90-8f21-4e8b-9532-19f2c29a674f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:20:57.992460 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5599b8a-966f-44ee-a2e2-8ae4df9d9c49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:20:57.993158 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5599b8a-966f-44ee-a2e2-8ae4df9d9c49 admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:20:57.993444 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5599b8a-966f-44ee-a2e2-8ae4df9d9c49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:20:57.993715 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5599b8a-966f-44ee-a2e2-8ae4df9d9c49 admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:20:57.994684 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5599b8a-966f-44ee-a2e2-8ae4df9d9c49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:20:57.996548 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5599b8a-966f-44ee-a2e2-8ae4df9d9c49 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:20:58.050656 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 841/1663] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:20:57 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 19:20:58.055453 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5599b8a-966f-44ee-a2e2-8ae4df9d9c49 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:20:58.055913 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-6cc8bc90-8f21-4e8b-9532-19f2c29a674f None None] MFA Rules not processed for user `90bbeed46811450f953507e570a2bd94`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:20:58.057267 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-6cc8bc90-8f21-4e8b-9532-19f2c29a674f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:20:58.082935 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5599b8a-966f-44ee-a2e2-8ae4df9d9c49 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:20:58.109108 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd1f95d-caa1-4930-835f-cd77b74c86fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:20:58.109796 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd1f95d-caa1-4930-835f-cd77b74c86fd admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:20:58.110078 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd1f95d-caa1-4930-835f-cd77b74c86fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:20:58.110356 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd1f95d-caa1-4930-835f-cd77b74c86fd admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:20:58.111197 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd1f95d-caa1-4930-835f-cd77b74c86fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:20:58.112780 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd1f95d-caa1-4930-835f-cd77b74c86fd admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:20:58.153422 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 842/1664] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:20:58 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 19:20:58.167019 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd1f95d-caa1-4930-835f-cd77b74c86fd admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:20:58.202828 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd1f95d-caa1-4930-835f-cd77b74c86fd admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:20:58.224306 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 823/1665] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:20:57 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:20:58.231233 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eaa759-1281-4e98-b6b8-32c4e429ef6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:20:58.238649 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc8bc90-8f21-4e8b-9532-19f2c29a674f None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:20:58.240522 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-6cc8bc90-8f21-4e8b-9532-19f2c29a674f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:20:58.242123 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eaa759-1281-4e98-b6b8-32c4e429ef6c admin admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:20:58.242835 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eaa759-1281-4e98-b6b8-32c4e429ef6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:20:58.242835 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eaa759-1281-4e98-b6b8-32c4e429ef6c admin admin] PATH_INFO: `/v3/projects/a2de3d1d79b14856ac7ebcc4aa70b498/users/7cd5123a16534644a042f82b280884c3/roles/5c07cf5bfbd3427db18428aa50420962` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:20:58.288073 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63eaa759-1281-4e98-b6b8-32c4e429ef6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2de3d1d79b14856ac7ebcc4aa70b498, user_id=7cd5123a16534644a042f82b280884c3, role_id=5c07cf5bfbd3427db18428aa50420962)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:20:58.290828 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63eaa759-1281-4e98-b6b8-32c4e429ef6c admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:20:58.340826 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 843/1666] 10.222.0.70 () {60 vars in 1482 bytes} [Tue May 10 19:20:58 2022] PUT /identity/v3/projects/a2de3d1d79b14856ac7ebcc4aa70b498/users/7cd5123a16534644a042f82b280884c3/roles/5c07cf5bfbd3427db18428aa50420962 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:20:58.340826 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eaa759-1281-4e98-b6b8-32c4e429ef6c admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:20:58.342375 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-63eaa759-1281-4e98-b6b8-32c4e429ef6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:20:58.459322 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc8bc90-8f21-4e8b-9532-19f2c29a674f None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:20:58.489335 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eaa759-1281-4e98-b6b8-32c4e429ef6c admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:20:58.499660 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b16439-632a-4e6e-b35b-73ea154dda1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f1dc79540b48c0866478cc48cd8205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:20:58.500345 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b16439-632a-4e6e-b35b-73ea154dda1b service neutron] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:20:58.502666 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b16439-632a-4e6e-b35b-73ea154dda1b service neutron] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:20:58.502955 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b16439-632a-4e6e-b35b-73ea154dda1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:20:58.600241 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c624e8-e3aa-4ba7-9aa0-69036e77e01e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9f310a468ec4058b3c95356ea60ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:20:58.601308 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c624e8-e3aa-4ba7-9aa0-69036e77e01e service nova] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:20:58.603274 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c624e8-e3aa-4ba7-9aa0-69036e77e01e service nova] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:20:58.604605 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c624e8-e3aa-4ba7-9aa0-69036e77e01e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:20:58.672853 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b16439-632a-4e6e-b35b-73ea154dda1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:20:58.689601 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b16439-632a-4e6e-b35b-73ea154dda1b service neutron] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:20:58.720492 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 844/1667] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:20:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:20:58.723602 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdddefc8-951d-4a25-a9dc-811b3d64d3ec None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:20:58.727638 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdddefc8-951d-4a25-a9dc-811b3d64d3ec None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:20:58.728022 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdddefc8-951d-4a25-a9dc-811b3d64d3ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:20:58.750735 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c624e8-e3aa-4ba7-9aa0-69036e77e01e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:20:58.752473 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c624e8-e3aa-4ba7-9aa0-69036e77e01e service nova] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:20:58.794441 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 824/1668] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:20:58 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 556 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:20:58.856253 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-bdddefc8-951d-4a25-a9dc-811b3d64d3ec None None] MFA Rules not processed for user `7cd5123a16534644a042f82b280884c3`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:20:58.865421 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-bdddefc8-951d-4a25-a9dc-811b3d64d3ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:20:59.180034 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 845/1669] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:20:58 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 459 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:20:59.184217 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c624e8-e3aa-4ba7-9aa0-69036e77e01e service nova] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:20:59.201304 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c624e8-e3aa-4ba7-9aa0-69036e77e01e service nova] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:20:59.223222 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711714b2-2dd7-413d-a883-182eea27ddad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:20:59.224040 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711714b2-2dd7-413d-a883-182eea27ddad admin admin] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:20:59.224343 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711714b2-2dd7-413d-a883-182eea27ddad admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:20:59.232976 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711714b2-2dd7-413d-a883-182eea27ddad admin admin] PATH_INFO: `/v3/projects` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:20:59.233763 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711714b2-2dd7-413d-a883-182eea27ddad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:20:59.238692 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711714b2-2dd7-413d-a883-182eea27ddad admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:20:59.331378 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 825/1670] 10.222.0.70 () {60 vars in 1152 bytes} [Tue May 10 19:20:59 2022] POST /identity/v3/projects => generated 357 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 19:20:59.335573 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdddefc8-951d-4a25-a9dc-811b3d64d3ec None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:20:59.355159 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdddefc8-951d-4a25-a9dc-811b3d64d3ec None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:20:59.575050 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dc5b19-d8dc-4044-9a91-493825a15449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:20:59.575996 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dc5b19-d8dc-4044-9a91-493825a15449 admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:20:59.576280 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dc5b19-d8dc-4044-9a91-493825a15449 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:20:59.576586 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dc5b19-d8dc-4044-9a91-493825a15449 admin admin] PATH_INFO: `/v3/users` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:20:59.577291 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dc5b19-d8dc-4044-9a91-493825a15449 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:20:59.579237 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dc5b19-d8dc-4044-9a91-493825a15449 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:20:59.650257 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 846/1671] 10.222.0.70 () {60 vars in 1143 bytes} [Tue May 10 19:20:59 2022] POST /identity/v3/users => generated 285 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:20:59.651199 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711714b2-2dd7-413d-a883-182eea27ddad admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:20:59.667371 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711714b2-2dd7-413d-a883-182eea27ddad admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:20:59.682553 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35372886-0a63-4600-bba6-2955e71826ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:20:59.683254 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35372886-0a63-4600-bba6-2955e71826ad admin admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:20:59.683541 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35372886-0a63-4600-bba6-2955e71826ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:20:59.683852 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35372886-0a63-4600-bba6-2955e71826ad admin admin] PATH_INFO: `/v3/roles` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:20:59.690712 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35372886-0a63-4600-bba6-2955e71826ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:20:59.693958 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35372886-0a63-4600-bba6-2955e71826ad admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:20:59.724753 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 826/1672] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:20:59 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:20:59.728561 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dc5b19-d8dc-4044-9a91-493825a15449 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:20:59.754913 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dc5b19-d8dc-4044-9a91-493825a15449 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:20:59.794694 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8550833-3600-40f6-96b2-2829171b1579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:20:59.797729 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8550833-3600-40f6-96b2-2829171b1579 admin admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:20:59.800461 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8550833-3600-40f6-96b2-2829171b1579 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:20:59.802916 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8550833-3600-40f6-96b2-2829171b1579 admin admin] PATH_INFO: `/v3/projects/9a9504957ba04447aab8bcb83d9fa8d6/users/2ea0890674e445ceb6111e63a4552dd3/roles/634ba284303b4626b5a0402772c68f5c` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:20:59.861888 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8550833-3600-40f6-96b2-2829171b1579 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a9504957ba04447aab8bcb83d9fa8d6, user_id=2ea0890674e445ceb6111e63a4552dd3, role_id=634ba284303b4626b5a0402772c68f5c)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:20:59.866030 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8550833-3600-40f6-96b2-2829171b1579 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:20:59.896830 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 847/1673] 10.222.0.70 () {60 vars in 1482 bytes} [Tue May 10 19:20:59 2022] PUT /identity/v3/projects/9a9504957ba04447aab8bcb83d9fa8d6/users/2ea0890674e445ceb6111e63a4552dd3/roles/634ba284303b4626b5a0402772c68f5c => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:20:59.900589 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35372886-0a63-4600-bba6-2955e71826ad admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:20:59.917990 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35372886-0a63-4600-bba6-2955e71826ad admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:00.084392 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d58494-4ca9-4647-8d27-0ff3a73901c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:00.085552 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d58494-4ca9-4647-8d27-0ff3a73901c8 admin admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:00.088323 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d58494-4ca9-4647-8d27-0ff3a73901c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:00.088813 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d58494-4ca9-4647-8d27-0ff3a73901c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:00.093340 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d58494-4ca9-4647-8d27-0ff3a73901c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:00.097496 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d58494-4ca9-4647-8d27-0ff3a73901c8 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:00.143297 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 827/1674] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:20:59 2022] GET /identity/v3/roles => generated 1420 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:21:00.146616 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8550833-3600-40f6-96b2-2829171b1579 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:00.172505 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8550833-3600-40f6-96b2-2829171b1579 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:00.192052 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1cef22-8229-4ed4-a971-b8ab6177b661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:00.193063 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1cef22-8229-4ed4-a971-b8ab6177b661 admin admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:00.193344 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1cef22-8229-4ed4-a971-b8ab6177b661 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:00.193621 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1cef22-8229-4ed4-a971-b8ab6177b661 admin admin] PATH_INFO: `/v3/projects/9a9504957ba04447aab8bcb83d9fa8d6/users/2ea0890674e445ceb6111e63a4552dd3/roles/634ba284303b4626b5a0402772c68f5c` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:00.201051 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1cef22-8229-4ed4-a971-b8ab6177b661 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a9504957ba04447aab8bcb83d9fa8d6, user_id=2ea0890674e445ceb6111e63a4552dd3, role_id=634ba284303b4626b5a0402772c68f5c)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:00.213095 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1cef22-8229-4ed4-a971-b8ab6177b661 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:00.254284 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 848/1675] 10.222.0.70 () {60 vars in 1482 bytes} [Tue May 10 19:21:00 2022] PUT /identity/v3/projects/9a9504957ba04447aab8bcb83d9fa8d6/users/2ea0890674e445ceb6111e63a4552dd3/roles/634ba284303b4626b5a0402772c68f5c => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:21:00.264553 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e9ad38-022f-4053-b248-dfa3aa02c93c None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:00.265080 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e9ad38-022f-4053-b248-dfa3aa02c93c None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:00.265164 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e9ad38-022f-4053-b248-dfa3aa02c93c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:00.338286 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-b1e9ad38-022f-4053-b248-dfa3aa02c93c None None] MFA Rules not processed for user `2ea0890674e445ceb6111e63a4552dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:21:00.339536 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-b1e9ad38-022f-4053-b248-dfa3aa02c93c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:21:00.559114 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 828/1676] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:21:00 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:21:00.575465 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1cef22-8229-4ed4-a971-b8ab6177b661 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:00.578807 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-bd1cef22-8229-4ed4-a971-b8ab6177b661 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:21:00.810196 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1cef22-8229-4ed4-a971-b8ab6177b661 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:00.829735 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582cf2c7-89a1-41a3-8b60-79741a3ca1b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15df2a8967aa43299c10e365f4200d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:00.830419 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582cf2c7-89a1-41a3-8b60-79741a3ca1b7 service cinder] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:00.830702 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582cf2c7-89a1-41a3-8b60-79741a3ca1b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:00.830978 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582cf2c7-89a1-41a3-8b60-79741a3ca1b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:00.862522 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582cf2c7-89a1-41a3-8b60-79741a3ca1b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:00.873710 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13038fd0-19f1-4a3c-b961-0bd800ffa163 None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:00.874058 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13038fd0-19f1-4a3c-b961-0bd800ffa163 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:00.874413 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13038fd0-19f1-4a3c-b961-0bd800ffa163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:00.879296 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582cf2c7-89a1-41a3-8b60-79741a3ca1b7 service cinder] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:00.931594 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 849/1677] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:21:00 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:21:00.935466 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-13038fd0-19f1-4a3c-b961-0bd800ffa163 None None] MFA Rules not processed for user `91f1dc79540b48c0866478cc48cd8205`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:21:00.940900 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-13038fd0-19f1-4a3c-b961-0bd800ffa163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:21:01.084316 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582cf2c7-89a1-41a3-8b60-79741a3ca1b7 service cinder] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:01.094088 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582cf2c7-89a1-41a3-8b60-79741a3ca1b7 service cinder] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:01.110453 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a05357e-d947-4d82-ae90-90e87e2f3bc8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15df2a8967aa43299c10e365f4200d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:01.112747 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a05357e-d947-4d82-ae90-90e87e2f3bc8 service cinder] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:01.113954 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a05357e-d947-4d82-ae90-90e87e2f3bc8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:01.118882 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a05357e-d947-4d82-ae90-90e87e2f3bc8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:01.201658 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 829/1678] 10.222.0.73 () {58 vars in 1015 bytes} [Tue May 10 19:21:00 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:21:01.287660 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a05357e-d947-4d82-ae90-90e87e2f3bc8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:01.289292 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a05357e-d947-4d82-ae90-90e87e2f3bc8 service cinder] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:01.315259 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 850/1679] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:21:01 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 19:21:01.357695 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13038fd0-19f1-4a3c-b961-0bd800ffa163 None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:01.359179 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-13038fd0-19f1-4a3c-b961-0bd800ffa163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:21:01.517982 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e9a6a3-8555-404a-a9e1-8c8dc4cf9101 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:01.518443 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e9a6a3-8555-404a-a9e1-8c8dc4cf9101 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:01.518728 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e9a6a3-8555-404a-a9e1-8c8dc4cf9101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:01.547468 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13038fd0-19f1-4a3c-b961-0bd800ffa163 None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:01.553604 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd463d7-99c7-414b-9866-8b8bc1c16cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:01.555094 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd463d7-99c7-414b-9866-8b8bc1c16cd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:01.555547 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd463d7-99c7-414b-9866-8b8bc1c16cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:01.555973 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd463d7-99c7-414b-9866-8b8bc1c16cd9 admin admin] PATH_INFO: `/v3/projects/a2b9c0e8217b473296fcf3c5779cfaee` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:01.557951 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd463d7-99c7-414b-9866-8b8bc1c16cd9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2b9c0e8217b473296fcf3c5779cfaee)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:01.572602 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd463d7-99c7-414b-9866-8b8bc1c16cd9 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:01.584888 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-25e9a6a3-8555-404a-a9e1-8c8dc4cf9101 None None] MFA Rules not processed for user `db6fd87ab33946808f4153585fc1d07a`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:21:01.591972 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-25e9a6a3-8555-404a-a9e1-8c8dc4cf9101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:21:01.731712 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-5fd463d7-99c7-414b-9866-8b8bc1c16cd9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2b9c0e8217b473296fcf3c5779cfaee', 'request_id': 'req-5fd463d7-99c7-414b-9866-8b8bc1c16cd9'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:01.748461 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-5fd463d7-99c7-414b-9866-8b8bc1c16cd9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2b9c0e8217b473296fcf3c5779cfaee', 'request_id': 'req-5fd463d7-99c7-414b-9866-8b8bc1c16cd9'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:01.762936 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-5fd463d7-99c7-414b-9866-8b8bc1c16cd9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2b9c0e8217b473296fcf3c5779cfaee', 'request_id': 'req-5fd463d7-99c7-414b-9866-8b8bc1c16cd9'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:01.819912 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-5fd463d7-99c7-414b-9866-8b8bc1c16cd9 admin admin] The token cache is being invalidate because project a2b9c0e8217b473296fcf3c5779cfaee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79993) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:21:01.820652 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-5fd463d7-99c7-414b-9866-8b8bc1c16cd9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:01.823178 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-5fd463d7-99c7-414b-9866-8b8bc1c16cd9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:01.829378 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 830/1680] 10.222.0.70 () {58 vars in 1232 bytes} [Tue May 10 19:21:01 2022] DELETE /identity/v3/projects/a2b9c0e8217b473296fcf3c5779cfaee => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:21:01.830880 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd463d7-99c7-414b-9866-8b8bc1c16cd9 admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:01.840930 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-5fd463d7-99c7-414b-9866-8b8bc1c16cd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:21:01.858243 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 851/1681] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:21:01 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:21:01.861822 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9ea0f3-54d3-4920-a5c3-575e76d3008b None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:01.863148 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9ea0f3-54d3-4920-a5c3-575e76d3008b None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:01.863655 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9ea0f3-54d3-4920-a5c3-575e76d3008b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:01.954471 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-ed9ea0f3-54d3-4920-a5c3-575e76d3008b None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:21:01.955796 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-ed9ea0f3-54d3-4920-a5c3-575e76d3008b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:21:01.974081 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd463d7-99c7-414b-9866-8b8bc1c16cd9 admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:01.989999 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a278a03-6560-4fbe-aa98-e649767d37f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f1dc79540b48c0866478cc48cd8205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:01.993522 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a278a03-6560-4fbe-aa98-e649767d37f1 service neutron] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:01.994849 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a278a03-6560-4fbe-aa98-e649767d37f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:01.995474 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a278a03-6560-4fbe-aa98-e649767d37f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:02.000589 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-7a278a03-6560-4fbe-aa98-e649767d37f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:21:02.030427 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a278a03-6560-4fbe-aa98-e649767d37f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:02.036973 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a278a03-6560-4fbe-aa98-e649767d37f1 service neutron] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:02.045832 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 852/1682] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:21:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:21:02.047032 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9ea0f3-54d3-4920-a5c3-575e76d3008b None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:02.048636 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-ed9ea0f3-54d3-4920-a5c3-575e76d3008b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:21:02.069240 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 831/1683] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:21:01 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:21:02.070911 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b28ba2d-7e3a-478c-aae6-48831f274eb2 None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:02.071218 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b28ba2d-7e3a-478c-aae6-48831f274eb2 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:02.071476 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b28ba2d-7e3a-478c-aae6-48831f274eb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:02.135679 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-0b28ba2d-7e3a-478c-aae6-48831f274eb2 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:21:02.143362 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9ea0f3-54d3-4920-a5c3-575e76d3008b None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:02.145409 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-0b28ba2d-7e3a-478c-aae6-48831f274eb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:21:02.151264 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2fa4ff-4200-4a7a-ab3b-a7d08f2282f2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9f310a468ec4058b3c95356ea60ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:02.152153 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2fa4ff-4200-4a7a-ab3b-a7d08f2282f2 service nova] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:02.152646 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2fa4ff-4200-4a7a-ab3b-a7d08f2282f2 service nova] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:02.153553 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2fa4ff-4200-4a7a-ab3b-a7d08f2282f2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:02.155549 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-3a2fa4ff-4200-4a7a-ab3b-a7d08f2282f2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:21:02.182726 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 832/1684] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:21:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:21:02.187202 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b28ba2d-7e3a-478c-aae6-48831f274eb2 None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:02.228515 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b28ba2d-7e3a-478c-aae6-48831f274eb2 None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:02.235905 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eda0db-44ba-422c-992b-5da9860ebaa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:02.236735 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eda0db-44ba-422c-992b-5da9860ebaa7 admin admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:02.237091 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eda0db-44ba-422c-992b-5da9860ebaa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:02.237438 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eda0db-44ba-422c-992b-5da9860ebaa7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:02.238361 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65eda0db-44ba-422c-992b-5da9860ebaa7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:21:02.238811 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65eda0db-44ba-422c-992b-5da9860ebaa7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:02.241573 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65eda0db-44ba-422c-992b-5da9860ebaa7 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:02.273395 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 833/1685] 10.222.0.70 () {58 vars in 1152 bytes} [Tue May 10 19:21:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:21:02.274625 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eda0db-44ba-422c-992b-5da9860ebaa7 admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:02.283340 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2fa4ff-4200-4a7a-ab3b-a7d08f2282f2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:02.285503 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2fa4ff-4200-4a7a-ab3b-a7d08f2282f2 service nova] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:02.285637 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eda0db-44ba-422c-992b-5da9860ebaa7 admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:02.290675 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cf593c-710a-442c-bbbf-e04d1a39c8fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:02.291362 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cf593c-710a-442c-bbbf-e04d1a39c8fa admin admin] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:02.291653 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cf593c-710a-442c-bbbf-e04d1a39c8fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:02.291930 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cf593c-710a-442c-bbbf-e04d1a39c8fa admin admin] PATH_INFO: `/v3/projects` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:02.292681 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cf593c-710a-442c-bbbf-e04d1a39c8fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:02.294997 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cf593c-710a-442c-bbbf-e04d1a39c8fa admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:02.299277 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 853/1686] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:21:02 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:21:02.335286 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 834/1687] 10.222.0.70 () {60 vars in 1152 bytes} [Tue May 10 19:21:02 2022] POST /identity/v3/projects => generated 373 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:21:02.336510 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2fa4ff-4200-4a7a-ab3b-a7d08f2282f2 service nova] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:02.358388 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2fa4ff-4200-4a7a-ab3b-a7d08f2282f2 service nova] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:02.475026 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ae05c9-e998-411b-b690-09a823305e0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:02.476159 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ae05c9-e998-411b-b690-09a823305e0a admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:02.476772 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ae05c9-e998-411b-b690-09a823305e0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:02.477208 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ae05c9-e998-411b-b690-09a823305e0a admin admin] PATH_INFO: `/v3/users` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:02.478041 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ae05c9-e998-411b-b690-09a823305e0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:02.480159 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ae05c9-e998-411b-b690-09a823305e0a admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:02.551026 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 854/1688] 10.222.0.70 () {60 vars in 1143 bytes} [Tue May 10 19:21:02 2022] POST /identity/v3/users => generated 287 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 19:21:02.554381 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cf593c-710a-442c-bbbf-e04d1a39c8fa admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:02.569375 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cf593c-710a-442c-bbbf-e04d1a39c8fa admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:02.576621 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511433e5-b2a5-4611-a356-7672f8470435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:02.577845 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511433e5-b2a5-4611-a356-7672f8470435 admin admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:02.578351 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511433e5-b2a5-4611-a356-7672f8470435 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:02.581104 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511433e5-b2a5-4611-a356-7672f8470435 admin admin] PATH_INFO: `/v3/roles` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:02.582306 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511433e5-b2a5-4611-a356-7672f8470435 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:02.585089 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511433e5-b2a5-4611-a356-7672f8470435 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:02.602906 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 835/1689] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:21:02 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:21:02.608564 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ae05c9-e998-411b-b690-09a823305e0a admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:02.623236 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ae05c9-e998-411b-b690-09a823305e0a admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:02.629815 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fee4566-7b09-409f-977c-09245c922afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:02.631707 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fee4566-7b09-409f-977c-09245c922afa admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:02.632789 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fee4566-7b09-409f-977c-09245c922afa admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:02.633547 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fee4566-7b09-409f-977c-09245c922afa admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:02.634678 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fee4566-7b09-409f-977c-09245c922afa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:02.638595 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fee4566-7b09-409f-977c-09245c922afa admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:02.655547 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 855/1690] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:21:02 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:21:02.659693 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511433e5-b2a5-4611-a356-7672f8470435 admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:02.673102 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511433e5-b2a5-4611-a356-7672f8470435 admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:02.680405 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c52efa-ac9d-400a-a1ba-5028e13ae836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:02.681828 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c52efa-ac9d-400a-a1ba-5028e13ae836 admin admin] REQUEST_METHOD: `PUT` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:02.682448 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c52efa-ac9d-400a-a1ba-5028e13ae836 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:02.683144 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c52efa-ac9d-400a-a1ba-5028e13ae836 admin admin] PATH_INFO: `/v3/projects/1dba4115428e4216bf2972d0905d4094/users/3393bccf8e6145589cde44bb7db2ed7e/roles/5c07cf5bfbd3427db18428aa50420962` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:02.709451 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c52efa-ac9d-400a-a1ba-5028e13ae836 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1dba4115428e4216bf2972d0905d4094, user_id=3393bccf8e6145589cde44bb7db2ed7e, role_id=5c07cf5bfbd3427db18428aa50420962)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:02.714572 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c52efa-ac9d-400a-a1ba-5028e13ae836 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:02.741954 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 836/1691] 10.222.0.70 () {60 vars in 1482 bytes} [Tue May 10 19:21:02 2022] PUT /identity/v3/projects/1dba4115428e4216bf2972d0905d4094/users/3393bccf8e6145589cde44bb7db2ed7e/roles/5c07cf5bfbd3427db18428aa50420962 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:21:02.754768 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8681a8c2-afaa-409a-99b8-d91674aef9d3 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:02.755606 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8681a8c2-afaa-409a-99b8-d91674aef9d3 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:02.757214 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8681a8c2-afaa-409a-99b8-d91674aef9d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:02.814524 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-8681a8c2-afaa-409a-99b8-d91674aef9d3 None None] MFA Rules not processed for user `3393bccf8e6145589cde44bb7db2ed7e`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:21:02.817596 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-8681a8c2-afaa-409a-99b8-d91674aef9d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:21:03.083413 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 856/1692] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:21:02 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:21:03.097042 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c52efa-ac9d-400a-a1ba-5028e13ae836 admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:03.424940 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c52efa-ac9d-400a-a1ba-5028e13ae836 admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:03.441118 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5edbe0-76f8-4add-818c-50ad700bc693 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9f310a468ec4058b3c95356ea60ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:03.441803 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5edbe0-76f8-4add-818c-50ad700bc693 service nova] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:03.442081 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5edbe0-76f8-4add-818c-50ad700bc693 service nova] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:03.442910 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5edbe0-76f8-4add-818c-50ad700bc693 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:03.472461 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5edbe0-76f8-4add-818c-50ad700bc693 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:03.484217 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5edbe0-76f8-4add-818c-50ad700bc693 service nova] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:03.512359 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 837/1693] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:21:03 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:21:03.753732 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8681a8c2-afaa-409a-99b8-d91674aef9d3 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:03.756310 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-8681a8c2-afaa-409a-99b8-d91674aef9d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:21:03.966313 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5edbe0-76f8-4add-818c-50ad700bc693 service nova] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:04.170823 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5edbe0-76f8-4add-818c-50ad700bc693 service nova] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:04.191390 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4be0153-fc38-493f-be74-743ff7ea8c32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:04.208227 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4be0153-fc38-493f-be74-743ff7ea8c32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:04.208927 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4be0153-fc38-493f-be74-743ff7ea8c32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:04.211026 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4be0153-fc38-493f-be74-743ff7ea8c32 admin admin] PATH_INFO: `/v3/users/3393bccf8e6145589cde44bb7db2ed7e` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:04.225392 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4be0153-fc38-493f-be74-743ff7ea8c32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3393bccf8e6145589cde44bb7db2ed7e)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:04.242575 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4be0153-fc38-493f-be74-743ff7ea8c32 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:04.378768 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8681a8c2-afaa-409a-99b8-d91674aef9d3 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:04.380687 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-d4be0153-fc38-493f-be74-743ff7ea8c32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3393bccf8e6145589cde44bb7db2ed7e'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:04.386238 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7a5340-635c-42d3-849d-08177a60269c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:04.387843 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7a5340-635c-42d3-849d-08177a60269c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:04.388280 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7a5340-635c-42d3-849d-08177a60269c admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:04.389298 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7a5340-635c-42d3-849d-08177a60269c admin admin] PATH_INFO: `/v3/projects/81ecb3bf630d4eb5b8c8a5fe1a80bda7` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:04.390818 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7a5340-635c-42d3-849d-08177a60269c admin admin] RBAC: Authorizing `identity:delete_project(project_id=81ecb3bf630d4eb5b8c8a5fe1a80bda7)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:04.393493 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7a5340-635c-42d3-849d-08177a60269c admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:04.409188 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-d4be0153-fc38-493f-be74-743ff7ea8c32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3393bccf8e6145589cde44bb7db2ed7e'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:04.426517 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-d4be0153-fc38-493f-be74-743ff7ea8c32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3393bccf8e6145589cde44bb7db2ed7e'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:04.427481 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-d4be0153-fc38-493f-be74-743ff7ea8c32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3393bccf8e6145589cde44bb7db2ed7e'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:04.442450 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-d4be0153-fc38-493f-be74-743ff7ea8c32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3393bccf8e6145589cde44bb7db2ed7e'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:04.454219 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 838/1694] 10.222.0.70 () {58 vars in 1223 bytes} [Tue May 10 19:21:03 2022] DELETE /identity/v3/users/3393bccf8e6145589cde44bb7db2ed7e => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 19:21:04.458529 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7d6655-52ce-46b4-a9f3-aa1d4a7a9801 None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:04.458932 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7d6655-52ce-46b4-a9f3-aa1d4a7a9801 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:04.459316 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7d6655-52ce-46b4-a9f3-aa1d4a7a9801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:04.473260 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-1f7a5340-635c-42d3-849d-08177a60269c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81ecb3bf630d4eb5b8c8a5fe1a80bda7', 'request_id': 'req-1f7a5340-635c-42d3-849d-08177a60269c'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:04.493018 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-1f7a5340-635c-42d3-849d-08177a60269c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81ecb3bf630d4eb5b8c8a5fe1a80bda7', 'request_id': 'req-1f7a5340-635c-42d3-849d-08177a60269c'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:04.504096 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-ec7d6655-52ce-46b4-a9f3-aa1d4a7a9801 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:21:04.505547 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-ec7d6655-52ce-46b4-a9f3-aa1d4a7a9801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:21:04.508991 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-1f7a5340-635c-42d3-849d-08177a60269c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81ecb3bf630d4eb5b8c8a5fe1a80bda7', 'request_id': 'req-1f7a5340-635c-42d3-849d-08177a60269c'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:04.535265 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-1f7a5340-635c-42d3-849d-08177a60269c admin admin] The token cache is being invalidate because project 81ecb3bf630d4eb5b8c8a5fe1a80bda7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79994) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:21:04.537097 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-1f7a5340-635c-42d3-849d-08177a60269c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:04.537866 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-1f7a5340-635c-42d3-849d-08177a60269c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:04.541141 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 857/1695] 10.222.0.70 () {58 vars in 1232 bytes} [Tue May 10 19:21:03 2022] DELETE /identity/v3/projects/81ecb3bf630d4eb5b8c8a5fe1a80bda7 => generated 0 bytes in 788 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:21:04.546382 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7a5340-635c-42d3-849d-08177a60269c admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:04.549346 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-1f7a5340-635c-42d3-849d-08177a60269c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:21:04.686482 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 839/1696] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:21:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:21:04.735821 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7a5340-635c-42d3-849d-08177a60269c admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:04.752208 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d1b7cb-cc99-4379-9e70-a20ab31ccc8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:04.754727 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d1b7cb-cc99-4379-9e70-a20ab31ccc8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:04.755320 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d1b7cb-cc99-4379-9e70-a20ab31ccc8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:04.755320 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d1b7cb-cc99-4379-9e70-a20ab31ccc8a admin admin] PATH_INFO: `/v3/users/ceb3eef9b11b47738cce0ebca8e12bb1` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:04.760679 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d1b7cb-cc99-4379-9e70-a20ab31ccc8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ceb3eef9b11b47738cce0ebca8e12bb1)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:04.764782 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d1b7cb-cc99-4379-9e70-a20ab31ccc8a admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:04.875484 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-19d1b7cb-cc99-4379-9e70-a20ab31ccc8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ceb3eef9b11b47738cce0ebca8e12bb1'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:04.911464 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-19d1b7cb-cc99-4379-9e70-a20ab31ccc8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ceb3eef9b11b47738cce0ebca8e12bb1'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:04.912795 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-19d1b7cb-cc99-4379-9e70-a20ab31ccc8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ceb3eef9b11b47738cce0ebca8e12bb1'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:04.934929 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-19d1b7cb-cc99-4379-9e70-a20ab31ccc8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ceb3eef9b11b47738cce0ebca8e12bb1'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:04.946696 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-19d1b7cb-cc99-4379-9e70-a20ab31ccc8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ceb3eef9b11b47738cce0ebca8e12bb1'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:04.953557 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7d6655-52ce-46b4-a9f3-aa1d4a7a9801 None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:04.955384 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-ec7d6655-52ce-46b4-a9f3-aa1d4a7a9801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:21:04.980234 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 858/1697] 10.222.0.70 () {58 vars in 1223 bytes} [Tue May 10 19:21:04 2022] DELETE /identity/v3/users/ceb3eef9b11b47738cce0ebca8e12bb1 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:21:05.122688 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7d6655-52ce-46b4-a9f3-aa1d4a7a9801 None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:05.341699 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd213b14-6695-4d3d-8661-db662eab1b01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f1dc79540b48c0866478cc48cd8205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:05.342378 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd213b14-6695-4d3d-8661-db662eab1b01 service neutron] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:05.342658 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd213b14-6695-4d3d-8661-db662eab1b01 service neutron] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:05.342930 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd213b14-6695-4d3d-8661-db662eab1b01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:05.344787 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-fd213b14-6695-4d3d-8661-db662eab1b01 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:21:05.494561 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd213b14-6695-4d3d-8661-db662eab1b01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:05.498386 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd213b14-6695-4d3d-8661-db662eab1b01 service neutron] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:05.517763 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 840/1698] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:21:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 565 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:21:06.133355 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8624b35c-c673-4e59-aa3d-9f1cc33b414a None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:06.133355 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8624b35c-c673-4e59-aa3d-9f1cc33b414a None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:06.133355 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8624b35c-c673-4e59-aa3d-9f1cc33b414a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:06.183759 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-8624b35c-c673-4e59-aa3d-9f1cc33b414a None None] MFA Rules not processed for user `4c7ce54253764d788ea48b5ff9b43d54`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:21:06.186098 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-8624b35c-c673-4e59-aa3d-9f1cc33b414a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:21:06.366769 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 859/1699] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:21:06 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:21:06.379737 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d3659b-6e0d-48ca-8790-e608d9e35a34 None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:06.380393 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d3659b-6e0d-48ca-8790-e608d9e35a34 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:06.380393 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d3659b-6e0d-48ca-8790-e608d9e35a34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:06.419317 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-09d3659b-6e0d-48ca-8790-e608d9e35a34 None None] MFA Rules not processed for user `4c7ce54253764d788ea48b5ff9b43d54`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:21:06.420738 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-09d3659b-6e0d-48ca-8790-e608d9e35a34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:21:06.450950 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 841/1700] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:21:06 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:21:06.458699 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8624b35c-c673-4e59-aa3d-9f1cc33b414a None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:06.460796 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-8624b35c-c673-4e59-aa3d-9f1cc33b414a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:21:06.715967 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8624b35c-c673-4e59-aa3d-9f1cc33b414a None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:06.734262 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204766c2-cb16-4577-a045-d797ad8d4866 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9f310a468ec4058b3c95356ea60ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:06.735156 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204766c2-cb16-4577-a045-d797ad8d4866 service nova] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:06.735812 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204766c2-cb16-4577-a045-d797ad8d4866 service nova] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:06.735812 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204766c2-cb16-4577-a045-d797ad8d4866 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:06.760486 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204766c2-cb16-4577-a045-d797ad8d4866 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:06.760486 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204766c2-cb16-4577-a045-d797ad8d4866 service nova] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:06.812925 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 860/1701] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:21:06 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:21:08.252699 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a59dc2-d1e3-4317-b8c4-3ef315e8e171 None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:08.253207 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a59dc2-d1e3-4317-b8c4-3ef315e8e171 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:08.253351 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a59dc2-d1e3-4317-b8c4-3ef315e8e171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:08.273803 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-b7a59dc2-d1e3-4317-b8c4-3ef315e8e171 None None] MFA Rules not processed for user `90bbeed46811450f953507e570a2bd94`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:21:08.294247 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-b7a59dc2-d1e3-4317-b8c4-3ef315e8e171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:21:08.456730 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 842/1702] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:21:08 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:21:08.852977 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9de0ed2-539c-467a-9458-d3369426850f None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:08.853567 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9de0ed2-539c-467a-9458-d3369426850f None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:08.853567 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9de0ed2-539c-467a-9458-d3369426850f None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:08.855479 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 861/1703] 10.222.0.70 () {54 vars in 921 bytes} [Tue May 10 19:21:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:21:08.928863 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa3cd0c-aeea-4208-9349-415b4ea96419 None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:08.929209 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa3cd0c-aeea-4208-9349-415b4ea96419 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:08.929530 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa3cd0c-aeea-4208-9349-415b4ea96419 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:08.967814 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-0aa3cd0c-aeea-4208-9349-415b4ea96419 None None] MFA Rules not processed for user `b9f310a468ec4058b3c95356ea60ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:21:08.970745 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-0aa3cd0c-aeea-4208-9349-415b4ea96419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:21:08.987787 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 843/1704] 10.222.0.70 () {58 vars in 1018 bytes} [Tue May 10 19:21:08 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:21:09.505379 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9de0ed2-539c-467a-9458-d3369426850f None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:09.509219 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-b9de0ed2-539c-467a-9458-d3369426850f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:21:09.539234 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa3cd0c-aeea-4208-9349-415b4ea96419 None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:09.541354 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-0aa3cd0c-aeea-4208-9349-415b4ea96419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:21:09.570666 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa3cd0c-aeea-4208-9349-415b4ea96419 None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:09.574593 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9de0ed2-539c-467a-9458-d3369426850f None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:09.585796 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e462af8-0af0-4bc9-853e-79ea284afeb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:09.587049 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e462af8-0af0-4bc9-853e-79ea284afeb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:09.590711 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e462af8-0af0-4bc9-853e-79ea284afeb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:09.596276 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e462af8-0af0-4bc9-853e-79ea284afeb7 admin admin] PATH_INFO: `/v3/projects/1dba4115428e4216bf2972d0905d4094` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:09.596996 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b88795-02cd-4774-a4d6-17b4508b2e6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:09.598100 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b88795-02cd-4774-a4d6-17b4508b2e6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:09.600491 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e462af8-0af0-4bc9-853e-79ea284afeb7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1dba4115428e4216bf2972d0905d4094)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:09.601041 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b88795-02cd-4774-a4d6-17b4508b2e6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:09.602973 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b88795-02cd-4774-a4d6-17b4508b2e6f admin admin] PATH_INFO: `/v3/projects/dcabdfc9b23c48978db0597903dd9b32` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:09.608984 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b88795-02cd-4774-a4d6-17b4508b2e6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=dcabdfc9b23c48978db0597903dd9b32)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:09.610370 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e462af8-0af0-4bc9-853e-79ea284afeb7 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:09.612571 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b88795-02cd-4774-a4d6-17b4508b2e6f admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:09.697217 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-6e462af8-0af0-4bc9-853e-79ea284afeb7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1dba4115428e4216bf2972d0905d4094', 'request_id': 'req-6e462af8-0af0-4bc9-853e-79ea284afeb7'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:09.707806 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-6e462af8-0af0-4bc9-853e-79ea284afeb7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1dba4115428e4216bf2972d0905d4094', 'request_id': 'req-6e462af8-0af0-4bc9-853e-79ea284afeb7'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:09.722678 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-6e462af8-0af0-4bc9-853e-79ea284afeb7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1dba4115428e4216bf2972d0905d4094', 'request_id': 'req-6e462af8-0af0-4bc9-853e-79ea284afeb7'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:09.747184 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-c0b88795-02cd-4774-a4d6-17b4508b2e6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dcabdfc9b23c48978db0597903dd9b32', 'request_id': 'req-c0b88795-02cd-4774-a4d6-17b4508b2e6f'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:09.755720 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-6e462af8-0af0-4bc9-853e-79ea284afeb7 admin admin] The token cache is being invalidate because project 1dba4115428e4216bf2972d0905d4094 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79993) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:21:09.756063 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-6e462af8-0af0-4bc9-853e-79ea284afeb7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:09.757002 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-6e462af8-0af0-4bc9-853e-79ea284afeb7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:09.767294 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-c0b88795-02cd-4774-a4d6-17b4508b2e6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dcabdfc9b23c48978db0597903dd9b32', 'request_id': 'req-c0b88795-02cd-4774-a4d6-17b4508b2e6f'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:09.772188 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 844/1705] 10.222.0.70 () {58 vars in 1232 bytes} [Tue May 10 19:21:09 2022] DELETE /identity/v3/projects/1dba4115428e4216bf2972d0905d4094 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:21:09.779449 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d18343-9b3c-470f-8e10-a95a7830a5b5 None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:09.779449 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d18343-9b3c-470f-8e10-a95a7830a5b5 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:09.779977 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d18343-9b3c-470f-8e10-a95a7830a5b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:09.789125 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-c0b88795-02cd-4774-a4d6-17b4508b2e6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dcabdfc9b23c48978db0597903dd9b32', 'request_id': 'req-c0b88795-02cd-4774-a4d6-17b4508b2e6f'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:09.812269 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-69d18343-9b3c-470f-8e10-a95a7830a5b5 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:21:09.814011 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-69d18343-9b3c-470f-8e10-a95a7830a5b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:21:09.831659 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-c0b88795-02cd-4774-a4d6-17b4508b2e6f admin admin] The token cache is being invalidate because project dcabdfc9b23c48978db0597903dd9b32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79994) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:21:09.831963 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-c0b88795-02cd-4774-a4d6-17b4508b2e6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:09.837870 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-c0b88795-02cd-4774-a4d6-17b4508b2e6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:09.851221 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 862/1706] 10.222.0.70 () {58 vars in 1232 bytes} [Tue May 10 19:21:09 2022] DELETE /identity/v3/projects/dcabdfc9b23c48978db0597903dd9b32 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:21:09.852792 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47528db6-4238-4ae1-8aed-4cf9521b4f35 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:09.853086 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47528db6-4238-4ae1-8aed-4cf9521b4f35 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:09.853649 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47528db6-4238-4ae1-8aed-4cf9521b4f35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:09.925647 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-47528db6-4238-4ae1-8aed-4cf9521b4f35 None None] MFA Rules not processed for user `a7188fbb905a4ef984d8d3eda8d443d9`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:21:09.927086 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-47528db6-4238-4ae1-8aed-4cf9521b4f35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:21:09.947167 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 845/1707] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:21:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:21:09.959471 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06b2bc5-6ef2-4d11-85fa-5c057acdba95 None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:09.959471 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06b2bc5-6ef2-4d11-85fa-5c057acdba95 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:09.959471 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06b2bc5-6ef2-4d11-85fa-5c057acdba95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:09.985359 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-e06b2bc5-6ef2-4d11-85fa-5c057acdba95 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:21:09.990791 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-e06b2bc5-6ef2-4d11-85fa-5c057acdba95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:21:10.028723 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 846/1708] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:21:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:21:10.029865 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c64e46-501e-4c53-a5be-20747e6f1175 None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:10.030154 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c64e46-501e-4c53-a5be-20747e6f1175 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:10.034072 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c64e46-501e-4c53-a5be-20747e6f1175 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:10.095866 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-51c64e46-501e-4c53-a5be-20747e6f1175 None None] MFA Rules not processed for user `db6fd87ab33946808f4153585fc1d07a`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:21:10.097126 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-51c64e46-501e-4c53-a5be-20747e6f1175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:21:10.135871 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 863/1709] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:21:09 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:21:10.138178 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5bc2f2-1d99-4a58-b417-ed0d6632ccbc None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:10.138552 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5bc2f2-1d99-4a58-b417-ed0d6632ccbc None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:10.138903 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5bc2f2-1d99-4a58-b417-ed0d6632ccbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:10.200964 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-4f5bc2f2-1d99-4a58-b417-ed0d6632ccbc None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:21:10.200964 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-4f5bc2f2-1d99-4a58-b417-ed0d6632ccbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:21:10.215625 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 847/1710] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:21:10 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:21:10.217466 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093ed6f2-d40c-47b6-9e2c-cd985e10026b None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:10.217832 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093ed6f2-d40c-47b6-9e2c-cd985e10026b None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:10.218261 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093ed6f2-d40c-47b6-9e2c-cd985e10026b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:10.236399 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 864/1711] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:21:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:21:10.239967 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5bc2f2-1d99-4a58-b417-ed0d6632ccbc None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:10.254503 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5bc2f2-1d99-4a58-b417-ed0d6632ccbc None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:10.271882 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-093ed6f2-d40c-47b6-9e2c-cd985e10026b None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:21:10.273138 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-093ed6f2-d40c-47b6-9e2c-cd985e10026b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:21:10.283281 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d47a638-8358-4b05-a846-e1fcfbddc32e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:10.284298 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d47a638-8358-4b05-a846-e1fcfbddc32e admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:10.290534 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d47a638-8358-4b05-a846-e1fcfbddc32e admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:10.290534 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d47a638-8358-4b05-a846-e1fcfbddc32e admin admin] PATH_INFO: `/v3/domains` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:10.290534 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d47a638-8358-4b05-a846-e1fcfbddc32e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:21:10.290534 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d47a638-8358-4b05-a846-e1fcfbddc32e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:10.307833 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d47a638-8358-4b05-a846-e1fcfbddc32e admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:10.321997 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 848/1712] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:21:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:21:10.326171 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093ed6f2-d40c-47b6-9e2c-cd985e10026b None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:10.346529 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 865/1713] 10.222.0.70 () {58 vars in 1152 bytes} [Tue May 10 19:21:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:21:10.352287 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093ed6f2-d40c-47b6-9e2c-cd985e10026b None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:10.353867 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d47a638-8358-4b05-a846-e1fcfbddc32e admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:10.380317 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a88fd7-4e36-4b0f-b6fa-03ad670754a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:10.381035 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a88fd7-4e36-4b0f-b6fa-03ad670754a4 admin admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:10.381320 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a88fd7-4e36-4b0f-b6fa-03ad670754a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:10.381599 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a88fd7-4e36-4b0f-b6fa-03ad670754a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:10.382332 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a88fd7-4e36-4b0f-b6fa-03ad670754a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:21:10.382642 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a88fd7-4e36-4b0f-b6fa-03ad670754a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:10.384307 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a88fd7-4e36-4b0f-b6fa-03ad670754a4 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:10.395627 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d47a638-8358-4b05-a846-e1fcfbddc32e admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:10.420680 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43caa42a-ef05-4a1f-96a4-9dbaaa70a052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:10.421813 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43caa42a-ef05-4a1f-96a4-9dbaaa70a052 admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:10.422241 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43caa42a-ef05-4a1f-96a4-9dbaaa70a052 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:10.422749 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43caa42a-ef05-4a1f-96a4-9dbaaa70a052 admin admin] PATH_INFO: `/v3/projects` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:10.425045 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43caa42a-ef05-4a1f-96a4-9dbaaa70a052 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:10.430334 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 849/1714] 10.222.0.70 () {58 vars in 1152 bytes} [Tue May 10 19:21:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:21:10.431220 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a88fd7-4e36-4b0f-b6fa-03ad670754a4 admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:10.432651 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43caa42a-ef05-4a1f-96a4-9dbaaa70a052 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:10.462923 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a88fd7-4e36-4b0f-b6fa-03ad670754a4 admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:10.478430 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c63f730-4ac6-4969-b322-ecdba3b8c773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:10.479067 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c63f730-4ac6-4969-b322-ecdba3b8c773 admin admin] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:10.479357 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c63f730-4ac6-4969-b322-ecdba3b8c773 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:10.479641 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c63f730-4ac6-4969-b322-ecdba3b8c773 admin admin] PATH_INFO: `/v3/projects` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:10.482236 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c63f730-4ac6-4969-b322-ecdba3b8c773 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:10.498230 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c63f730-4ac6-4969-b322-ecdba3b8c773 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:10.538606 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 866/1715] 10.222.0.70 () {60 vars in 1152 bytes} [Tue May 10 19:21:10 2022] POST /identity/v3/projects => generated 405 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:21:10.540367 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43caa42a-ef05-4a1f-96a4-9dbaaa70a052 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:10.584474 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 850/1716] 10.222.0.70 () {60 vars in 1152 bytes} [Tue May 10 19:21:10 2022] POST /identity/v3/projects => generated 365 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:21:10.586718 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c63f730-4ac6-4969-b322-ecdba3b8c773 admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:10.751254 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43caa42a-ef05-4a1f-96a4-9dbaaa70a052 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:10.765516 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b91ba4-5fd2-4489-a6cf-1ffd59cf08b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:10.766329 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b91ba4-5fd2-4489-a6cf-1ffd59cf08b6 admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:10.766512 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b91ba4-5fd2-4489-a6cf-1ffd59cf08b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:10.766861 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b91ba4-5fd2-4489-a6cf-1ffd59cf08b6 admin admin] PATH_INFO: `/v3/users` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:10.770962 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b91ba4-5fd2-4489-a6cf-1ffd59cf08b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:10.772975 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b91ba4-5fd2-4489-a6cf-1ffd59cf08b6 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:10.773104 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c63f730-4ac6-4969-b322-ecdba3b8c773 admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:10.785055 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56001d62-eb67-4f73-aeb6-8ef45a9e80fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:10.786214 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56001d62-eb67-4f73-aeb6-8ef45a9e80fa admin admin] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:10.786497 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56001d62-eb67-4f73-aeb6-8ef45a9e80fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:10.786925 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56001d62-eb67-4f73-aeb6-8ef45a9e80fa admin admin] PATH_INFO: `/v3/users` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:10.787637 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56001d62-eb67-4f73-aeb6-8ef45a9e80fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:10.790239 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56001d62-eb67-4f73-aeb6-8ef45a9e80fa admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:10.849091 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 851/1717] 10.222.0.70 () {60 vars in 1143 bytes} [Tue May 10 19:21:10 2022] POST /identity/v3/users => generated 283 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:21:10.850787 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56001d62-eb67-4f73-aeb6-8ef45a9e80fa admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:10.860670 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 867/1718] 10.222.0.70 () {60 vars in 1143 bytes} [Tue May 10 19:21:10 2022] POST /identity/v3/users => generated 303 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:21:10.864890 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b91ba4-5fd2-4489-a6cf-1ffd59cf08b6 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:10.872822 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56001d62-eb67-4f73-aeb6-8ef45a9e80fa admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:10.896262 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e15b4bd-5ffc-4738-88a3-f2b17a62eb5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:10.896994 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e15b4bd-5ffc-4738-88a3-f2b17a62eb5f admin admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:10.897283 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e15b4bd-5ffc-4738-88a3-f2b17a62eb5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:10.897554 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e15b4bd-5ffc-4738-88a3-f2b17a62eb5f admin admin] PATH_INFO: `/v3/roles` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:10.898295 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e15b4bd-5ffc-4738-88a3-f2b17a62eb5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:10.899915 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e15b4bd-5ffc-4738-88a3-f2b17a62eb5f admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:10.904234 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b91ba4-5fd2-4489-a6cf-1ffd59cf08b6 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:10.918428 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d26a10-08f5-42b7-9f75-84388151db76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:10.934775 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d26a10-08f5-42b7-9f75-84388151db76 admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:10.935393 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d26a10-08f5-42b7-9f75-84388151db76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:10.935821 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d26a10-08f5-42b7-9f75-84388151db76 admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:10.936813 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d26a10-08f5-42b7-9f75-84388151db76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:10.938677 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d26a10-08f5-42b7-9f75-84388151db76 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:10.954741 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 852/1719] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:21:10 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 19:21:10.955245 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e15b4bd-5ffc-4738-88a3-f2b17a62eb5f admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:10.993191 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e15b4bd-5ffc-4738-88a3-f2b17a62eb5f admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:10.997944 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 868/1720] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:21:10 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:21:11.002237 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d26a10-08f5-42b7-9f75-84388151db76 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:11.004868 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4949ace3-4955-47f4-a922-f22a813acb05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:11.005803 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4949ace3-4955-47f4-a922-f22a813acb05 admin admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:11.006234 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4949ace3-4955-47f4-a922-f22a813acb05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:11.006704 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4949ace3-4955-47f4-a922-f22a813acb05 admin admin] PATH_INFO: `/v3/roles` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:11.007591 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4949ace3-4955-47f4-a922-f22a813acb05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:11.012778 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4949ace3-4955-47f4-a922-f22a813acb05 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:11.023871 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d26a10-08f5-42b7-9f75-84388151db76 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:11.029516 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890365cc-85ae-48c7-a013-96b010f7de68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:11.030459 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890365cc-85ae-48c7-a013-96b010f7de68 admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:11.030911 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890365cc-85ae-48c7-a013-96b010f7de68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:11.031345 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890365cc-85ae-48c7-a013-96b010f7de68 admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:11.032361 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890365cc-85ae-48c7-a013-96b010f7de68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:11.034476 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890365cc-85ae-48c7-a013-96b010f7de68 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:11.038731 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 853/1721] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:21:10 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:21:11.049516 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4949ace3-4955-47f4-a922-f22a813acb05 admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:11.050000 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 869/1722] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:21:11 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:21:11.055153 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890365cc-85ae-48c7-a013-96b010f7de68 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:11.070827 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4949ace3-4955-47f4-a922-f22a813acb05 admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:11.072062 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890365cc-85ae-48c7-a013-96b010f7de68 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:11.076941 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36024b9b-4c4d-46ff-bf10-c636b7ffbc34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:11.078062 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36024b9b-4c4d-46ff-bf10-c636b7ffbc34 admin admin] REQUEST_METHOD: `PUT` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:11.078502 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36024b9b-4c4d-46ff-bf10-c636b7ffbc34 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:11.078934 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36024b9b-4c4d-46ff-bf10-c636b7ffbc34 admin admin] PATH_INFO: `/v3/projects/4e85ca83eb454e19a4f16320bf2eb5b1/users/63da35371f434cd1b7788b510aa6fc92/roles/5c07cf5bfbd3427db18428aa50420962` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:11.090419 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddc362f-8de4-4c29-b1ea-c70abdd16235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:11.091438 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddc362f-8de4-4c29-b1ea-c70abdd16235 admin admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:11.091798 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddc362f-8de4-4c29-b1ea-c70abdd16235 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:11.092148 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddc362f-8de4-4c29-b1ea-c70abdd16235 admin admin] PATH_INFO: `/v3/projects/c01dcc8f6d83457d99e5ec3e2a3c7509/users/26c0336e81f04f61a612fd3488a23d3b/roles/5c07cf5bfbd3427db18428aa50420962` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:11.102490 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36024b9b-4c4d-46ff-bf10-c636b7ffbc34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e85ca83eb454e19a4f16320bf2eb5b1, user_id=63da35371f434cd1b7788b510aa6fc92, role_id=5c07cf5bfbd3427db18428aa50420962)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:11.107669 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36024b9b-4c4d-46ff-bf10-c636b7ffbc34 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:11.135495 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 854/1723] 10.222.0.70 () {60 vars in 1482 bytes} [Tue May 10 19:21:11 2022] PUT /identity/v3/projects/4e85ca83eb454e19a4f16320bf2eb5b1/users/63da35371f434cd1b7788b510aa6fc92/roles/5c07cf5bfbd3427db18428aa50420962 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:21:11.146504 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5b2ca7-4bbf-4b21-b3e6-a7d8434d4cbc None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:11.146885 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddc362f-8de4-4c29-b1ea-c70abdd16235 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c01dcc8f6d83457d99e5ec3e2a3c7509, user_id=26c0336e81f04f61a612fd3488a23d3b, role_id=5c07cf5bfbd3427db18428aa50420962)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:11.147207 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5b2ca7-4bbf-4b21-b3e6-a7d8434d4cbc None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:11.147638 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5b2ca7-4bbf-4b21-b3e6-a7d8434d4cbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:11.150077 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddc362f-8de4-4c29-b1ea-c70abdd16235 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:11.169578 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 870/1724] 10.222.0.70 () {60 vars in 1482 bytes} [Tue May 10 19:21:11 2022] PUT /identity/v3/projects/c01dcc8f6d83457d99e5ec3e2a3c7509/users/26c0336e81f04f61a612fd3488a23d3b/roles/5c07cf5bfbd3427db18428aa50420962 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:21:11.181088 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653aea7d-57f5-4a0a-836f-d14c3978ff8b None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:11.181686 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653aea7d-57f5-4a0a-836f-d14c3978ff8b None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:11.182193 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653aea7d-57f5-4a0a-836f-d14c3978ff8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:11.206239 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-7c5b2ca7-4bbf-4b21-b3e6-a7d8434d4cbc None None] MFA Rules not processed for user `63da35371f434cd1b7788b510aa6fc92`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:21:11.207950 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-7c5b2ca7-4bbf-4b21-b3e6-a7d8434d4cbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:21:11.256232 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-653aea7d-57f5-4a0a-836f-d14c3978ff8b None None] MFA Rules not processed for user `26c0336e81f04f61a612fd3488a23d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:21:11.257513 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-653aea7d-57f5-4a0a-836f-d14c3978ff8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:21:11.350291 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 855/1725] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:21:11 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:21:11.354222 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a64e21-6a57-423f-b40a-11ce1cfeb573 None None] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:11.354222 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a64e21-6a57-423f-b40a-11ce1cfeb573 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:11.354222 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a64e21-6a57-423f-b40a-11ce1cfeb573 None None] PATH_INFO: `/` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:11.358586 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 856/1726] 10.222.0.70 () {54 vars in 912 bytes} [Tue May 10 19:21:11 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:21:11.359491 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a64e21-6a57-423f-b40a-11ce1cfeb573 None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:11.377771 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 871/1727] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:21:11 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:21:11.379639 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e30b33d-4a15-4868-a3fc-73950c582e9e None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:11.382234 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e30b33d-4a15-4868-a3fc-73950c582e9e None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:11.384552 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e30b33d-4a15-4868-a3fc-73950c582e9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:11.429553 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-3e30b33d-4a15-4868-a3fc-73950c582e9e None None] MFA Rules not processed for user `91f1dc79540b48c0866478cc48cd8205`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:21:11.435594 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-3e30b33d-4a15-4868-a3fc-73950c582e9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:21:11.494604 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a64e21-6a57-423f-b40a-11ce1cfeb573 None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:11.503336 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca46bbd8-e71b-4678-b1f0-846d498878e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:11.504346 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca46bbd8-e71b-4678-b1f0-846d498878e2 admin admin] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:11.504346 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca46bbd8-e71b-4678-b1f0-846d498878e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:11.504654 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca46bbd8-e71b-4678-b1f0-846d498878e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:11.505301 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca46bbd8-e71b-4678-b1f0-846d498878e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:11.507215 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca46bbd8-e71b-4678-b1f0-846d498878e2 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:11.524541 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 872/1728] 10.222.0.70 () {58 vars in 1009 bytes} [Tue May 10 19:21:11 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:21:11.526515 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e30b33d-4a15-4868-a3fc-73950c582e9e None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:11.548580 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 857/1729] 10.222.0.70 () {60 vars in 1152 bytes} [Tue May 10 19:21:11 2022] POST /identity/v3/projects => generated 363 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:21:11.548765 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e30b33d-4a15-4868-a3fc-73950c582e9e None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:11.548846 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca46bbd8-e71b-4678-b1f0-846d498878e2 admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:11.548846 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-ca46bbd8-e71b-4678-b1f0-846d498878e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:21:11.623133 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dc360c-2f63-4598-9bbe-3a03cd64b53c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:11.624201 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dc360c-2f63-4598-9bbe-3a03cd64b53c admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:11.624851 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dc360c-2f63-4598-9bbe-3a03cd64b53c admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:11.626448 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dc360c-2f63-4598-9bbe-3a03cd64b53c admin admin] PATH_INFO: `/v3/projects` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:11.627430 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dc360c-2f63-4598-9bbe-3a03cd64b53c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:11.629857 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dc360c-2f63-4598-9bbe-3a03cd64b53c admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:11.676006 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 873/1730] 10.222.0.70 () {60 vars in 1152 bytes} [Tue May 10 19:21:11 2022] POST /identity/v3/projects => generated 405 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:21:11.676937 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dc360c-2f63-4598-9bbe-3a03cd64b53c admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:11.679981 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-56dc360c-2f63-4598-9bbe-3a03cd64b53c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:21:11.685730 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca46bbd8-e71b-4678-b1f0-846d498878e2 admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:11.762897 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dc360c-2f63-4598-9bbe-3a03cd64b53c admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:11.768162 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78a8993-e4dc-4300-80fd-502bb6abd074 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f1dc79540b48c0866478cc48cd8205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:11.768931 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78a8993-e4dc-4300-80fd-502bb6abd074 service neutron] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:11.769286 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78a8993-e4dc-4300-80fd-502bb6abd074 service neutron] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:11.769933 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78a8993-e4dc-4300-80fd-502bb6abd074 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:11.771362 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739b5bc6-16e7-43d9-aef0-8fc682878b6c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9f310a468ec4058b3c95356ea60ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:11.772030 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739b5bc6-16e7-43d9-aef0-8fc682878b6c service nova] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:11.772312 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739b5bc6-16e7-43d9-aef0-8fc682878b6c service nova] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:11.772614 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739b5bc6-16e7-43d9-aef0-8fc682878b6c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:11.774475 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-739b5bc6-16e7-43d9-aef0-8fc682878b6c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:21:11.779422 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78a8993-e4dc-4300-80fd-502bb6abd074 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:11.781766 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78a8993-e4dc-4300-80fd-502bb6abd074 service neutron] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:11.787463 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739b5bc6-16e7-43d9-aef0-8fc682878b6c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:11.789137 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739b5bc6-16e7-43d9-aef0-8fc682878b6c service nova] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:11.791258 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 874/1731] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:21:11 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:21:11.792201 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78a8993-e4dc-4300-80fd-502bb6abd074 service neutron] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:11.802497 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 858/1732] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:21:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:21:11.803389 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739b5bc6-16e7-43d9-aef0-8fc682878b6c service nova] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:11.882687 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78a8993-e4dc-4300-80fd-502bb6abd074 service neutron] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:11.892140 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7558ea70-962f-43ff-9401-c8c0d1a7d85b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:11.893252 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7558ea70-962f-43ff-9401-c8c0d1a7d85b admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:11.894666 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7558ea70-962f-43ff-9401-c8c0d1a7d85b admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:11.896627 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7558ea70-962f-43ff-9401-c8c0d1a7d85b admin admin] PATH_INFO: `/v3/users` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:11.898479 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7558ea70-962f-43ff-9401-c8c0d1a7d85b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:11.906459 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7558ea70-962f-43ff-9401-c8c0d1a7d85b admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:11.921007 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739b5bc6-16e7-43d9-aef0-8fc682878b6c service nova] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:11.935689 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dde0954-9aa2-41af-b30d-35137d94efb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:11.936269 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dde0954-9aa2-41af-b30d-35137d94efb5 admin admin] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:11.936506 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dde0954-9aa2-41af-b30d-35137d94efb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:11.937674 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dde0954-9aa2-41af-b30d-35137d94efb5 admin admin] PATH_INFO: `/v3/users` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:11.939425 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dde0954-9aa2-41af-b30d-35137d94efb5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:11.946605 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dde0954-9aa2-41af-b30d-35137d94efb5 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:11.988797 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 875/1733] 10.222.0.70 () {60 vars in 1143 bytes} [Tue May 10 19:21:11 2022] POST /identity/v3/users => generated 288 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:21:11.992876 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7558ea70-962f-43ff-9401-c8c0d1a7d85b admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:12.003146 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 859/1734] 10.222.0.70 () {60 vars in 1143 bytes} [Tue May 10 19:21:11 2022] POST /identity/v3/users => generated 309 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:21:12.007426 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dde0954-9aa2-41af-b30d-35137d94efb5 admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:12.014119 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7558ea70-962f-43ff-9401-c8c0d1a7d85b admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:12.047687 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1246e2d4-7258-436c-b16d-ddf3e4562d08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:12.053143 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dde0954-9aa2-41af-b30d-35137d94efb5 admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:12.063036 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61517030-62f5-4731-a33c-c660795e8dfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:12.063598 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61517030-62f5-4731-a33c-c660795e8dfc admin admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:12.063889 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61517030-62f5-4731-a33c-c660795e8dfc admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:12.064456 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61517030-62f5-4731-a33c-c660795e8dfc admin admin] PATH_INFO: `/v3/roles` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:12.065212 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61517030-62f5-4731-a33c-c660795e8dfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:12.068393 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1246e2d4-7258-436c-b16d-ddf3e4562d08 admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:12.069602 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1246e2d4-7258-436c-b16d-ddf3e4562d08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:12.070119 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1246e2d4-7258-436c-b16d-ddf3e4562d08 admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:12.072578 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61517030-62f5-4731-a33c-c660795e8dfc admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:12.077117 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1246e2d4-7258-436c-b16d-ddf3e4562d08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:12.079540 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1246e2d4-7258-436c-b16d-ddf3e4562d08 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:12.100926 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 860/1735] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:21:12 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:21:12.101907 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61517030-62f5-4731-a33c-c660795e8dfc admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:12.129647 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 876/1736] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:21:11 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 19:21:12.131415 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1246e2d4-7258-436c-b16d-ddf3e4562d08 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:12.138797 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61517030-62f5-4731-a33c-c660795e8dfc admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:12.162623 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1246e2d4-7258-436c-b16d-ddf3e4562d08 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:12.165799 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d40acb-91da-4b2d-a320-6867a303754c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:12.166893 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d40acb-91da-4b2d-a320-6867a303754c admin admin] REQUEST_METHOD: `PUT` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:12.167151 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d40acb-91da-4b2d-a320-6867a303754c admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:12.167507 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d40acb-91da-4b2d-a320-6867a303754c admin admin] PATH_INFO: `/v3/projects/9397b17be8cf403ea50631e3ba2104a1/users/ca0cce6e7e7f4c0ea652ec6e0e68a809/roles/634ba284303b4626b5a0402772c68f5c` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:12.193157 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f0949c-e483-4a5b-9c9b-2d507ee31eee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:12.194236 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f0949c-e483-4a5b-9c9b-2d507ee31eee admin admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:12.194630 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f0949c-e483-4a5b-9c9b-2d507ee31eee admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:12.195709 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f0949c-e483-4a5b-9c9b-2d507ee31eee admin admin] PATH_INFO: `/v3/projects/4dcdb7f126444fffa1c52ef3ef5d73d9/users/8d48b3a5de524ed6a81b0b3c286044a7/roles/634ba284303b4626b5a0402772c68f5c` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:12.207723 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d40acb-91da-4b2d-a320-6867a303754c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9397b17be8cf403ea50631e3ba2104a1, user_id=ca0cce6e7e7f4c0ea652ec6e0e68a809, role_id=634ba284303b4626b5a0402772c68f5c)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:12.212657 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d40acb-91da-4b2d-a320-6867a303754c admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:12.228798 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f0949c-e483-4a5b-9c9b-2d507ee31eee admin admin] RBAC: Authorizing `identity:create_grant(project_id=4dcdb7f126444fffa1c52ef3ef5d73d9, user_id=8d48b3a5de524ed6a81b0b3c286044a7, role_id=634ba284303b4626b5a0402772c68f5c)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:12.235381 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f0949c-e483-4a5b-9c9b-2d507ee31eee admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:12.244963 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 861/1737] 10.222.0.70 () {60 vars in 1482 bytes} [Tue May 10 19:21:12 2022] PUT /identity/v3/projects/9397b17be8cf403ea50631e3ba2104a1/users/ca0cce6e7e7f4c0ea652ec6e0e68a809/roles/634ba284303b4626b5a0402772c68f5c => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:21:12.245994 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d40acb-91da-4b2d-a320-6867a303754c admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:12.257947 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 877/1738] 10.222.0.70 () {60 vars in 1482 bytes} [Tue May 10 19:21:12 2022] PUT /identity/v3/projects/4dcdb7f126444fffa1c52ef3ef5d73d9/users/8d48b3a5de524ed6a81b0b3c286044a7/roles/634ba284303b4626b5a0402772c68f5c => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:21:12.263214 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f0949c-e483-4a5b-9c9b-2d507ee31eee admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:12.427442 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d40acb-91da-4b2d-a320-6867a303754c admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:12.443783 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b328ed-ec79-4df9-8570-46e0f300dc55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:12.444539 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b328ed-ec79-4df9-8570-46e0f300dc55 admin admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:12.447030 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b328ed-ec79-4df9-8570-46e0f300dc55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:12.447322 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b328ed-ec79-4df9-8570-46e0f300dc55 admin admin] PATH_INFO: `/v3/roles` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:12.448092 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b328ed-ec79-4df9-8570-46e0f300dc55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:12.450704 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f0949c-e483-4a5b-9c9b-2d507ee31eee admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:12.451585 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b328ed-ec79-4df9-8570-46e0f300dc55 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:12.470347 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6a924b-92af-4218-b590-c16eee2418d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:12.472277 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6a924b-92af-4218-b590-c16eee2418d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:12.475231 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6a924b-92af-4218-b590-c16eee2418d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:12.475769 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6a924b-92af-4218-b590-c16eee2418d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:12.478588 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6a924b-92af-4218-b590-c16eee2418d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:12.482496 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 862/1739] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:21:12 2022] GET /identity/v3/roles => generated 1420 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:21:12.483736 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b328ed-ec79-4df9-8570-46e0f300dc55 admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:12.484024 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6a924b-92af-4218-b590-c16eee2418d6 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:12.510336 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b328ed-ec79-4df9-8570-46e0f300dc55 admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:12.528472 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 878/1740] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:21:12 2022] GET /identity/v3/roles => generated 1420 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:21:12.534722 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1649274f-b3f5-4bc1-8f4f-648e4f829637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:12.536110 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6a924b-92af-4218-b590-c16eee2418d6 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:12.540556 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1649274f-b3f5-4bc1-8f4f-648e4f829637 admin admin] REQUEST_METHOD: `PUT` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:12.543644 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1649274f-b3f5-4bc1-8f4f-648e4f829637 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:12.544004 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1649274f-b3f5-4bc1-8f4f-648e4f829637 admin admin] PATH_INFO: `/v3/projects/9397b17be8cf403ea50631e3ba2104a1/users/ca0cce6e7e7f4c0ea652ec6e0e68a809/roles/634ba284303b4626b5a0402772c68f5c` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:12.551512 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1649274f-b3f5-4bc1-8f4f-648e4f829637 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9397b17be8cf403ea50631e3ba2104a1, user_id=ca0cce6e7e7f4c0ea652ec6e0e68a809, role_id=634ba284303b4626b5a0402772c68f5c)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:12.562604 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1649274f-b3f5-4bc1-8f4f-648e4f829637 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:12.571703 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6a924b-92af-4218-b590-c16eee2418d6 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:12.603629 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8a7940-442c-43d2-aed4-b52ce4160f42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:12.607064 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8a7940-442c-43d2-aed4-b52ce4160f42 admin admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:12.607977 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 863/1741] 10.222.0.70 () {60 vars in 1482 bytes} [Tue May 10 19:21:12 2022] PUT /identity/v3/projects/9397b17be8cf403ea50631e3ba2104a1/users/ca0cce6e7e7f4c0ea652ec6e0e68a809/roles/634ba284303b4626b5a0402772c68f5c => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:21:12.608359 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8a7940-442c-43d2-aed4-b52ce4160f42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:12.608684 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8a7940-442c-43d2-aed4-b52ce4160f42 admin admin] PATH_INFO: `/v3/projects/4dcdb7f126444fffa1c52ef3ef5d73d9/users/8d48b3a5de524ed6a81b0b3c286044a7/roles/634ba284303b4626b5a0402772c68f5c` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:12.612582 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8a7940-442c-43d2-aed4-b52ce4160f42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4dcdb7f126444fffa1c52ef3ef5d73d9, user_id=8d48b3a5de524ed6a81b0b3c286044a7, role_id=634ba284303b4626b5a0402772c68f5c)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:12.615329 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1649274f-b3f5-4bc1-8f4f-648e4f829637 admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:12.618554 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8a7940-442c-43d2-aed4-b52ce4160f42 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:12.638602 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 879/1742] 10.222.0.70 () {60 vars in 1482 bytes} [Tue May 10 19:21:12 2022] PUT /identity/v3/projects/4dcdb7f126444fffa1c52ef3ef5d73d9/users/8d48b3a5de524ed6a81b0b3c286044a7/roles/634ba284303b4626b5a0402772c68f5c => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:21:12.640245 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a67f41e-1dbc-4d40-96c4-a35fc7c8fcaa None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:12.640602 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a67f41e-1dbc-4d40-96c4-a35fc7c8fcaa None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:12.641045 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a67f41e-1dbc-4d40-96c4-a35fc7c8fcaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:12.726096 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-3a67f41e-1dbc-4d40-96c4-a35fc7c8fcaa None None] MFA Rules not processed for user `ca0cce6e7e7f4c0ea652ec6e0e68a809`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:21:12.729392 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-3a67f41e-1dbc-4d40-96c4-a35fc7c8fcaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:21:12.794711 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1649274f-b3f5-4bc1-8f4f-648e4f829637 admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:12.970589 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39be2dcc-1b3e-4950-9f6d-156e0ed9dae5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9f310a468ec4058b3c95356ea60ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:12.971259 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39be2dcc-1b3e-4950-9f6d-156e0ed9dae5 service nova] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:12.971542 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39be2dcc-1b3e-4950-9f6d-156e0ed9dae5 service nova] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:12.971815 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39be2dcc-1b3e-4950-9f6d-156e0ed9dae5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:13.026837 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 880/1743] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:21:12 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 387 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:21:13.036040 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb9c439-cbb5-4ae0-a9f3-575b76c5bcf2 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:13.036727 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb9c439-cbb5-4ae0-a9f3-575b76c5bcf2 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:13.037704 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb9c439-cbb5-4ae0-a9f3-575b76c5bcf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:13.094663 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39be2dcc-1b3e-4950-9f6d-156e0ed9dae5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:13.096970 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39be2dcc-1b3e-4950-9f6d-156e0ed9dae5 service nova] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:13.108897 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 864/1744] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:21:12 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 494 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 19:21:13.109838 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39be2dcc-1b3e-4950-9f6d-156e0ed9dae5 service nova] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:13.112279 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-39be2dcc-1b3e-4950-9f6d-156e0ed9dae5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:21:13.159362 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-6eb9c439-cbb5-4ae0-a9f3-575b76c5bcf2 None None] MFA Rules not processed for user `8d48b3a5de524ed6a81b0b3c286044a7`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:21:13.161902 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-6eb9c439-cbb5-4ae0-a9f3-575b76c5bcf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:21:13.231897 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39be2dcc-1b3e-4950-9f6d-156e0ed9dae5 service nova] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:13.244202 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a883101e-58cf-45ac-b5bc-08e3b3027dc7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15df2a8967aa43299c10e365f4200d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:13.246672 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a883101e-58cf-45ac-b5bc-08e3b3027dc7 service cinder] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:13.246971 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a883101e-58cf-45ac-b5bc-08e3b3027dc7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:13.248022 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a883101e-58cf-45ac-b5bc-08e3b3027dc7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:13.291881 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a883101e-58cf-45ac-b5bc-08e3b3027dc7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:13.295960 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a883101e-58cf-45ac-b5bc-08e3b3027dc7 service cinder] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:13.328858 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 865/1745] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:21:13 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:21:13.431865 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 881/1746] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:21:13 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 401 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:21:13.447215 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a883101e-58cf-45ac-b5bc-08e3b3027dc7 service cinder] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:13.467710 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a883101e-58cf-45ac-b5bc-08e3b3027dc7 service cinder] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:13.487757 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa1ccab-a3b8-4311-ac0f-220403fe661e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15df2a8967aa43299c10e365f4200d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:13.488452 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa1ccab-a3b8-4311-ac0f-220403fe661e service cinder] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:13.488779 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa1ccab-a3b8-4311-ac0f-220403fe661e service cinder] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:13.489003 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa1ccab-a3b8-4311-ac0f-220403fe661e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:13.528296 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa1ccab-a3b8-4311-ac0f-220403fe661e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:13.536770 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa1ccab-a3b8-4311-ac0f-220403fe661e service cinder] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:13.572518 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 866/1747] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:21:13 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:21:13.619880 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb9c439-cbb5-4ae0-a9f3-575b76c5bcf2 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:13.691622 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632c8f4c-f8db-445e-ac8b-7ac8b8abd5d4 None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:13.692064 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632c8f4c-f8db-445e-ac8b-7ac8b8abd5d4 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:13.692508 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632c8f4c-f8db-445e-ac8b-7ac8b8abd5d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:13.737505 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-632c8f4c-f8db-445e-ac8b-7ac8b8abd5d4 None None] MFA Rules not processed for user `4c7ce54253764d788ea48b5ff9b43d54`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:21:13.749363 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-632c8f4c-f8db-445e-ac8b-7ac8b8abd5d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:21:13.783786 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb9c439-cbb5-4ae0-a9f3-575b76c5bcf2 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:13.790811 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229a3bdb-173f-4ecc-a99c-16d42734cd14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:13.793496 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229a3bdb-173f-4ecc-a99c-16d42734cd14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:13.795134 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229a3bdb-173f-4ecc-a99c-16d42734cd14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:13.796061 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229a3bdb-173f-4ecc-a99c-16d42734cd14 admin admin] PATH_INFO: `/v3/users/26c0336e81f04f61a612fd3488a23d3b` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:13.802288 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229a3bdb-173f-4ecc-a99c-16d42734cd14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=26c0336e81f04f61a612fd3488a23d3b)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:13.838941 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229a3bdb-173f-4ecc-a99c-16d42734cd14 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:13.890647 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 867/1748] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:21:13 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:21:13.891899 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632c8f4c-f8db-445e-ac8b-7ac8b8abd5d4 None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:13.904494 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632c8f4c-f8db-445e-ac8b-7ac8b8abd5d4 None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:13.905356 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-229a3bdb-173f-4ecc-a99c-16d42734cd14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26c0336e81f04f61a612fd3488a23d3b'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:13.909262 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6351bf-9817-4981-a6d3-7073ba960b3b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15df2a8967aa43299c10e365f4200d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:13.910397 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6351bf-9817-4981-a6d3-7073ba960b3b service cinder] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:13.911389 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6351bf-9817-4981-a6d3-7073ba960b3b service cinder] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:13.911885 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6351bf-9817-4981-a6d3-7073ba960b3b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:13.922813 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-229a3bdb-173f-4ecc-a99c-16d42734cd14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26c0336e81f04f61a612fd3488a23d3b'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:13.923667 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-229a3bdb-173f-4ecc-a99c-16d42734cd14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26c0336e81f04f61a612fd3488a23d3b'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:13.933727 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-229a3bdb-173f-4ecc-a99c-16d42734cd14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26c0336e81f04f61a612fd3488a23d3b'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:13.953021 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-229a3bdb-173f-4ecc-a99c-16d42734cd14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26c0336e81f04f61a612fd3488a23d3b'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:13.966506 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 882/1749] 10.222.0.70 () {58 vars in 1223 bytes} [Tue May 10 19:21:13 2022] DELETE /identity/v3/users/26c0336e81f04f61a612fd3488a23d3b => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:21:13.975972 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11e0df5-3507-4be3-b964-b1e61392e4c2 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:13.977212 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11e0df5-3507-4be3-b964-b1e61392e4c2 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:13.977614 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11e0df5-3507-4be3-b964-b1e61392e4c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:14.004916 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-a11e0df5-3507-4be3-b964-b1e61392e4c2 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:21:14.007021 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-a11e0df5-3507-4be3-b964-b1e61392e4c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:21:14.030575 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6351bf-9817-4981-a6d3-7073ba960b3b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:14.032942 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6351bf-9817-4981-a6d3-7073ba960b3b service cinder] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:14.065569 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 868/1750] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:21:13 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:21:14.151087 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 883/1751] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:21:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:21:14.179819 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6351bf-9817-4981-a6d3-7073ba960b3b service cinder] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:14.181501 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-9d6351bf-9817-4981-a6d3-7073ba960b3b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:21:14.397225 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6351bf-9817-4981-a6d3-7073ba960b3b service cinder] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:14.515261 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af0f315-f2f8-4981-ad93-111728cbe1dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f1dc79540b48c0866478cc48cd8205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:14.520966 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af0f315-f2f8-4981-ad93-111728cbe1dd service neutron] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:14.522431 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af0f315-f2f8-4981-ad93-111728cbe1dd service neutron] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:14.523696 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af0f315-f2f8-4981-ad93-111728cbe1dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:14.550998 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af0f315-f2f8-4981-ad93-111728cbe1dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:14.554344 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af0f315-f2f8-4981-ad93-111728cbe1dd service neutron] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:14.574861 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 869/1752] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:21:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:21:17.047506 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11e0df5-3507-4be3-b964-b1e61392e4c2 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:17.049045 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-a11e0df5-3507-4be3-b964-b1e61392e4c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:21:17.075002 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11e0df5-3507-4be3-b964-b1e61392e4c2 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:17.090197 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa62396-60a2-4869-8783-21ecdf1d5bef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:17.091244 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa62396-60a2-4869-8783-21ecdf1d5bef admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:17.091527 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa62396-60a2-4869-8783-21ecdf1d5bef admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:17.091851 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa62396-60a2-4869-8783-21ecdf1d5bef admin admin] PATH_INFO: `/v3/projects/c01dcc8f6d83457d99e5ec3e2a3c7509` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:17.094882 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa62396-60a2-4869-8783-21ecdf1d5bef admin admin] RBAC: Authorizing `identity:delete_project(project_id=c01dcc8f6d83457d99e5ec3e2a3c7509)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:17.097807 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa62396-60a2-4869-8783-21ecdf1d5bef admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:17.194739 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-2aa62396-60a2-4869-8783-21ecdf1d5bef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c01dcc8f6d83457d99e5ec3e2a3c7509', 'request_id': 'req-2aa62396-60a2-4869-8783-21ecdf1d5bef'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:17.211058 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-2aa62396-60a2-4869-8783-21ecdf1d5bef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c01dcc8f6d83457d99e5ec3e2a3c7509', 'request_id': 'req-2aa62396-60a2-4869-8783-21ecdf1d5bef'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:17.244720 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-2aa62396-60a2-4869-8783-21ecdf1d5bef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c01dcc8f6d83457d99e5ec3e2a3c7509', 'request_id': 'req-2aa62396-60a2-4869-8783-21ecdf1d5bef'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:17.281798 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-2aa62396-60a2-4869-8783-21ecdf1d5bef admin admin] The token cache is being invalidate because project c01dcc8f6d83457d99e5ec3e2a3c7509 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79994) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:21:17.282093 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-2aa62396-60a2-4869-8783-21ecdf1d5bef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:17.296996 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-2aa62396-60a2-4869-8783-21ecdf1d5bef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:17.307277 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 884/1753] 10.222.0.70 () {58 vars in 1232 bytes} [Tue May 10 19:21:17 2022] DELETE /identity/v3/projects/c01dcc8f6d83457d99e5ec3e2a3c7509 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:21:17.308381 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af0f315-f2f8-4981-ad93-111728cbe1dd service neutron] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:17.359114 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af0f315-f2f8-4981-ad93-111728cbe1dd service neutron] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:17.586648 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad07dea-3878-4392-a819-ae460ba2dd20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:17.588779 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad07dea-3878-4392-a819-ae460ba2dd20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:17.591545 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad07dea-3878-4392-a819-ae460ba2dd20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:17.591842 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad07dea-3878-4392-a819-ae460ba2dd20 admin admin] PATH_INFO: `/v3/users/ca0cce6e7e7f4c0ea652ec6e0e68a809` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:17.594056 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad07dea-3878-4392-a819-ae460ba2dd20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca0cce6e7e7f4c0ea652ec6e0e68a809)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:17.596109 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad07dea-3878-4392-a819-ae460ba2dd20 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:17.755428 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa62396-60a2-4869-8783-21ecdf1d5bef admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:17.756965 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-2aa62396-60a2-4869-8783-21ecdf1d5bef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:21:17.785065 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa62396-60a2-4869-8783-21ecdf1d5bef admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:17.797537 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ca0d35-41eb-43ae-a66d-cd92aef6e907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:17.798646 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ca0d35-41eb-43ae-a66d-cd92aef6e907 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:17.799140 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ca0d35-41eb-43ae-a66d-cd92aef6e907 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:17.799569 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ca0d35-41eb-43ae-a66d-cd92aef6e907 admin admin] PATH_INFO: `/v3/users/63da35371f434cd1b7788b510aa6fc92` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:17.801062 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ca0d35-41eb-43ae-a66d-cd92aef6e907 admin admin] RBAC: Authorizing `identity:delete_user(user_id=63da35371f434cd1b7788b510aa6fc92)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:17.803597 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ca0d35-41eb-43ae-a66d-cd92aef6e907 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:17.925653 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-78ca0d35-41eb-43ae-a66d-cd92aef6e907 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63da35371f434cd1b7788b510aa6fc92'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:17.973887 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-78ca0d35-41eb-43ae-a66d-cd92aef6e907 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63da35371f434cd1b7788b510aa6fc92'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:17.976827 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-78ca0d35-41eb-43ae-a66d-cd92aef6e907 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63da35371f434cd1b7788b510aa6fc92'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:17.993182 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-78ca0d35-41eb-43ae-a66d-cd92aef6e907 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63da35371f434cd1b7788b510aa6fc92'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:18.005044 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-78ca0d35-41eb-43ae-a66d-cd92aef6e907 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63da35371f434cd1b7788b510aa6fc92'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:18.020310 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 885/1754] 10.222.0.70 () {58 vars in 1223 bytes} [Tue May 10 19:21:17 2022] DELETE /identity/v3/users/63da35371f434cd1b7788b510aa6fc92 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 19:21:18.022367 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ebe84f-eca5-45da-b7e7-9fdd9eff8bbc None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:18.022650 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ebe84f-eca5-45da-b7e7-9fdd9eff8bbc None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:18.022924 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ebe84f-eca5-45da-b7e7-9fdd9eff8bbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:18.104154 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-c9ebe84f-eca5-45da-b7e7-9fdd9eff8bbc None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:21:18.111836 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-c9ebe84f-eca5-45da-b7e7-9fdd9eff8bbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:21:18.201151 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-cad07dea-3878-4392-a819-ae460ba2dd20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca0cce6e7e7f4c0ea652ec6e0e68a809'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:18.235587 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-cad07dea-3878-4392-a819-ae460ba2dd20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca0cce6e7e7f4c0ea652ec6e0e68a809'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:18.244436 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-cad07dea-3878-4392-a819-ae460ba2dd20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca0cce6e7e7f4c0ea652ec6e0e68a809'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:18.245403 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-cad07dea-3878-4392-a819-ae460ba2dd20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca0cce6e7e7f4c0ea652ec6e0e68a809'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:18.256471 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-cad07dea-3878-4392-a819-ae460ba2dd20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca0cce6e7e7f4c0ea652ec6e0e68a809'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:18.266517 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 870/1755] 10.222.0.70 () {58 vars in 1223 bytes} [Tue May 10 19:21:17 2022] DELETE /identity/v3/users/ca0cce6e7e7f4c0ea652ec6e0e68a809 => generated 0 bytes in 959 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:21:18.321881 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 886/1756] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:21:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:21:18.543702 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7070122d-a7d2-4108-8685-83dae01c1899 None None] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:18.544218 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7070122d-a7d2-4108-8685-83dae01c1899 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:18.544412 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7070122d-a7d2-4108-8685-83dae01c1899 None None] PATH_INFO: `/` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:18.546249 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 871/1757] 10.222.0.70 () {54 vars in 921 bytes} [Tue May 10 19:21:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:21:18.567226 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ebe84f-eca5-45da-b7e7-9fdd9eff8bbc None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:18.569488 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-c9ebe84f-eca5-45da-b7e7-9fdd9eff8bbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:21:18.587585 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efb68e6-fd91-4cc5-9b99-bc98317fc8ba None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:18.588190 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efb68e6-fd91-4cc5-9b99-bc98317fc8ba None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:18.588721 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efb68e6-fd91-4cc5-9b99-bc98317fc8ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:18.643243 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-8efb68e6-fd91-4cc5-9b99-bc98317fc8ba None None] MFA Rules not processed for user `b9f310a468ec4058b3c95356ea60ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:21:18.644792 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-8efb68e6-fd91-4cc5-9b99-bc98317fc8ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:21:18.695100 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ebe84f-eca5-45da-b7e7-9fdd9eff8bbc None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:18.775662 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e943de-e1cc-430f-a3af-d95bf2fbdf95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f1dc79540b48c0866478cc48cd8205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:18.776580 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e943de-e1cc-430f-a3af-d95bf2fbdf95 service neutron] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:18.777049 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e943de-e1cc-430f-a3af-d95bf2fbdf95 service neutron] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:18.777573 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e943de-e1cc-430f-a3af-d95bf2fbdf95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:18.791687 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 872/1758] 10.222.0.70 () {58 vars in 1018 bytes} [Tue May 10 19:21:18 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:21:18.874255 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e943de-e1cc-430f-a3af-d95bf2fbdf95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:18.877790 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e943de-e1cc-430f-a3af-d95bf2fbdf95 service neutron] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:18.918937 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efb68e6-fd91-4cc5-9b99-bc98317fc8ba None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:18.920498 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 887/1759] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:21:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:21:18.921777 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-8efb68e6-fd91-4cc5-9b99-bc98317fc8ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:21:18.952243 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efb68e6-fd91-4cc5-9b99-bc98317fc8ba None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:18.982032 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc7ba27-3dc1-478c-8d8a-fffad1b269c4 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:18.982362 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc7ba27-3dc1-478c-8d8a-fffad1b269c4 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:18.982600 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc7ba27-3dc1-478c-8d8a-fffad1b269c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:18.989140 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af313d4b-bc7d-4e13-982f-da4148b06a20 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9f310a468ec4058b3c95356ea60ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:18.990231 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af313d4b-bc7d-4e13-982f-da4148b06a20 service nova] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:18.990606 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af313d4b-bc7d-4e13-982f-da4148b06a20 service nova] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:18.990956 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af313d4b-bc7d-4e13-982f-da4148b06a20 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:19.016771 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af313d4b-bc7d-4e13-982f-da4148b06a20 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:19.021068 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af313d4b-bc7d-4e13-982f-da4148b06a20 service nova] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:19.021798 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-7bc7ba27-3dc1-478c-8d8a-fffad1b269c4 None None] MFA Rules not processed for user `a7188fbb905a4ef984d8d3eda8d443d9`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:21:19.024363 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-7bc7ba27-3dc1-478c-8d8a-fffad1b269c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:21:19.044975 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 873/1760] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:21:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:21:19.192608 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 888/1761] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:21:18 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:21:20.559300 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af313d4b-bc7d-4e13-982f-da4148b06a20 service nova] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:20.560832 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-af313d4b-bc7d-4e13-982f-da4148b06a20 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:21:20.580275 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af313d4b-bc7d-4e13-982f-da4148b06a20 service nova] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:20.590302 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc30053-8377-48c2-a20e-62baafb0e724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:20.591658 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc30053-8377-48c2-a20e-62baafb0e724 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:20.594199 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc30053-8377-48c2-a20e-62baafb0e724 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:20.595032 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc30053-8377-48c2-a20e-62baafb0e724 admin admin] PATH_INFO: `/v3/projects/9397b17be8cf403ea50631e3ba2104a1` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:20.597217 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc30053-8377-48c2-a20e-62baafb0e724 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9397b17be8cf403ea50631e3ba2104a1)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:20.603522 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc30053-8377-48c2-a20e-62baafb0e724 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:20.675830 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55afebe9-7bde-4939-af73-784d909be76e None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:20.676392 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55afebe9-7bde-4939-af73-784d909be76e None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:20.676392 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55afebe9-7bde-4939-af73-784d909be76e None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:20.678133 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 889/1762] 10.222.0.70 () {54 vars in 921 bytes} [Tue May 10 19:21:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:21:20.690133 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce303361-a3fc-4c44-aff6-2aeafced91cb None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:20.690744 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce303361-a3fc-4c44-aff6-2aeafced91cb None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:20.691343 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce303361-a3fc-4c44-aff6-2aeafced91cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:20.725436 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-ce303361-a3fc-4c44-aff6-2aeafced91cb None None] MFA Rules not processed for user `b9f310a468ec4058b3c95356ea60ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:21:20.726687 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-ce303361-a3fc-4c44-aff6-2aeafced91cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:21:20.727785 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-bbc30053-8377-48c2-a20e-62baafb0e724 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9397b17be8cf403ea50631e3ba2104a1', 'request_id': 'req-bbc30053-8377-48c2-a20e-62baafb0e724'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:20.747519 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-bbc30053-8377-48c2-a20e-62baafb0e724 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9397b17be8cf403ea50631e3ba2104a1', 'request_id': 'req-bbc30053-8377-48c2-a20e-62baafb0e724'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:20.768162 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-bbc30053-8377-48c2-a20e-62baafb0e724 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9397b17be8cf403ea50631e3ba2104a1', 'request_id': 'req-bbc30053-8377-48c2-a20e-62baafb0e724'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:20.788044 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-bbc30053-8377-48c2-a20e-62baafb0e724 admin admin] The token cache is being invalidate because project 9397b17be8cf403ea50631e3ba2104a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79993) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:21:20.788933 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-bbc30053-8377-48c2-a20e-62baafb0e724 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:20.789916 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-bbc30053-8377-48c2-a20e-62baafb0e724 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:20.792154 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 874/1763] 10.222.0.70 () {58 vars in 1232 bytes} [Tue May 10 19:21:20 2022] DELETE /identity/v3/projects/9397b17be8cf403ea50631e3ba2104a1 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:21:20.797460 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc380621-36bc-427c-a14c-c443ccc95cba None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:20.797974 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc380621-36bc-427c-a14c-c443ccc95cba None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:20.798402 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc380621-36bc-427c-a14c-c443ccc95cba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:20.843629 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-dc380621-36bc-427c-a14c-c443ccc95cba None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:21:20.844960 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-dc380621-36bc-427c-a14c-c443ccc95cba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:21:20.890942 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 890/1764] 10.222.0.70 () {58 vars in 1018 bytes} [Tue May 10 19:21:20 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:21:20.979727 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 875/1765] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:21:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:21:20.989026 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1b13bb-13ff-4ef0-9fa2-05331def62fc None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:20.989321 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1b13bb-13ff-4ef0-9fa2-05331def62fc None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:20.989601 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1b13bb-13ff-4ef0-9fa2-05331def62fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:21.022190 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-dc1b13bb-13ff-4ef0-9fa2-05331def62fc None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:21:21.024499 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-dc1b13bb-13ff-4ef0-9fa2-05331def62fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:21:21.043964 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 891/1766] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:21:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:21:21.045593 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc380621-36bc-427c-a14c-c443ccc95cba None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:21.058249 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc380621-36bc-427c-a14c-c443ccc95cba None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:21.072608 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0214a2af-d7c2-4526-9bb3-44c93c363d56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:21.073500 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0214a2af-d7c2-4526-9bb3-44c93c363d56 admin admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:21.074522 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0214a2af-d7c2-4526-9bb3-44c93c363d56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:21.075035 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0214a2af-d7c2-4526-9bb3-44c93c363d56 admin admin] PATH_INFO: `/v3/domains` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:21.076655 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0214a2af-d7c2-4526-9bb3-44c93c363d56 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:21:21.078365 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0214a2af-d7c2-4526-9bb3-44c93c363d56 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:21.081109 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0214a2af-d7c2-4526-9bb3-44c93c363d56 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:21.118777 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 876/1767] 10.222.0.70 () {58 vars in 1152 bytes} [Tue May 10 19:21:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:21:21.124438 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1b13bb-13ff-4ef0-9fa2-05331def62fc None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:21.134920 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1b13bb-13ff-4ef0-9fa2-05331def62fc None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:21.148813 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c51859-2b1a-437b-8916-4a37fd62dc1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:21.149693 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c51859-2b1a-437b-8916-4a37fd62dc1f admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:21.150134 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c51859-2b1a-437b-8916-4a37fd62dc1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:21.151803 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c51859-2b1a-437b-8916-4a37fd62dc1f admin admin] PATH_INFO: `/v3/projects` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:21.152886 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c51859-2b1a-437b-8916-4a37fd62dc1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:21.156756 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c51859-2b1a-437b-8916-4a37fd62dc1f admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:21.201201 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 892/1768] 10.222.0.70 () {60 vars in 1152 bytes} [Tue May 10 19:21:21 2022] POST /identity/v3/projects => generated 365 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:21:21.202651 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0214a2af-d7c2-4526-9bb3-44c93c363d56 admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:21.227301 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0214a2af-d7c2-4526-9bb3-44c93c363d56 admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:21.244451 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c51859-2b1a-437b-8916-4a37fd62dc1f admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:21.249223 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-b2c51859-2b1a-437b-8916-4a37fd62dc1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:21:21.346159 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ac439d-4689-41e3-aef0-54b025789150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:21.346696 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ac439d-4689-41e3-aef0-54b025789150 admin admin] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:21.347164 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ac439d-4689-41e3-aef0-54b025789150 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:21.347261 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ac439d-4689-41e3-aef0-54b025789150 admin admin] PATH_INFO: `/v3/users` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:21.348329 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ac439d-4689-41e3-aef0-54b025789150 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:21.354276 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ac439d-4689-41e3-aef0-54b025789150 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:21.388123 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c51859-2b1a-437b-8916-4a37fd62dc1f admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:21.399193 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 877/1769] 10.222.0.70 () {60 vars in 1143 bytes} [Tue May 10 19:21:21 2022] POST /identity/v3/users => generated 283 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:21:21.403582 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ac439d-4689-41e3-aef0-54b025789150 admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:21.410106 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5860b7-3558-462a-99dc-8b0506459cd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:21.411319 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5860b7-3558-462a-99dc-8b0506459cd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:21.411675 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5860b7-3558-462a-99dc-8b0506459cd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:21.412126 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5860b7-3558-462a-99dc-8b0506459cd8 admin admin] PATH_INFO: `/v3/users/7cd5123a16534644a042f82b280884c3` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:21.415790 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5860b7-3558-462a-99dc-8b0506459cd8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7cd5123a16534644a042f82b280884c3)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:21.421736 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5860b7-3558-462a-99dc-8b0506459cd8 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:21.426849 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ac439d-4689-41e3-aef0-54b025789150 admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:21.448536 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b436aa-5427-4006-9d51-037c7f3b0873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:21.452082 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b436aa-5427-4006-9d51-037c7f3b0873 admin admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:21.452475 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b436aa-5427-4006-9d51-037c7f3b0873 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:21.452639 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b436aa-5427-4006-9d51-037c7f3b0873 admin admin] PATH_INFO: `/v3/roles` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:21.455764 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b436aa-5427-4006-9d51-037c7f3b0873 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:21.457747 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b436aa-5427-4006-9d51-037c7f3b0873 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:21.480190 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 878/1770] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:21:21 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:21:21.481487 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b436aa-5427-4006-9d51-037c7f3b0873 admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:21.483995 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-17b436aa-5427-4006-9d51-037c7f3b0873 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:21:21.501100 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b436aa-5427-4006-9d51-037c7f3b0873 admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:21.508317 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231dd913-fa3b-44d5-ba21-6491cf16b8d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:21.509558 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231dd913-fa3b-44d5-ba21-6491cf16b8d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:21.510104 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231dd913-fa3b-44d5-ba21-6491cf16b8d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:21.510561 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231dd913-fa3b-44d5-ba21-6491cf16b8d9 admin admin] PATH_INFO: `/v3/projects/4e85ca83eb454e19a4f16320bf2eb5b1` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:21.512435 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231dd913-fa3b-44d5-ba21-6491cf16b8d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e85ca83eb454e19a4f16320bf2eb5b1)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:21.517354 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231dd913-fa3b-44d5-ba21-6491cf16b8d9 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:21.554338 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-0a5860b7-3558-462a-99dc-8b0506459cd8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7cd5123a16534644a042f82b280884c3'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:21.586232 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-0a5860b7-3558-462a-99dc-8b0506459cd8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7cd5123a16534644a042f82b280884c3'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:21.589733 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-0a5860b7-3558-462a-99dc-8b0506459cd8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7cd5123a16534644a042f82b280884c3'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:21.610496 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-0a5860b7-3558-462a-99dc-8b0506459cd8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7cd5123a16534644a042f82b280884c3'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:21.622820 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-0a5860b7-3558-462a-99dc-8b0506459cd8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7cd5123a16534644a042f82b280884c3'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:21.626290 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-231dd913-fa3b-44d5-ba21-6491cf16b8d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e85ca83eb454e19a4f16320bf2eb5b1', 'request_id': 'req-231dd913-fa3b-44d5-ba21-6491cf16b8d9'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:21.638613 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-231dd913-fa3b-44d5-ba21-6491cf16b8d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e85ca83eb454e19a4f16320bf2eb5b1', 'request_id': 'req-231dd913-fa3b-44d5-ba21-6491cf16b8d9'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:21.651511 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 893/1771] 10.222.0.70 () {58 vars in 1223 bytes} [Tue May 10 19:21:21 2022] DELETE /identity/v3/users/7cd5123a16534644a042f82b280884c3 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 19:21:21.656173 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5860b7-3558-462a-99dc-8b0506459cd8 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:21.657956 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-231dd913-fa3b-44d5-ba21-6491cf16b8d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e85ca83eb454e19a4f16320bf2eb5b1', 'request_id': 'req-231dd913-fa3b-44d5-ba21-6491cf16b8d9'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:21.660818 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-0a5860b7-3558-462a-99dc-8b0506459cd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:21:21.685691 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-231dd913-fa3b-44d5-ba21-6491cf16b8d9 admin admin] The token cache is being invalidate because project 4e85ca83eb454e19a4f16320bf2eb5b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79993) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:21:21.686275 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-231dd913-fa3b-44d5-ba21-6491cf16b8d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:21.687312 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-231dd913-fa3b-44d5-ba21-6491cf16b8d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:21.690346 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 879/1772] 10.222.0.70 () {58 vars in 1232 bytes} [Tue May 10 19:21:21 2022] DELETE /identity/v3/projects/4e85ca83eb454e19a4f16320bf2eb5b1 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:21:21.691562 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231dd913-fa3b-44d5-ba21-6491cf16b8d9 admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:21.694108 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-231dd913-fa3b-44d5-ba21-6491cf16b8d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:21:21.780769 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5860b7-3558-462a-99dc-8b0506459cd8 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:21.786304 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8d713d-1b0f-4c65-b066-0e318597cc6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:21.787190 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8d713d-1b0f-4c65-b066-0e318597cc6f admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:21.787616 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8d713d-1b0f-4c65-b066-0e318597cc6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:21.788022 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8d713d-1b0f-4c65-b066-0e318597cc6f admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:21.789090 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8d713d-1b0f-4c65-b066-0e318597cc6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:21.791461 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8d713d-1b0f-4c65-b066-0e318597cc6f admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:21.803713 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 894/1773] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:21:21 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:21:21.805384 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513d1f29-b9e4-4519-8aac-463d56b2d8fb None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:21.805803 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513d1f29-b9e4-4519-8aac-463d56b2d8fb None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:21.806217 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513d1f29-b9e4-4519-8aac-463d56b2d8fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:21.830997 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-513d1f29-b9e4-4519-8aac-463d56b2d8fb None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:21:21.832887 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-513d1f29-b9e4-4519-8aac-463d56b2d8fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:21:21.844964 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 895/1774] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:21:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:21:21.846271 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513d1f29-b9e4-4519-8aac-463d56b2d8fb None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:21.850873 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-513d1f29-b9e4-4519-8aac-463d56b2d8fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:21:21.867767 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513d1f29-b9e4-4519-8aac-463d56b2d8fb None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:21.881063 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd0190a-b626-4d88-acb1-b7ec98ed2e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:21.881580 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231dd913-fa3b-44d5-ba21-6491cf16b8d9 admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:21.882605 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd0190a-b626-4d88-acb1-b7ec98ed2e07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:21.883034 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd0190a-b626-4d88-acb1-b7ec98ed2e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:21.883481 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd0190a-b626-4d88-acb1-b7ec98ed2e07 admin admin] PATH_INFO: `/v3/users/8d48b3a5de524ed6a81b0b3c286044a7` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:21.885808 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd0190a-b626-4d88-acb1-b7ec98ed2e07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d48b3a5de524ed6a81b0b3c286044a7)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:21.889571 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd0190a-b626-4d88-acb1-b7ec98ed2e07 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:21.976353 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-dcd0190a-b626-4d88-acb1-b7ec98ed2e07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d48b3a5de524ed6a81b0b3c286044a7'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:21.986763 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e40089-b3fe-4f9f-802b-4c865ad99d4e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9f310a468ec4058b3c95356ea60ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:21.987570 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e40089-b3fe-4f9f-802b-4c865ad99d4e service nova] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:21.988104 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e40089-b3fe-4f9f-802b-4c865ad99d4e service nova] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:21.988675 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e40089-b3fe-4f9f-802b-4c865ad99d4e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:21.990921 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-d6e40089-b3fe-4f9f-802b-4c865ad99d4e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:21:22.003243 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-dcd0190a-b626-4d88-acb1-b7ec98ed2e07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d48b3a5de524ed6a81b0b3c286044a7'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:22.005522 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-dcd0190a-b626-4d88-acb1-b7ec98ed2e07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d48b3a5de524ed6a81b0b3c286044a7'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:22.008193 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e40089-b3fe-4f9f-802b-4c865ad99d4e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:22.010102 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e40089-b3fe-4f9f-802b-4c865ad99d4e service nova] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:22.024247 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-dcd0190a-b626-4d88-acb1-b7ec98ed2e07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d48b3a5de524ed6a81b0b3c286044a7'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:22.026060 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 880/1775] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:21:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:21:22.028478 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e40089-b3fe-4f9f-802b-4c865ad99d4e service nova] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:22.030083 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-d6e40089-b3fe-4f9f-802b-4c865ad99d4e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:21:22.056087 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-dcd0190a-b626-4d88-acb1-b7ec98ed2e07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d48b3a5de524ed6a81b0b3c286044a7'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:22.056944 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e40089-b3fe-4f9f-802b-4c865ad99d4e service nova] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:22.063963 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ad3237-e776-4dfb-8212-3e09050a426a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:22.065327 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ad3237-e776-4dfb-8212-3e09050a426a admin admin] REQUEST_METHOD: `PUT` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:22.065914 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ad3237-e776-4dfb-8212-3e09050a426a admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:22.066378 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ad3237-e776-4dfb-8212-3e09050a426a admin admin] PATH_INFO: `/v3/projects/b80a7dfcfc33424994e37ce9b0d0bcc4/users/737f2b3fe7c643e2b0bce4af1d3c4834/roles/5c07cf5bfbd3427db18428aa50420962` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:22.092258 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 896/1776] 10.222.0.70 () {58 vars in 1223 bytes} [Tue May 10 19:21:21 2022] DELETE /identity/v3/users/8d48b3a5de524ed6a81b0b3c286044a7 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:21:22.093614 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd0190a-b626-4d88-acb1-b7ec98ed2e07 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:22.097917 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-dcd0190a-b626-4d88-acb1-b7ec98ed2e07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:21:22.138473 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ad3237-e776-4dfb-8212-3e09050a426a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b80a7dfcfc33424994e37ce9b0d0bcc4, user_id=737f2b3fe7c643e2b0bce4af1d3c4834, role_id=5c07cf5bfbd3427db18428aa50420962)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:22.141288 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ad3237-e776-4dfb-8212-3e09050a426a admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:22.203561 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 881/1777] 10.222.0.70 () {60 vars in 1482 bytes} [Tue May 10 19:21:22 2022] PUT /identity/v3/projects/b80a7dfcfc33424994e37ce9b0d0bcc4/users/737f2b3fe7c643e2b0bce4af1d3c4834/roles/5c07cf5bfbd3427db18428aa50420962 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:21:22.207083 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd0190a-b626-4d88-acb1-b7ec98ed2e07 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:22.221222 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ad4890-1ca0-4bc1-be81-f8fb48b6aece None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:22.221505 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ad4890-1ca0-4bc1-be81-f8fb48b6aece None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:22.221779 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ad4890-1ca0-4bc1-be81-f8fb48b6aece None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:22.321729 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-a1ad4890-1ca0-4bc1-be81-f8fb48b6aece None None] MFA Rules not processed for user `737f2b3fe7c643e2b0bce4af1d3c4834`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:21:22.322994 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-a1ad4890-1ca0-4bc1-be81-f8fb48b6aece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:21:22.338872 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cc6cfb-707a-4d51-9795-7dc944dfb478 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f1dc79540b48c0866478cc48cd8205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:22.341409 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cc6cfb-707a-4d51-9795-7dc944dfb478 service neutron] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:22.341845 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cc6cfb-707a-4d51-9795-7dc944dfb478 service neutron] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:22.342166 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cc6cfb-707a-4d51-9795-7dc944dfb478 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:22.353533 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-01cc6cfb-707a-4d51-9795-7dc944dfb478 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:21:22.501965 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 882/1778] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:21:22 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:21:22.502876 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ad4890-1ca0-4bc1-be81-f8fb48b6aece None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:22.507021 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-a1ad4890-1ca0-4bc1-be81-f8fb48b6aece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:21:22.577825 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cc6cfb-707a-4d51-9795-7dc944dfb478 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:22.580628 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cc6cfb-707a-4d51-9795-7dc944dfb478 service neutron] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:22.610363 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 897/1779] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:21:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 517 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:21:22.673327 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ad4890-1ca0-4bc1-be81-f8fb48b6aece None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:22.680303 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac3f330-6808-4ac5-a681-005a46af5db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:22.681284 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac3f330-6808-4ac5-a681-005a46af5db2 admin admin] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:22.681725 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac3f330-6808-4ac5-a681-005a46af5db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:22.682145 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac3f330-6808-4ac5-a681-005a46af5db2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:22.683684 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac3f330-6808-4ac5-a681-005a46af5db2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:22.686463 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac3f330-6808-4ac5-a681-005a46af5db2 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:22.724767 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 883/1780] 10.222.0.70 () {60 vars in 1152 bytes} [Tue May 10 19:21:22 2022] POST /identity/v3/projects => generated 365 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:21:22.724975 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cc6cfb-707a-4d51-9795-7dc944dfb478 service neutron] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:22.738042 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cc6cfb-707a-4d51-9795-7dc944dfb478 service neutron] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:22.814931 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bd5293-a1e3-4c7d-b653-f1ec2b132a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:22.816323 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bd5293-a1e3-4c7d-b653-f1ec2b132a1d admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:22.817293 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bd5293-a1e3-4c7d-b653-f1ec2b132a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:22.817755 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bd5293-a1e3-4c7d-b653-f1ec2b132a1d admin admin] PATH_INFO: `/v3/users` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:22.818868 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bd5293-a1e3-4c7d-b653-f1ec2b132a1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:22.821325 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bd5293-a1e3-4c7d-b653-f1ec2b132a1d admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:22.855824 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 898/1781] 10.222.0.70 () {60 vars in 1143 bytes} [Tue May 10 19:21:22 2022] POST /identity/v3/users => generated 289 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 19:21:22.856828 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac3f330-6808-4ac5-a681-005a46af5db2 admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:22.876126 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac3f330-6808-4ac5-a681-005a46af5db2 admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:22.886844 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff0fbb7-cfd3-43cb-87d1-0532ffce111a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:22.887383 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff0fbb7-cfd3-43cb-87d1-0532ffce111a admin admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:22.888705 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff0fbb7-cfd3-43cb-87d1-0532ffce111a admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:22.889119 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff0fbb7-cfd3-43cb-87d1-0532ffce111a admin admin] PATH_INFO: `/v3/roles` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:22.890304 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff0fbb7-cfd3-43cb-87d1-0532ffce111a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:22.892996 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff0fbb7-cfd3-43cb-87d1-0532ffce111a admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:22.906602 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 884/1782] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:21:22 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 19:21:22.912020 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bd5293-a1e3-4c7d-b653-f1ec2b132a1d admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:22.924689 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bd5293-a1e3-4c7d-b653-f1ec2b132a1d admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:22.930047 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22635ac3-4a53-4fdb-adc4-e39b17bd3761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:22.931616 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22635ac3-4a53-4fdb-adc4-e39b17bd3761 admin admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:22.932111 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22635ac3-4a53-4fdb-adc4-e39b17bd3761 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:22.932619 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22635ac3-4a53-4fdb-adc4-e39b17bd3761 admin admin] PATH_INFO: `/v3/projects/8c1508a0109242dcbe22ab6070dafe1b/users/d076f880a506434d88b2d2fc7e082924/roles/634ba284303b4626b5a0402772c68f5c` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:22.990612 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22635ac3-4a53-4fdb-adc4-e39b17bd3761 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c1508a0109242dcbe22ab6070dafe1b, user_id=d076f880a506434d88b2d2fc7e082924, role_id=634ba284303b4626b5a0402772c68f5c)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:22.997036 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22635ac3-4a53-4fdb-adc4-e39b17bd3761 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:23.024521 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 899/1783] 10.222.0.70 () {60 vars in 1482 bytes} [Tue May 10 19:21:22 2022] PUT /identity/v3/projects/8c1508a0109242dcbe22ab6070dafe1b/users/d076f880a506434d88b2d2fc7e082924/roles/634ba284303b4626b5a0402772c68f5c => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:21:23.030216 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff0fbb7-cfd3-43cb-87d1-0532ffce111a admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:23.061899 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff0fbb7-cfd3-43cb-87d1-0532ffce111a admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:23.198101 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06288fcf-0b32-43dc-b323-f91af4d953ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:23.199427 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06288fcf-0b32-43dc-b323-f91af4d953ac admin admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:23.201076 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06288fcf-0b32-43dc-b323-f91af4d953ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:23.201545 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06288fcf-0b32-43dc-b323-f91af4d953ac admin admin] PATH_INFO: `/v3/roles` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:23.202950 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06288fcf-0b32-43dc-b323-f91af4d953ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:23.208579 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06288fcf-0b32-43dc-b323-f91af4d953ac admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:23.240290 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22635ac3-4a53-4fdb-adc4-e39b17bd3761 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:23.241966 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 885/1784] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:21:23 2022] GET /identity/v3/roles => generated 1420 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:21:23.258609 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22635ac3-4a53-4fdb-adc4-e39b17bd3761 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:23.283181 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775118c7-239a-4c34-830e-ba4b6252f41f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:23.287437 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775118c7-239a-4c34-830e-ba4b6252f41f admin admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:23.287437 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775118c7-239a-4c34-830e-ba4b6252f41f admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:23.287437 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775118c7-239a-4c34-830e-ba4b6252f41f admin admin] PATH_INFO: `/v3/projects/8c1508a0109242dcbe22ab6070dafe1b/users/d076f880a506434d88b2d2fc7e082924/roles/634ba284303b4626b5a0402772c68f5c` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:23.298664 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775118c7-239a-4c34-830e-ba4b6252f41f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c1508a0109242dcbe22ab6070dafe1b, user_id=d076f880a506434d88b2d2fc7e082924, role_id=634ba284303b4626b5a0402772c68f5c)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:23.301892 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775118c7-239a-4c34-830e-ba4b6252f41f admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:23.342119 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 900/1785] 10.222.0.70 () {60 vars in 1482 bytes} [Tue May 10 19:21:23 2022] PUT /identity/v3/projects/8c1508a0109242dcbe22ab6070dafe1b/users/d076f880a506434d88b2d2fc7e082924/roles/634ba284303b4626b5a0402772c68f5c => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:21:23.355545 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2903e48e-f9ca-4504-b406-f53acd408aba None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:23.355770 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2903e48e-f9ca-4504-b406-f53acd408aba None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:23.356334 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2903e48e-f9ca-4504-b406-f53acd408aba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:23.480917 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-2903e48e-f9ca-4504-b406-f53acd408aba None None] MFA Rules not processed for user `d076f880a506434d88b2d2fc7e082924`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:21:23.484171 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-2903e48e-f9ca-4504-b406-f53acd408aba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:21:23.565682 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775118c7-239a-4c34-830e-ba4b6252f41f admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:23.567513 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-775118c7-239a-4c34-830e-ba4b6252f41f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:21:23.636474 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 886/1786] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:21:23 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:21:23.652533 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2903e48e-f9ca-4504-b406-f53acd408aba None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:23.654961 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-2903e48e-f9ca-4504-b406-f53acd408aba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:21:23.661105 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775118c7-239a-4c34-830e-ba4b6252f41f admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:23.668055 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5658b760-3115-470a-b855-bfb982cd66ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:23.670857 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5658b760-3115-470a-b855-bfb982cd66ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:23.671152 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5658b760-3115-470a-b855-bfb982cd66ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:23.671427 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5658b760-3115-470a-b855-bfb982cd66ac admin admin] PATH_INFO: `/v3/projects/4dcdb7f126444fffa1c52ef3ef5d73d9` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:23.674913 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5658b760-3115-470a-b855-bfb982cd66ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=4dcdb7f126444fffa1c52ef3ef5d73d9)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:23.677489 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5658b760-3115-470a-b855-bfb982cd66ac admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:23.756018 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-5658b760-3115-470a-b855-bfb982cd66ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4dcdb7f126444fffa1c52ef3ef5d73d9', 'request_id': 'req-5658b760-3115-470a-b855-bfb982cd66ac'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:23.762676 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-5658b760-3115-470a-b855-bfb982cd66ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4dcdb7f126444fffa1c52ef3ef5d73d9', 'request_id': 'req-5658b760-3115-470a-b855-bfb982cd66ac'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:23.771592 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-5658b760-3115-470a-b855-bfb982cd66ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4dcdb7f126444fffa1c52ef3ef5d73d9', 'request_id': 'req-5658b760-3115-470a-b855-bfb982cd66ac'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:23.780879 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2903e48e-f9ca-4504-b406-f53acd408aba None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:23.785541 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-5658b760-3115-470a-b855-bfb982cd66ac admin admin] The token cache is being invalidate because project 4dcdb7f126444fffa1c52ef3ef5d73d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79994) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:21:23.785838 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-5658b760-3115-470a-b855-bfb982cd66ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:23.787190 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-5658b760-3115-470a-b855-bfb982cd66ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:23.789913 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 901/1787] 10.222.0.70 () {58 vars in 1232 bytes} [Tue May 10 19:21:23 2022] DELETE /identity/v3/projects/4dcdb7f126444fffa1c52ef3ef5d73d9 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 19:21:23.794429 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067c0234-a1f7-4fe5-84c0-d0a8fa93bb70 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:23.794729 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067c0234-a1f7-4fe5-84c0-d0a8fa93bb70 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:23.795005 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067c0234-a1f7-4fe5-84c0-d0a8fa93bb70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:23.845065 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-067c0234-a1f7-4fe5-84c0-d0a8fa93bb70 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:21:23.848724 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-067c0234-a1f7-4fe5-84c0-d0a8fa93bb70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:21:23.864966 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bccc3c-a35d-4b84-9b01-095001cabfad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15df2a8967aa43299c10e365f4200d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:23.874206 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bccc3c-a35d-4b84-9b01-095001cabfad service cinder] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:23.874709 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bccc3c-a35d-4b84-9b01-095001cabfad service cinder] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:23.875150 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bccc3c-a35d-4b84-9b01-095001cabfad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:23.878046 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-55bccc3c-a35d-4b84-9b01-095001cabfad service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:21:23.931026 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 902/1788] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:21:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:21:23.932050 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067c0234-a1f7-4fe5-84c0-d0a8fa93bb70 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:23.938835 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-067c0234-a1f7-4fe5-84c0-d0a8fa93bb70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:21:23.962120 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067c0234-a1f7-4fe5-84c0-d0a8fa93bb70 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:23.967155 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566ef7a1-b404-4292-9b97-deaaa4586baa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:23.968016 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566ef7a1-b404-4292-9b97-deaaa4586baa admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:23.968510 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566ef7a1-b404-4292-9b97-deaaa4586baa admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:23.968787 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566ef7a1-b404-4292-9b97-deaaa4586baa admin admin] PATH_INFO: `/v3/projects/a2de3d1d79b14856ac7ebcc4aa70b498` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:23.970564 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566ef7a1-b404-4292-9b97-deaaa4586baa admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2de3d1d79b14856ac7ebcc4aa70b498)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:23.972485 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566ef7a1-b404-4292-9b97-deaaa4586baa admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:23.979859 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bccc3c-a35d-4b84-9b01-095001cabfad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:23.981368 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bccc3c-a35d-4b84-9b01-095001cabfad service cinder] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:23.994522 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 887/1789] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:21:23 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 19:21:23.997045 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0f0784-a102-41b5-9fb6-912201fbc8f5 None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:23.997867 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0f0784-a102-41b5-9fb6-912201fbc8f5 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:23.998327 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0f0784-a102-41b5-9fb6-912201fbc8f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:24.034261 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-566ef7a1-b404-4292-9b97-deaaa4586baa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2de3d1d79b14856ac7ebcc4aa70b498', 'request_id': 'req-566ef7a1-b404-4292-9b97-deaaa4586baa'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:24.036640 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-de0f0784-a102-41b5-9fb6-912201fbc8f5 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:21:24.038174 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-de0f0784-a102-41b5-9fb6-912201fbc8f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:21:24.051581 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-566ef7a1-b404-4292-9b97-deaaa4586baa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2de3d1d79b14856ac7ebcc4aa70b498', 'request_id': 'req-566ef7a1-b404-4292-9b97-deaaa4586baa'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:24.061559 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-566ef7a1-b404-4292-9b97-deaaa4586baa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2de3d1d79b14856ac7ebcc4aa70b498', 'request_id': 'req-566ef7a1-b404-4292-9b97-deaaa4586baa'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:24.078197 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-566ef7a1-b404-4292-9b97-deaaa4586baa admin admin] The token cache is being invalidate because project a2de3d1d79b14856ac7ebcc4aa70b498 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79994) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:21:24.078469 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-566ef7a1-b404-4292-9b97-deaaa4586baa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:24.079383 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-566ef7a1-b404-4292-9b97-deaaa4586baa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:24.081406 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 903/1790] 10.222.0.70 () {58 vars in 1232 bytes} [Tue May 10 19:21:23 2022] DELETE /identity/v3/projects/a2de3d1d79b14856ac7ebcc4aa70b498 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:21:24.090318 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566ef7a1-b404-4292-9b97-deaaa4586baa admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:24.091973 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-566ef7a1-b404-4292-9b97-deaaa4586baa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:21:24.133976 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 888/1791] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:21:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:21:24.134874 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0f0784-a102-41b5-9fb6-912201fbc8f5 None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:24.138397 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-de0f0784-a102-41b5-9fb6-912201fbc8f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:21:24.187262 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566ef7a1-b404-4292-9b97-deaaa4586baa admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:24.192930 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5632ded5-8c7d-4a47-a4bd-f539cbda51bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:24.194266 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5632ded5-8c7d-4a47-a4bd-f539cbda51bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:24.194389 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5632ded5-8c7d-4a47-a4bd-f539cbda51bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:24.194640 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5632ded5-8c7d-4a47-a4bd-f539cbda51bd admin admin] PATH_INFO: `/v3/users/2ea0890674e445ceb6111e63a4552dd3` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:24.196924 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5632ded5-8c7d-4a47-a4bd-f539cbda51bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ea0890674e445ceb6111e63a4552dd3)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:24.199356 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5632ded5-8c7d-4a47-a4bd-f539cbda51bd admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:24.236875 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0f0784-a102-41b5-9fb6-912201fbc8f5 None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:24.242110 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987d4afc-69e8-49e5-908f-0541452f2695 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15df2a8967aa43299c10e365f4200d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:24.243123 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987d4afc-69e8-49e5-908f-0541452f2695 service cinder] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:24.243609 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987d4afc-69e8-49e5-908f-0541452f2695 service cinder] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:24.244060 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987d4afc-69e8-49e5-908f-0541452f2695 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:24.246417 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-987d4afc-69e8-49e5-908f-0541452f2695 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:21:24.267434 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-5632ded5-8c7d-4a47-a4bd-f539cbda51bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ea0890674e445ceb6111e63a4552dd3'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:24.279746 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-5632ded5-8c7d-4a47-a4bd-f539cbda51bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ea0890674e445ceb6111e63a4552dd3'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:24.280677 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-5632ded5-8c7d-4a47-a4bd-f539cbda51bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ea0890674e445ceb6111e63a4552dd3'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:24.289290 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-5632ded5-8c7d-4a47-a4bd-f539cbda51bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ea0890674e445ceb6111e63a4552dd3'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:24.297997 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-5632ded5-8c7d-4a47-a4bd-f539cbda51bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ea0890674e445ceb6111e63a4552dd3'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:24.304658 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 904/1792] 10.222.0.70 () {58 vars in 1223 bytes} [Tue May 10 19:21:24 2022] DELETE /identity/v3/users/2ea0890674e445ceb6111e63a4552dd3 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:21:24.305459 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5632ded5-8c7d-4a47-a4bd-f539cbda51bd admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:24.306819 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-5632ded5-8c7d-4a47-a4bd-f539cbda51bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:21:24.333733 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987d4afc-69e8-49e5-908f-0541452f2695 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:24.335475 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987d4afc-69e8-49e5-908f-0541452f2695 service cinder] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:24.347934 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 889/1793] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:21:24 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:21:24.394322 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5632ded5-8c7d-4a47-a4bd-f539cbda51bd admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:24.401344 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5022dbb4-05fd-479e-9ee5-e2213765790f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:24.403835 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5022dbb4-05fd-479e-9ee5-e2213765790f admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:24.404235 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5022dbb4-05fd-479e-9ee5-e2213765790f admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:24.404729 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5022dbb4-05fd-479e-9ee5-e2213765790f admin admin] PATH_INFO: `/v3/domains` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:24.406323 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5022dbb4-05fd-479e-9ee5-e2213765790f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:21:24.406739 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5022dbb4-05fd-479e-9ee5-e2213765790f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:24.408943 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5022dbb4-05fd-479e-9ee5-e2213765790f admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:24.427234 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 905/1794] 10.222.0.70 () {58 vars in 1152 bytes} [Tue May 10 19:21:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:21:24.432277 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987d4afc-69e8-49e5-908f-0541452f2695 service cinder] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:24.453714 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987d4afc-69e8-49e5-908f-0541452f2695 service cinder] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:24.466063 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9abcee-d400-4e17-8b13-867abc3cd0a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:24.466827 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9abcee-d400-4e17-8b13-867abc3cd0a2 admin admin] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:24.467558 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9abcee-d400-4e17-8b13-867abc3cd0a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:24.467916 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9abcee-d400-4e17-8b13-867abc3cd0a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:24.468739 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9abcee-d400-4e17-8b13-867abc3cd0a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:24.471101 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9abcee-d400-4e17-8b13-867abc3cd0a2 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:24.515034 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5022dbb4-05fd-479e-9ee5-e2213765790f admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:24.517169 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 890/1795] 10.222.0.70 () {60 vars in 1152 bytes} [Tue May 10 19:21:24 2022] POST /identity/v3/projects => generated 393 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:21:24.533675 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5022dbb4-05fd-479e-9ee5-e2213765790f admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:24.670611 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a19ae3d-51ce-4e8c-9444-17a8db93b3fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:24.671347 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a19ae3d-51ce-4e8c-9444-17a8db93b3fe admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:24.671624 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a19ae3d-51ce-4e8c-9444-17a8db93b3fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:24.671894 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a19ae3d-51ce-4e8c-9444-17a8db93b3fe admin admin] PATH_INFO: `/v3/users` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:24.672675 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a19ae3d-51ce-4e8c-9444-17a8db93b3fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:24.674799 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a19ae3d-51ce-4e8c-9444-17a8db93b3fe admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:24.697284 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 906/1796] 10.222.0.70 () {60 vars in 1143 bytes} [Tue May 10 19:21:24 2022] POST /identity/v3/users => generated 297 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 19:21:24.701696 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9abcee-d400-4e17-8b13-867abc3cd0a2 admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:24.716600 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9abcee-d400-4e17-8b13-867abc3cd0a2 admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:24.727213 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b44e9eb-11b5-4ba3-8dd8-7cf534828c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:24.728466 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b44e9eb-11b5-4ba3-8dd8-7cf534828c05 admin admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:24.729325 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b44e9eb-11b5-4ba3-8dd8-7cf534828c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:24.730922 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b44e9eb-11b5-4ba3-8dd8-7cf534828c05 admin admin] PATH_INFO: `/v3/roles` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:24.731812 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b44e9eb-11b5-4ba3-8dd8-7cf534828c05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:24.736047 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b44e9eb-11b5-4ba3-8dd8-7cf534828c05 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:24.754301 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 891/1797] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:21:24 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:21:24.758377 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a19ae3d-51ce-4e8c-9444-17a8db93b3fe admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:24.765878 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b44e9eb-11b5-4ba3-8dd8-7cf534828c05 admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:24.768992 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-5b44e9eb-11b5-4ba3-8dd8-7cf534828c05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:21:24.769561 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a19ae3d-51ce-4e8c-9444-17a8db93b3fe admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:24.787707 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b44e9eb-11b5-4ba3-8dd8-7cf534828c05 admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:24.788207 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f8c678-1ebf-4802-a69b-9f3ec7f38efd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:24.790004 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f8c678-1ebf-4802-a69b-9f3ec7f38efd admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:24.790004 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f8c678-1ebf-4802-a69b-9f3ec7f38efd admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:24.790004 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f8c678-1ebf-4802-a69b-9f3ec7f38efd admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:24.790862 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f8c678-1ebf-4802-a69b-9f3ec7f38efd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:24.795029 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f8c678-1ebf-4802-a69b-9f3ec7f38efd admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:24.800766 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b486521-3622-4264-9755-0333be46eefd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:24.802315 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b486521-3622-4264-9755-0333be46eefd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:24.802395 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b486521-3622-4264-9755-0333be46eefd admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:24.802783 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b486521-3622-4264-9755-0333be46eefd admin admin] PATH_INFO: `/v3/projects/9a9504957ba04447aab8bcb83d9fa8d6` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:24.804254 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b486521-3622-4264-9755-0333be46eefd admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a9504957ba04447aab8bcb83d9fa8d6)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:24.806773 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b486521-3622-4264-9755-0333be46eefd admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:24.814596 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 907/1798] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:21:24 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 19:21:24.818676 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f8c678-1ebf-4802-a69b-9f3ec7f38efd admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:24.829408 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f8c678-1ebf-4802-a69b-9f3ec7f38efd admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:24.835336 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d8bcf6-829f-43c4-8183-c53de4f4a6c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:24.836565 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d8bcf6-829f-43c4-8183-c53de4f4a6c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:24.836859 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d8bcf6-829f-43c4-8183-c53de4f4a6c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:24.837210 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d8bcf6-829f-43c4-8183-c53de4f4a6c2 admin admin] PATH_INFO: `/v3/projects/b1b4ec13b8864a6892712706f49669a2/users/7fa8fdf7b3f84f36b19d0bd822f47315/roles/5c07cf5bfbd3427db18428aa50420962` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:24.855241 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d8bcf6-829f-43c4-8183-c53de4f4a6c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1b4ec13b8864a6892712706f49669a2, user_id=7fa8fdf7b3f84f36b19d0bd822f47315, role_id=5c07cf5bfbd3427db18428aa50420962)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:24.858264 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d8bcf6-829f-43c4-8183-c53de4f4a6c2 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:24.860930 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-6b486521-3622-4264-9755-0333be46eefd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a9504957ba04447aab8bcb83d9fa8d6', 'request_id': 'req-6b486521-3622-4264-9755-0333be46eefd'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:24.866747 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-6b486521-3622-4264-9755-0333be46eefd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a9504957ba04447aab8bcb83d9fa8d6', 'request_id': 'req-6b486521-3622-4264-9755-0333be46eefd'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:24.874409 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 908/1799] 10.222.0.70 () {60 vars in 1482 bytes} [Tue May 10 19:21:24 2022] PUT /identity/v3/projects/b1b4ec13b8864a6892712706f49669a2/users/7fa8fdf7b3f84f36b19d0bd822f47315/roles/5c07cf5bfbd3427db18428aa50420962 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 19:21:24.877135 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-6b486521-3622-4264-9755-0333be46eefd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a9504957ba04447aab8bcb83d9fa8d6', 'request_id': 'req-6b486521-3622-4264-9755-0333be46eefd'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:24.886215 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862859d8-0116-4971-8a80-15563b0de8d0 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:24.886504 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862859d8-0116-4971-8a80-15563b0de8d0 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:24.886781 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862859d8-0116-4971-8a80-15563b0de8d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:24.890033 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-6b486521-3622-4264-9755-0333be46eefd admin admin] The token cache is being invalidate because project 9a9504957ba04447aab8bcb83d9fa8d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79993) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:21:24.890323 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-6b486521-3622-4264-9755-0333be46eefd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:24.891075 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-6b486521-3622-4264-9755-0333be46eefd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:24.892961 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 892/1800] 10.222.0.70 () {58 vars in 1232 bytes} [Tue May 10 19:21:24 2022] DELETE /identity/v3/projects/9a9504957ba04447aab8bcb83d9fa8d6 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 19:21:24.901127 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc25193-a5ff-4c19-8d7e-5a83da322418 None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:24.902544 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc25193-a5ff-4c19-8d7e-5a83da322418 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:24.902850 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc25193-a5ff-4c19-8d7e-5a83da322418 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:24.920950 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-862859d8-0116-4971-8a80-15563b0de8d0 None None] MFA Rules not processed for user `7fa8fdf7b3f84f36b19d0bd822f47315`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:21:24.921319 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-9bc25193-a5ff-4c19-8d7e-5a83da322418 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:21:24.922580 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-862859d8-0116-4971-8a80-15563b0de8d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:21:24.922842 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-9bc25193-a5ff-4c19-8d7e-5a83da322418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:21:25.040069 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 909/1801] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:21:24 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:21:25.046038 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862859d8-0116-4971-8a80-15563b0de8d0 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:25.047347 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-862859d8-0116-4971-8a80-15563b0de8d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:21:25.062992 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 893/1802] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:21:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:21:25.064563 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8e7bd2-52b9-4b69-9724-44f6f423617c None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:25.064863 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8e7bd2-52b9-4b69-9724-44f6f423617c None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:25.065155 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8e7bd2-52b9-4b69-9724-44f6f423617c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:25.083985 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862859d8-0116-4971-8a80-15563b0de8d0 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:25.098477 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0252530a-71a7-47b0-b5b7-e0b37306ce6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:25.099333 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0252530a-71a7-47b0-b5b7-e0b37306ce6a admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:25.099809 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0252530a-71a7-47b0-b5b7-e0b37306ce6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:25.100223 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0252530a-71a7-47b0-b5b7-e0b37306ce6a admin admin] PATH_INFO: `/v3/projects` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:25.101131 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0252530a-71a7-47b0-b5b7-e0b37306ce6a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:25.108234 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-0a8e7bd2-52b9-4b69-9724-44f6f423617c None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:21:25.109890 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0252530a-71a7-47b0-b5b7-e0b37306ce6a admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:25.111325 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-0a8e7bd2-52b9-4b69-9724-44f6f423617c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:21:25.136217 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 894/1803] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:21:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:21:25.137264 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8e7bd2-52b9-4b69-9724-44f6f423617c None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:25.144921 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 910/1804] 10.222.0.70 () {60 vars in 1152 bytes} [Tue May 10 19:21:25 2022] POST /identity/v3/projects => generated 391 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:21:25.146111 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0252530a-71a7-47b0-b5b7-e0b37306ce6a admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:25.156368 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8e7bd2-52b9-4b69-9724-44f6f423617c None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:25.216514 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0252530a-71a7-47b0-b5b7-e0b37306ce6a admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:25.223352 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59730b2-45c9-48f8-8775-99251aa14b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:25.225025 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59730b2-45c9-48f8-8775-99251aa14b13 admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:25.225025 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59730b2-45c9-48f8-8775-99251aa14b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:25.225025 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59730b2-45c9-48f8-8775-99251aa14b13 admin admin] PATH_INFO: `/v3/users` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:25.226759 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59730b2-45c9-48f8-8775-99251aa14b13 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:25.227660 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59730b2-45c9-48f8-8775-99251aa14b13 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:25.270012 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 911/1805] 10.222.0.70 () {60 vars in 1143 bytes} [Tue May 10 19:21:25 2022] POST /identity/v3/users => generated 302 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:21:25.270197 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8872f8-a55d-4f72-b559-4b4fffa5a7ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:25.270801 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8872f8-a55d-4f72-b559-4b4fffa5a7ad admin admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:25.271091 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8872f8-a55d-4f72-b559-4b4fffa5a7ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:25.271371 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8872f8-a55d-4f72-b559-4b4fffa5a7ad admin admin] PATH_INFO: `/v3/domains` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:25.272100 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8872f8-a55d-4f72-b559-4b4fffa5a7ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:21:25.272410 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8872f8-a55d-4f72-b559-4b4fffa5a7ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:25.274300 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8872f8-a55d-4f72-b559-4b4fffa5a7ad admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:25.276348 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59730b2-45c9-48f8-8775-99251aa14b13 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:25.290928 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 895/1806] 10.222.0.70 () {58 vars in 1152 bytes} [Tue May 10 19:21:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:21:25.295553 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8872f8-a55d-4f72-b559-4b4fffa5a7ad admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:25.301141 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59730b2-45c9-48f8-8775-99251aa14b13 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:25.313320 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ec9722-efc0-498a-9fc5-533190bc41f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:25.313665 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8872f8-a55d-4f72-b559-4b4fffa5a7ad admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:25.314361 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ec9722-efc0-498a-9fc5-533190bc41f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:25.314559 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ec9722-efc0-498a-9fc5-533190bc41f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:25.316453 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ec9722-efc0-498a-9fc5-533190bc41f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:25.317545 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ec9722-efc0-498a-9fc5-533190bc41f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:25.322178 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c8a25f-8b2a-49ba-a237-18be67a241c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:25.324110 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c8a25f-8b2a-49ba-a237-18be67a241c9 admin admin] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:25.325945 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ec9722-efc0-498a-9fc5-533190bc41f7 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:25.326451 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c8a25f-8b2a-49ba-a237-18be67a241c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:25.326904 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c8a25f-8b2a-49ba-a237-18be67a241c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:25.327788 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c8a25f-8b2a-49ba-a237-18be67a241c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:25.333812 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c8a25f-8b2a-49ba-a237-18be67a241c9 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:25.340813 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 912/1807] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:21:25 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:21:25.344929 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ec9722-efc0-498a-9fc5-533190bc41f7 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:25.361635 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ec9722-efc0-498a-9fc5-533190bc41f7 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:25.375237 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eb4466-c13a-444f-8d01-9e09539764aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:25.377729 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eb4466-c13a-444f-8d01-9e09539764aa admin admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:25.378146 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eb4466-c13a-444f-8d01-9e09539764aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:25.378449 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eb4466-c13a-444f-8d01-9e09539764aa admin admin] PATH_INFO: `/v3/projects/ab1308814a40498a8f9df0befa3ffdb9/users/4ad07bba55254e2d922e4414e6411ab6/roles/634ba284303b4626b5a0402772c68f5c` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:25.403763 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 896/1808] 10.222.0.70 () {60 vars in 1152 bytes} [Tue May 10 19:21:25 2022] POST /identity/v3/projects => generated 375 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:21:25.405283 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c8a25f-8b2a-49ba-a237-18be67a241c9 admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:25.431100 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54eb4466-c13a-444f-8d01-9e09539764aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab1308814a40498a8f9df0befa3ffdb9, user_id=4ad07bba55254e2d922e4414e6411ab6, role_id=634ba284303b4626b5a0402772c68f5c)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:25.436250 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54eb4466-c13a-444f-8d01-9e09539764aa admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:25.476724 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 913/1809] 10.222.0.70 () {60 vars in 1482 bytes} [Tue May 10 19:21:25 2022] PUT /identity/v3/projects/ab1308814a40498a8f9df0befa3ffdb9/users/4ad07bba55254e2d922e4414e6411ab6/roles/634ba284303b4626b5a0402772c68f5c => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 19:21:25.476724 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eb4466-c13a-444f-8d01-9e09539764aa admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:25.526048 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c8a25f-8b2a-49ba-a237-18be67a241c9 admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:25.565676 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eb4466-c13a-444f-8d01-9e09539764aa admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:25.571054 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01be98e-4aca-46ad-9691-6c1a875b2829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:25.572013 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01be98e-4aca-46ad-9691-6c1a875b2829 admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:25.572511 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01be98e-4aca-46ad-9691-6c1a875b2829 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:25.572992 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01be98e-4aca-46ad-9691-6c1a875b2829 admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:25.574648 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01be98e-4aca-46ad-9691-6c1a875b2829 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:25.576864 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01be98e-4aca-46ad-9691-6c1a875b2829 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:25.590008 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 914/1810] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:21:25 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 19:21:25.594264 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01be98e-4aca-46ad-9691-6c1a875b2829 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:25.606593 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1d08a4-3619-4bb8-8c66-d211e394e0d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:25.607226 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1d08a4-3619-4bb8-8c66-d211e394e0d0 admin admin] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:25.607511 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1d08a4-3619-4bb8-8c66-d211e394e0d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:25.609072 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1d08a4-3619-4bb8-8c66-d211e394e0d0 admin admin] PATH_INFO: `/v3/users` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:25.609775 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1d08a4-3619-4bb8-8c66-d211e394e0d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:25.612319 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1d08a4-3619-4bb8-8c66-d211e394e0d0 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:25.621197 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01be98e-4aca-46ad-9691-6c1a875b2829 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:25.628742 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a4b52a-9da4-4def-85c5-9c704ad62fd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:25.629473 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a4b52a-9da4-4def-85c5-9c704ad62fd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:25.629765 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a4b52a-9da4-4def-85c5-9c704ad62fd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:25.630055 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a4b52a-9da4-4def-85c5-9c704ad62fd1 admin admin] PATH_INFO: `/v3/projects/ab1308814a40498a8f9df0befa3ffdb9/users/4ad07bba55254e2d922e4414e6411ab6/roles/634ba284303b4626b5a0402772c68f5c` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:25.637079 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a4b52a-9da4-4def-85c5-9c704ad62fd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab1308814a40498a8f9df0befa3ffdb9, user_id=4ad07bba55254e2d922e4414e6411ab6, role_id=634ba284303b4626b5a0402772c68f5c)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:25.639477 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a4b52a-9da4-4def-85c5-9c704ad62fd1 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:25.645944 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 897/1811] 10.222.0.70 () {60 vars in 1143 bytes} [Tue May 10 19:21:25 2022] POST /identity/v3/users => generated 288 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 19:21:25.656952 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1d08a4-3619-4bb8-8c66-d211e394e0d0 admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:25.667002 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 915/1812] 10.222.0.70 () {60 vars in 1482 bytes} [Tue May 10 19:21:25 2022] PUT /identity/v3/projects/ab1308814a40498a8f9df0befa3ffdb9/users/4ad07bba55254e2d922e4414e6411ab6/roles/634ba284303b4626b5a0402772c68f5c => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:21:25.685340 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5729af-6306-463b-b0ed-c8391cd93dd1 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:25.685630 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5729af-6306-463b-b0ed-c8391cd93dd1 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:25.685909 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5729af-6306-463b-b0ed-c8391cd93dd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:25.694602 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1d08a4-3619-4bb8-8c66-d211e394e0d0 admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:25.723629 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-0c5729af-6306-463b-b0ed-c8391cd93dd1 None None] MFA Rules not processed for user `4ad07bba55254e2d922e4414e6411ab6`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:21:25.725162 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-0c5729af-6306-463b-b0ed-c8391cd93dd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:21:25.766878 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f160bb-476c-4eb0-895d-69c21c890cbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:25.767550 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f160bb-476c-4eb0-895d-69c21c890cbe admin admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:25.767835 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f160bb-476c-4eb0-895d-69c21c890cbe admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:25.768107 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f160bb-476c-4eb0-895d-69c21c890cbe admin admin] PATH_INFO: `/v3/roles` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:25.769095 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f160bb-476c-4eb0-895d-69c21c890cbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:25.770700 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f160bb-476c-4eb0-895d-69c21c890cbe admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:25.784999 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 898/1813] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:21:25 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 19:21:25.786718 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f160bb-476c-4eb0-895d-69c21c890cbe admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:25.797778 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f160bb-476c-4eb0-895d-69c21c890cbe admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:25.804220 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a590c9ca-907d-4f59-a26a-d35de0952f13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:25.805235 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a590c9ca-907d-4f59-a26a-d35de0952f13 admin admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:25.805726 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a590c9ca-907d-4f59-a26a-d35de0952f13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:25.806207 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a590c9ca-907d-4f59-a26a-d35de0952f13 admin admin] PATH_INFO: `/v3/roles` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:25.807114 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a590c9ca-907d-4f59-a26a-d35de0952f13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:25.809642 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a590c9ca-907d-4f59-a26a-d35de0952f13 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:25.821929 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 916/1814] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:21:25 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:21:25.829802 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5729af-6306-463b-b0ed-c8391cd93dd1 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:25.833507 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-0c5729af-6306-463b-b0ed-c8391cd93dd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:21:25.833733 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 899/1815] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:21:25 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:21:25.837955 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a590c9ca-907d-4f59-a26a-d35de0952f13 admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:25.849230 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a590c9ca-907d-4f59-a26a-d35de0952f13 admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:25.856544 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f800b20e-e822-43f8-8c9a-920c43357c07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:25.857738 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f800b20e-e822-43f8-8c9a-920c43357c07 admin admin] REQUEST_METHOD: `PUT` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:25.858089 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f800b20e-e822-43f8-8c9a-920c43357c07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:25.858468 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f800b20e-e822-43f8-8c9a-920c43357c07 admin admin] PATH_INFO: `/v3/projects/2e92758b0ab445ae80cb636133b5d245/users/b0af823276aa42339b1832983d57d3ba/roles/5c07cf5bfbd3427db18428aa50420962` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:25.876589 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f800b20e-e822-43f8-8c9a-920c43357c07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e92758b0ab445ae80cb636133b5d245, user_id=b0af823276aa42339b1832983d57d3ba, role_id=5c07cf5bfbd3427db18428aa50420962)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:25.880950 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f800b20e-e822-43f8-8c9a-920c43357c07 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:25.898715 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 900/1816] 10.222.0.70 () {60 vars in 1482 bytes} [Tue May 10 19:21:25 2022] PUT /identity/v3/projects/2e92758b0ab445ae80cb636133b5d245/users/b0af823276aa42339b1832983d57d3ba/roles/5c07cf5bfbd3427db18428aa50420962 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 19:21:25.909078 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13abf39b-e42d-42b7-a534-bee6fcf30d73 None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:25.909568 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13abf39b-e42d-42b7-a534-bee6fcf30d73 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:25.909898 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13abf39b-e42d-42b7-a534-bee6fcf30d73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:25.923010 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5729af-6306-463b-b0ed-c8391cd93dd1 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:25.966568 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-13abf39b-e42d-42b7-a534-bee6fcf30d73 None None] MFA Rules not processed for user `b0af823276aa42339b1832983d57d3ba`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:21:25.968645 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-13abf39b-e42d-42b7-a534-bee6fcf30d73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:21:26.019297 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aedeef-d6b7-4d9c-a66e-b4579c24332e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15df2a8967aa43299c10e365f4200d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:26.020729 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aedeef-d6b7-4d9c-a66e-b4579c24332e service cinder] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:26.023377 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aedeef-d6b7-4d9c-a66e-b4579c24332e service cinder] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:26.023850 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aedeef-d6b7-4d9c-a66e-b4579c24332e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:26.099979 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 901/1817] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:21:25 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:21:26.109447 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13abf39b-e42d-42b7-a534-bee6fcf30d73 None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:26.113300 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-13abf39b-e42d-42b7-a534-bee6fcf30d73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:21:26.198664 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89aedeef-d6b7-4d9c-a66e-b4579c24332e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:26.201684 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89aedeef-d6b7-4d9c-a66e-b4579c24332e service cinder] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:26.225770 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 917/1818] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:21:25 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:21:26.243288 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13abf39b-e42d-42b7-a534-bee6fcf30d73 None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:26.252968 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329f0323-d1fa-42aa-94d7-408fa9b2dfeb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24ca97ff2a1745e58dedba4cef61b3f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:26.254103 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329f0323-d1fa-42aa-94d7-408fa9b2dfeb service glance] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:26.254459 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329f0323-d1fa-42aa-94d7-408fa9b2dfeb service glance] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:26.254745 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329f0323-d1fa-42aa-94d7-408fa9b2dfeb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:26.282075 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329f0323-d1fa-42aa-94d7-408fa9b2dfeb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:26.285007 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329f0323-d1fa-42aa-94d7-408fa9b2dfeb service glance] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:26.298465 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 902/1819] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:21:26 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 19:21:26.358401 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aedeef-d6b7-4d9c-a66e-b4579c24332e service cinder] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:26.370111 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aedeef-d6b7-4d9c-a66e-b4579c24332e service cinder] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:26.378394 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c295c6-d5c6-4d59-b0c1-3312acf12dd2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15df2a8967aa43299c10e365f4200d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:26.380810 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c295c6-d5c6-4d59-b0c1-3312acf12dd2 service cinder] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:26.382121 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c295c6-d5c6-4d59-b0c1-3312acf12dd2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:26.383456 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c295c6-d5c6-4d59-b0c1-3312acf12dd2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:26.540241 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c295c6-d5c6-4d59-b0c1-3312acf12dd2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:26.544655 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c295c6-d5c6-4d59-b0c1-3312acf12dd2 service cinder] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:26.585895 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 918/1820] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:21:26 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:21:31.905488 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329f0323-d1fa-42aa-94d7-408fa9b2dfeb service glance] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:32.003453 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329f0323-d1fa-42aa-94d7-408fa9b2dfeb service glance] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:32.008362 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e8259b-749b-4839-8577-0369c7a9c822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:32.009387 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e8259b-749b-4839-8577-0369c7a9c822 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:32.009678 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e8259b-749b-4839-8577-0369c7a9c822 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:32.009957 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e8259b-749b-4839-8577-0369c7a9c822 admin admin] PATH_INFO: `/v3/users/7fa8fdf7b3f84f36b19d0bd822f47315` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:32.011224 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e8259b-749b-4839-8577-0369c7a9c822 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7fa8fdf7b3f84f36b19d0bd822f47315)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:32.013377 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e8259b-749b-4839-8577-0369c7a9c822 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:32.084381 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-34e8259b-749b-4839-8577-0369c7a9c822 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7fa8fdf7b3f84f36b19d0bd822f47315'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:32.097705 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-34e8259b-749b-4839-8577-0369c7a9c822 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7fa8fdf7b3f84f36b19d0bd822f47315'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:32.108821 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-34e8259b-749b-4839-8577-0369c7a9c822 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7fa8fdf7b3f84f36b19d0bd822f47315'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:32.109568 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-34e8259b-749b-4839-8577-0369c7a9c822 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7fa8fdf7b3f84f36b19d0bd822f47315'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:32.116930 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-34e8259b-749b-4839-8577-0369c7a9c822 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7fa8fdf7b3f84f36b19d0bd822f47315'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:32.122842 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 903/1821] 10.222.0.70 () {58 vars in 1223 bytes} [Tue May 10 19:21:31 2022] DELETE /identity/v3/users/7fa8fdf7b3f84f36b19d0bd822f47315 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:21:32.127528 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8a32ac-59ab-4b7e-8782-b88f2719f8ec None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:32.128006 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8a32ac-59ab-4b7e-8782-b88f2719f8ec None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:32.128324 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8a32ac-59ab-4b7e-8782-b88f2719f8ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:32.145695 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-8d8a32ac-59ab-4b7e-8782-b88f2719f8ec None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:21:32.146925 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-8d8a32ac-59ab-4b7e-8782-b88f2719f8ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:21:32.214735 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 919/1822] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:21:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:21:32.225436 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e8259b-749b-4839-8577-0369c7a9c822 admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:32.226998 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-34e8259b-749b-4839-8577-0369c7a9c822 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:21:32.286348 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e8259b-749b-4839-8577-0369c7a9c822 admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:32.290013 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304efaff-cf04-405d-83f4-c63d06460634 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f1dc79540b48c0866478cc48cd8205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:32.290661 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304efaff-cf04-405d-83f4-c63d06460634 service neutron] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:32.290943 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304efaff-cf04-405d-83f4-c63d06460634 service neutron] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:32.291221 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304efaff-cf04-405d-83f4-c63d06460634 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:32.301492 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304efaff-cf04-405d-83f4-c63d06460634 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:32.302959 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304efaff-cf04-405d-83f4-c63d06460634 service neutron] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:32.312912 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 904/1823] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:21:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:21:32.638282 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8a32ac-59ab-4b7e-8782-b88f2719f8ec None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:32.641916 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-8d8a32ac-59ab-4b7e-8782-b88f2719f8ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:21:32.678851 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8a32ac-59ab-4b7e-8782-b88f2719f8ec None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:32.685886 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2c7283-338a-485c-8d6a-2e09858309be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:32.687454 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2c7283-338a-485c-8d6a-2e09858309be admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:32.687454 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2c7283-338a-485c-8d6a-2e09858309be admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:32.687799 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2c7283-338a-485c-8d6a-2e09858309be admin admin] PATH_INFO: `/v3/projects/b1b4ec13b8864a6892712706f49669a2` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:32.689170 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2c7283-338a-485c-8d6a-2e09858309be admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1b4ec13b8864a6892712706f49669a2)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:32.691611 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2c7283-338a-485c-8d6a-2e09858309be admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:32.747470 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-8b2c7283-338a-485c-8d6a-2e09858309be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1b4ec13b8864a6892712706f49669a2', 'request_id': 'req-8b2c7283-338a-485c-8d6a-2e09858309be'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:32.754688 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-8b2c7283-338a-485c-8d6a-2e09858309be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1b4ec13b8864a6892712706f49669a2', 'request_id': 'req-8b2c7283-338a-485c-8d6a-2e09858309be'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:32.763052 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-8b2c7283-338a-485c-8d6a-2e09858309be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1b4ec13b8864a6892712706f49669a2', 'request_id': 'req-8b2c7283-338a-485c-8d6a-2e09858309be'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:32.774566 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-8b2c7283-338a-485c-8d6a-2e09858309be admin admin] The token cache is being invalidate because project b1b4ec13b8864a6892712706f49669a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79994) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:21:32.774851 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-8b2c7283-338a-485c-8d6a-2e09858309be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:32.775499 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-8b2c7283-338a-485c-8d6a-2e09858309be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:32.777746 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 920/1824] 10.222.0.70 () {58 vars in 1232 bytes} [Tue May 10 19:21:32 2022] DELETE /identity/v3/projects/b1b4ec13b8864a6892712706f49669a2 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:21:32.781554 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304efaff-cf04-405d-83f4-c63d06460634 service neutron] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:32.793550 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304efaff-cf04-405d-83f4-c63d06460634 service neutron] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:32.884026 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e66bda1-c52e-4dd1-a188-98e6a5a44f36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:32.885479 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e66bda1-c52e-4dd1-a188-98e6a5a44f36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:32.885875 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e66bda1-c52e-4dd1-a188-98e6a5a44f36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:32.886221 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e66bda1-c52e-4dd1-a188-98e6a5a44f36 admin admin] PATH_INFO: `/v3/users/4ad07bba55254e2d922e4414e6411ab6` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:32.887623 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e66bda1-c52e-4dd1-a188-98e6a5a44f36 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ad07bba55254e2d922e4414e6411ab6)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:32.889722 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e66bda1-c52e-4dd1-a188-98e6a5a44f36 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:32.939492 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-8e66bda1-c52e-4dd1-a188-98e6a5a44f36 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ad07bba55254e2d922e4414e6411ab6'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:32.962813 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-8e66bda1-c52e-4dd1-a188-98e6a5a44f36 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ad07bba55254e2d922e4414e6411ab6'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:32.970086 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-8e66bda1-c52e-4dd1-a188-98e6a5a44f36 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ad07bba55254e2d922e4414e6411ab6'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:32.970844 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-8e66bda1-c52e-4dd1-a188-98e6a5a44f36 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ad07bba55254e2d922e4414e6411ab6'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:32.978083 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-8e66bda1-c52e-4dd1-a188-98e6a5a44f36 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ad07bba55254e2d922e4414e6411ab6'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:32.984911 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 905/1825] 10.222.0.70 () {58 vars in 1223 bytes} [Tue May 10 19:21:32 2022] DELETE /identity/v3/users/4ad07bba55254e2d922e4414e6411ab6 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 19:21:33.469560 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2c7283-338a-485c-8d6a-2e09858309be admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:33.471012 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-8b2c7283-338a-485c-8d6a-2e09858309be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:21:33.485044 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2c7283-338a-485c-8d6a-2e09858309be admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:33.551259 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c956e67-5c97-461f-9e00-8d70166df973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:33.552133 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c956e67-5c97-461f-9e00-8d70166df973 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:33.552432 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c956e67-5c97-461f-9e00-8d70166df973 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:33.552721 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c956e67-5c97-461f-9e00-8d70166df973 admin admin] PATH_INFO: `/v3/projects/ab1308814a40498a8f9df0befa3ffdb9` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:33.554132 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c956e67-5c97-461f-9e00-8d70166df973 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab1308814a40498a8f9df0befa3ffdb9)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:33.556085 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c956e67-5c97-461f-9e00-8d70166df973 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:33.612927 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-4c956e67-5c97-461f-9e00-8d70166df973 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab1308814a40498a8f9df0befa3ffdb9', 'request_id': 'req-4c956e67-5c97-461f-9e00-8d70166df973'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:33.622479 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-4c956e67-5c97-461f-9e00-8d70166df973 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab1308814a40498a8f9df0befa3ffdb9', 'request_id': 'req-4c956e67-5c97-461f-9e00-8d70166df973'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:33.630942 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-4c956e67-5c97-461f-9e00-8d70166df973 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab1308814a40498a8f9df0befa3ffdb9', 'request_id': 'req-4c956e67-5c97-461f-9e00-8d70166df973'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:33.644611 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-4c956e67-5c97-461f-9e00-8d70166df973 admin admin] The token cache is being invalidate because project ab1308814a40498a8f9df0befa3ffdb9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79994) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:21:33.644948 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-4c956e67-5c97-461f-9e00-8d70166df973 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:33.645539 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-4c956e67-5c97-461f-9e00-8d70166df973 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:33.647635 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 921/1826] 10.222.0.70 () {58 vars in 1232 bytes} [Tue May 10 19:21:33 2022] DELETE /identity/v3/projects/ab1308814a40498a8f9df0befa3ffdb9 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 19:21:33.654050 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacb8a0c-cc89-48f4-a43f-c67c4aca56ae None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:33.654289 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacb8a0c-cc89-48f4-a43f-c67c4aca56ae None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:33.654746 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacb8a0c-cc89-48f4-a43f-c67c4aca56ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:33.674049 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-dacb8a0c-cc89-48f4-a43f-c67c4aca56ae None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:21:33.675274 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-dacb8a0c-cc89-48f4-a43f-c67c4aca56ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:21:33.745399 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 906/1827] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:21:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:21:33.753454 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ef110a-699b-4ea7-b417-ca5511b4eaa9 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:33.753857 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ef110a-699b-4ea7-b417-ca5511b4eaa9 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:33.754068 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ef110a-699b-4ea7-b417-ca5511b4eaa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:33.779594 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-37ef110a-699b-4ea7-b417-ca5511b4eaa9 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:21:33.780965 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-37ef110a-699b-4ea7-b417-ca5511b4eaa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:21:33.789942 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 922/1828] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:21:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:21:33.795037 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacb8a0c-cc89-48f4-a43f-c67c4aca56ae None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:33.812205 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacb8a0c-cc89-48f4-a43f-c67c4aca56ae None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:33.817465 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd531eac-e046-48fa-bd49-5796aa0679d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:33.818202 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd531eac-e046-48fa-bd49-5796aa0679d8 admin admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:33.818556 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd531eac-e046-48fa-bd49-5796aa0679d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:33.818901 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd531eac-e046-48fa-bd49-5796aa0679d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:33.819792 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd531eac-e046-48fa-bd49-5796aa0679d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:21:33.820166 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd531eac-e046-48fa-bd49-5796aa0679d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:33.821952 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd531eac-e046-48fa-bd49-5796aa0679d8 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:33.839578 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 907/1829] 10.222.0.70 () {58 vars in 1152 bytes} [Tue May 10 19:21:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:21:33.840922 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ef110a-699b-4ea7-b417-ca5511b4eaa9 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:33.850270 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ef110a-699b-4ea7-b417-ca5511b4eaa9 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:33.855277 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdd6fb8-9d52-4ccb-bd19-eda0ae8568ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:33.856042 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdd6fb8-9d52-4ccb-bd19-eda0ae8568ae admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:33.856445 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdd6fb8-9d52-4ccb-bd19-eda0ae8568ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:33.856867 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdd6fb8-9d52-4ccb-bd19-eda0ae8568ae admin admin] PATH_INFO: `/v3/projects` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:33.857568 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdd6fb8-9d52-4ccb-bd19-eda0ae8568ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:33.861549 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdd6fb8-9d52-4ccb-bd19-eda0ae8568ae admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:33.893178 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 923/1830] 10.222.0.70 () {60 vars in 1152 bytes} [Tue May 10 19:21:33 2022] POST /identity/v3/projects => generated 387 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:21:33.897314 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd531eac-e046-48fa-bd49-5796aa0679d8 admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:33.908657 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd531eac-e046-48fa-bd49-5796aa0679d8 admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:33.986733 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2feb018b-5676-4ad9-8f8b-3b1f3939d081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:33.989948 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feb018b-5676-4ad9-8f8b-3b1f3939d081 admin admin] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:33.990246 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feb018b-5676-4ad9-8f8b-3b1f3939d081 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:33.990560 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feb018b-5676-4ad9-8f8b-3b1f3939d081 admin admin] PATH_INFO: `/v3/users` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:33.991336 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2feb018b-5676-4ad9-8f8b-3b1f3939d081 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:33.993576 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2feb018b-5676-4ad9-8f8b-3b1f3939d081 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:34.020631 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 908/1831] 10.222.0.70 () {60 vars in 1143 bytes} [Tue May 10 19:21:33 2022] POST /identity/v3/users => generated 294 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:21:34.021772 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdd6fb8-9d52-4ccb-bd19-eda0ae8568ae admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:34.034676 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdd6fb8-9d52-4ccb-bd19-eda0ae8568ae admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:34.038982 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799da600-cb55-4030-89e7-fc607b501cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:34.039793 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799da600-cb55-4030-89e7-fc607b501cce admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:34.040296 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799da600-cb55-4030-89e7-fc607b501cce admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:34.040671 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799da600-cb55-4030-89e7-fc607b501cce admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:34.041611 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799da600-cb55-4030-89e7-fc607b501cce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:34.043811 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799da600-cb55-4030-89e7-fc607b501cce admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:34.062573 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 924/1832] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:21:34 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 19:21:34.064207 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2feb018b-5676-4ad9-8f8b-3b1f3939d081 admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:34.075561 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2feb018b-5676-4ad9-8f8b-3b1f3939d081 admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:34.080524 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c666397-91ec-4f16-a5c4-ee6973e54a2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:34.081224 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c666397-91ec-4f16-a5c4-ee6973e54a2c admin admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:34.081524 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c666397-91ec-4f16-a5c4-ee6973e54a2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:34.082014 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c666397-91ec-4f16-a5c4-ee6973e54a2c admin admin] PATH_INFO: `/v3/roles` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:34.083318 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c666397-91ec-4f16-a5c4-ee6973e54a2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:34.085528 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c666397-91ec-4f16-a5c4-ee6973e54a2c admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:34.097712 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 909/1833] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:21:34 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:21:34.102519 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799da600-cb55-4030-89e7-fc607b501cce admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:34.133934 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799da600-cb55-4030-89e7-fc607b501cce admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:34.139865 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa9aa0b-5a4f-43b3-be88-586f781948db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:34.141141 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa9aa0b-5a4f-43b3-be88-586f781948db admin admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:34.141452 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa9aa0b-5a4f-43b3-be88-586f781948db admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:34.141727 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa9aa0b-5a4f-43b3-be88-586f781948db admin admin] PATH_INFO: `/v3/projects/7e4e1824b43e482f85f7c8e073d31779/users/b267cff820044171adf9b50ae603e835/roles/5c07cf5bfbd3427db18428aa50420962` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:34.166116 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa9aa0b-5a4f-43b3-be88-586f781948db admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e4e1824b43e482f85f7c8e073d31779, user_id=b267cff820044171adf9b50ae603e835, role_id=5c07cf5bfbd3427db18428aa50420962)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:34.169412 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa9aa0b-5a4f-43b3-be88-586f781948db admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:34.190956 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 925/1834] 10.222.0.70 () {60 vars in 1482 bytes} [Tue May 10 19:21:34 2022] PUT /identity/v3/projects/7e4e1824b43e482f85f7c8e073d31779/users/b267cff820044171adf9b50ae603e835/roles/5c07cf5bfbd3427db18428aa50420962 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:21:34.197664 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b164fa-f53b-487d-acdf-b095f2ae49ad None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:34.198387 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b164fa-f53b-487d-acdf-b095f2ae49ad None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:34.198698 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b164fa-f53b-487d-acdf-b095f2ae49ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:34.226569 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-89b164fa-f53b-487d-acdf-b095f2ae49ad None None] MFA Rules not processed for user `b267cff820044171adf9b50ae603e835`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:21:34.227771 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-89b164fa-f53b-487d-acdf-b095f2ae49ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:21:34.293159 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 910/1835] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:21:34 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:21:34.298143 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa9aa0b-5a4f-43b3-be88-586f781948db admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:34.360448 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa9aa0b-5a4f-43b3-be88-586f781948db admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:34.365254 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3452bdf2-9dcd-4759-ab44-859e0c4f3706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:34.365913 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3452bdf2-9dcd-4759-ab44-859e0c4f3706 admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:34.366202 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3452bdf2-9dcd-4759-ab44-859e0c4f3706 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:34.366473 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3452bdf2-9dcd-4759-ab44-859e0c4f3706 admin admin] PATH_INFO: `/v3/projects` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:34.367156 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3452bdf2-9dcd-4759-ab44-859e0c4f3706 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:34.369092 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3452bdf2-9dcd-4759-ab44-859e0c4f3706 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:34.396858 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 926/1836] 10.222.0.70 () {60 vars in 1152 bytes} [Tue May 10 19:21:34 2022] POST /identity/v3/projects => generated 385 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 19:21:34.400605 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b164fa-f53b-487d-acdf-b095f2ae49ad None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:34.411139 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b164fa-f53b-487d-acdf-b095f2ae49ad None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:34.465672 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7ffbb0-9ad6-4b3d-86a9-27768cb74e4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:34.466374 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7ffbb0-9ad6-4b3d-86a9-27768cb74e4d admin admin] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:34.466686 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7ffbb0-9ad6-4b3d-86a9-27768cb74e4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:34.466964 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7ffbb0-9ad6-4b3d-86a9-27768cb74e4d admin admin] PATH_INFO: `/v3/users` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:34.467662 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7ffbb0-9ad6-4b3d-86a9-27768cb74e4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:34.469618 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7ffbb0-9ad6-4b3d-86a9-27768cb74e4d admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:34.502643 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 911/1837] 10.222.0.70 () {60 vars in 1143 bytes} [Tue May 10 19:21:34 2022] POST /identity/v3/users => generated 299 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:21:34.503621 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3452bdf2-9dcd-4759-ab44-859e0c4f3706 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:34.515503 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3452bdf2-9dcd-4759-ab44-859e0c4f3706 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:34.520973 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5300a0f2-b727-4d9b-a9ff-04a9d780b309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:34.521672 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5300a0f2-b727-4d9b-a9ff-04a9d780b309 admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:34.521960 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5300a0f2-b727-4d9b-a9ff-04a9d780b309 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:34.522237 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5300a0f2-b727-4d9b-a9ff-04a9d780b309 admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:34.523049 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5300a0f2-b727-4d9b-a9ff-04a9d780b309 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:34.524624 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5300a0f2-b727-4d9b-a9ff-04a9d780b309 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:34.569779 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 927/1838] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:21:34 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 19:21:34.573554 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7ffbb0-9ad6-4b3d-86a9-27768cb74e4d admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:34.601812 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7ffbb0-9ad6-4b3d-86a9-27768cb74e4d admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:34.609301 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050a7f5b-8607-4ece-aadb-e5cfa187cb68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:34.610251 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050a7f5b-8607-4ece-aadb-e5cfa187cb68 admin admin] REQUEST_METHOD: `PUT` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:34.610555 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050a7f5b-8607-4ece-aadb-e5cfa187cb68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:34.610995 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050a7f5b-8607-4ece-aadb-e5cfa187cb68 admin admin] PATH_INFO: `/v3/projects/1bbc09deed8e445789402235b1908465/users/6179124ada314bff8964576a12873d4b/roles/634ba284303b4626b5a0402772c68f5c` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:34.641881 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050a7f5b-8607-4ece-aadb-e5cfa187cb68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bbc09deed8e445789402235b1908465, user_id=6179124ada314bff8964576a12873d4b, role_id=634ba284303b4626b5a0402772c68f5c)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:34.646299 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050a7f5b-8607-4ece-aadb-e5cfa187cb68 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:34.667823 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 912/1839] 10.222.0.70 () {60 vars in 1482 bytes} [Tue May 10 19:21:34 2022] PUT /identity/v3/projects/1bbc09deed8e445789402235b1908465/users/6179124ada314bff8964576a12873d4b/roles/634ba284303b4626b5a0402772c68f5c => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 19:21:34.671967 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5300a0f2-b727-4d9b-a9ff-04a9d780b309 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:34.701310 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5300a0f2-b727-4d9b-a9ff-04a9d780b309 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:34.759492 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050a7f5b-8607-4ece-aadb-e5cfa187cb68 admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:34.761926 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-050a7f5b-8607-4ece-aadb-e5cfa187cb68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:21:34.807526 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37d9622-635d-46fb-99f8-d64ad63a93e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:34.808268 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37d9622-635d-46fb-99f8-d64ad63a93e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:34.808678 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37d9622-635d-46fb-99f8-d64ad63a93e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:34.808877 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37d9622-635d-46fb-99f8-d64ad63a93e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:34.809628 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37d9622-635d-46fb-99f8-d64ad63a93e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:34.811207 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37d9622-635d-46fb-99f8-d64ad63a93e4 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:34.822695 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 928/1840] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:21:34 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:21:34.827973 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37d9622-635d-46fb-99f8-d64ad63a93e4 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:34.838475 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37d9622-635d-46fb-99f8-d64ad63a93e4 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:34.847538 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30dedaf-dae1-464a-bb63-bb226b3b77d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:34.848842 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30dedaf-dae1-464a-bb63-bb226b3b77d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:34.849123 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30dedaf-dae1-464a-bb63-bb226b3b77d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:34.849398 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30dedaf-dae1-464a-bb63-bb226b3b77d8 admin admin] PATH_INFO: `/v3/projects/1bbc09deed8e445789402235b1908465/users/6179124ada314bff8964576a12873d4b/roles/634ba284303b4626b5a0402772c68f5c` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:34.851437 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30dedaf-dae1-464a-bb63-bb226b3b77d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bbc09deed8e445789402235b1908465, user_id=6179124ada314bff8964576a12873d4b, role_id=634ba284303b4626b5a0402772c68f5c)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:34.856687 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30dedaf-dae1-464a-bb63-bb226b3b77d8 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:34.870814 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050a7f5b-8607-4ece-aadb-e5cfa187cb68 admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:34.871925 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 929/1841] 10.222.0.70 () {60 vars in 1482 bytes} [Tue May 10 19:21:34 2022] PUT /identity/v3/projects/1bbc09deed8e445789402235b1908465/users/6179124ada314bff8964576a12873d4b/roles/634ba284303b4626b5a0402772c68f5c => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 19:21:34.882365 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6a237c-998e-4c3a-bdec-dc53727132a6 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:34.882696 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6a237c-998e-4c3a-bdec-dc53727132a6 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:34.882994 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6a237c-998e-4c3a-bdec-dc53727132a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:34.913364 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-0a6a237c-998e-4c3a-bdec-dc53727132a6 None None] MFA Rules not processed for user `6179124ada314bff8964576a12873d4b`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:21:34.914567 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-0a6a237c-998e-4c3a-bdec-dc53727132a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:21:34.927116 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e338c2-11bd-4fd3-a395-4094611a45ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:34.927995 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e338c2-11bd-4fd3-a395-4094611a45ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:34.928277 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e338c2-11bd-4fd3-a395-4094611a45ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:34.928590 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e338c2-11bd-4fd3-a395-4094611a45ed admin admin] PATH_INFO: `/v3/users/737f2b3fe7c643e2b0bce4af1d3c4834` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:34.929774 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e338c2-11bd-4fd3-a395-4094611a45ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=737f2b3fe7c643e2b0bce4af1d3c4834)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:34.931690 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e338c2-11bd-4fd3-a395-4094611a45ed admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:34.984736 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-a2e338c2-11bd-4fd3-a395-4094611a45ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '737f2b3fe7c643e2b0bce4af1d3c4834'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:34.988921 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 930/1842] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:21:34 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:21:34.996458 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-a2e338c2-11bd-4fd3-a395-4094611a45ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '737f2b3fe7c643e2b0bce4af1d3c4834'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:35.000601 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6a237c-998e-4c3a-bdec-dc53727132a6 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:35.001961 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-0a6a237c-998e-4c3a-bdec-dc53727132a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:21:35.003337 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-a2e338c2-11bd-4fd3-a395-4094611a45ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '737f2b3fe7c643e2b0bce4af1d3c4834'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:35.004176 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-a2e338c2-11bd-4fd3-a395-4094611a45ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '737f2b3fe7c643e2b0bce4af1d3c4834'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:35.013808 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-a2e338c2-11bd-4fd3-a395-4094611a45ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '737f2b3fe7c643e2b0bce4af1d3c4834'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:35.020733 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 913/1843] 10.222.0.70 () {58 vars in 1223 bytes} [Tue May 10 19:21:34 2022] DELETE /identity/v3/users/737f2b3fe7c643e2b0bce4af1d3c4834 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 19:21:35.025618 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f2da08-c1e2-4a47-bf66-9b37bd9b6725 None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:35.026648 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f2da08-c1e2-4a47-bf66-9b37bd9b6725 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:35.027087 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f2da08-c1e2-4a47-bf66-9b37bd9b6725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:35.044630 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-d7f2da08-c1e2-4a47-bf66-9b37bd9b6725 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:21:35.045829 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-d7f2da08-c1e2-4a47-bf66-9b37bd9b6725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:21:35.066665 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6a237c-998e-4c3a-bdec-dc53727132a6 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:35.109497 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 914/1844] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:21:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:21:35.120711 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f2da08-c1e2-4a47-bf66-9b37bd9b6725 None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:35.122529 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-d7f2da08-c1e2-4a47-bf66-9b37bd9b6725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:21:35.124647 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6f3cb1-b744-40ec-83ff-71504322eff2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15df2a8967aa43299c10e365f4200d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:35.125361 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6f3cb1-b744-40ec-83ff-71504322eff2 service cinder] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:35.125640 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6f3cb1-b744-40ec-83ff-71504322eff2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:35.125911 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6f3cb1-b744-40ec-83ff-71504322eff2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:35.127652 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-af6f3cb1-b744-40ec-83ff-71504322eff2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:21:35.224089 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f2da08-c1e2-4a47-bf66-9b37bd9b6725 None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:35.229266 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6f3cb1-b744-40ec-83ff-71504322eff2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:35.230150 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba987e9-85c6-4f9b-86bd-3cc91e933b8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f1dc79540b48c0866478cc48cd8205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:35.230957 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba987e9-85c6-4f9b-86bd-3cc91e933b8b service neutron] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:35.231217 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6f3cb1-b744-40ec-83ff-71504322eff2 service cinder] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:35.231424 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba987e9-85c6-4f9b-86bd-3cc91e933b8b service neutron] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:35.231710 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba987e9-85c6-4f9b-86bd-3cc91e933b8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:35.241694 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 931/1845] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:21:34 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:21:35.253414 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba987e9-85c6-4f9b-86bd-3cc91e933b8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:35.255222 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba987e9-85c6-4f9b-86bd-3cc91e933b8b service neutron] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:35.270552 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 915/1846] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:21:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 19:21:35.718362 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6f3cb1-b744-40ec-83ff-71504322eff2 service cinder] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:35.722216 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-af6f3cb1-b744-40ec-83ff-71504322eff2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:21:35.738692 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6f3cb1-b744-40ec-83ff-71504322eff2 service cinder] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:35.744397 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28df2733-1305-478d-a824-370def8d4795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:35.745847 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28df2733-1305-478d-a824-370def8d4795 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:35.746312 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28df2733-1305-478d-a824-370def8d4795 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:35.746585 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28df2733-1305-478d-a824-370def8d4795 admin admin] PATH_INFO: `/v3/projects/b80a7dfcfc33424994e37ce9b0d0bcc4` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:35.747833 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28df2733-1305-478d-a824-370def8d4795 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b80a7dfcfc33424994e37ce9b0d0bcc4)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:35.749923 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28df2733-1305-478d-a824-370def8d4795 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:35.815493 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-28df2733-1305-478d-a824-370def8d4795 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b80a7dfcfc33424994e37ce9b0d0bcc4', 'request_id': 'req-28df2733-1305-478d-a824-370def8d4795'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:35.827657 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-28df2733-1305-478d-a824-370def8d4795 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b80a7dfcfc33424994e37ce9b0d0bcc4', 'request_id': 'req-28df2733-1305-478d-a824-370def8d4795'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:35.840183 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-28df2733-1305-478d-a824-370def8d4795 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b80a7dfcfc33424994e37ce9b0d0bcc4', 'request_id': 'req-28df2733-1305-478d-a824-370def8d4795'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:35.857179 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-28df2733-1305-478d-a824-370def8d4795 admin admin] The token cache is being invalidate because project b80a7dfcfc33424994e37ce9b0d0bcc4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79994) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:21:35.857584 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-28df2733-1305-478d-a824-370def8d4795 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:35.858631 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-28df2733-1305-478d-a824-370def8d4795 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:35.861910 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 932/1847] 10.222.0.70 () {58 vars in 1232 bytes} [Tue May 10 19:21:35 2022] DELETE /identity/v3/projects/b80a7dfcfc33424994e37ce9b0d0bcc4 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:21:35.866033 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba987e9-85c6-4f9b-86bd-3cc91e933b8b service neutron] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:35.876765 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba987e9-85c6-4f9b-86bd-3cc91e933b8b service neutron] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:35.931403 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28df2733-1305-478d-a824-370def8d4795 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:35.933443 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-28df2733-1305-478d-a824-370def8d4795 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:21:35.952952 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925f2f39-511e-43ff-b691-815db900dd82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:35.953898 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925f2f39-511e-43ff-b691-815db900dd82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:35.954184 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925f2f39-511e-43ff-b691-815db900dd82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:35.954454 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925f2f39-511e-43ff-b691-815db900dd82 admin admin] PATH_INFO: `/v3/users/d076f880a506434d88b2d2fc7e082924` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:35.956588 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925f2f39-511e-43ff-b691-815db900dd82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d076f880a506434d88b2d2fc7e082924)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:35.958825 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925f2f39-511e-43ff-b691-815db900dd82 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:36.019190 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-925f2f39-511e-43ff-b691-815db900dd82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd076f880a506434d88b2d2fc7e082924'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:36.020075 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28df2733-1305-478d-a824-370def8d4795 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:36.024935 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8db3e58-b3f5-4808-8a28-b351b6e4676e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:36.025819 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8db3e58-b3f5-4808-8a28-b351b6e4676e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:36.026131 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8db3e58-b3f5-4808-8a28-b351b6e4676e admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:36.026404 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8db3e58-b3f5-4808-8a28-b351b6e4676e admin admin] PATH_INFO: `/v3/users/b267cff820044171adf9b50ae603e835` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:36.027692 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8db3e58-b3f5-4808-8a28-b351b6e4676e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b267cff820044171adf9b50ae603e835)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:36.029641 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8db3e58-b3f5-4808-8a28-b351b6e4676e admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:36.037957 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-925f2f39-511e-43ff-b691-815db900dd82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd076f880a506434d88b2d2fc7e082924'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:36.047632 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-925f2f39-511e-43ff-b691-815db900dd82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd076f880a506434d88b2d2fc7e082924'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:36.048814 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-925f2f39-511e-43ff-b691-815db900dd82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd076f880a506434d88b2d2fc7e082924'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:36.058899 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-925f2f39-511e-43ff-b691-815db900dd82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd076f880a506434d88b2d2fc7e082924'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:36.066922 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 916/1848] 10.222.0.70 () {58 vars in 1223 bytes} [Tue May 10 19:21:35 2022] DELETE /identity/v3/users/d076f880a506434d88b2d2fc7e082924 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:21:36.098889 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-a8db3e58-b3f5-4808-8a28-b351b6e4676e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b267cff820044171adf9b50ae603e835'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:36.113245 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-a8db3e58-b3f5-4808-8a28-b351b6e4676e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b267cff820044171adf9b50ae603e835'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:36.114332 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-a8db3e58-b3f5-4808-8a28-b351b6e4676e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b267cff820044171adf9b50ae603e835'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:36.125199 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-a8db3e58-b3f5-4808-8a28-b351b6e4676e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b267cff820044171adf9b50ae603e835'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:36.133139 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-a8db3e58-b3f5-4808-8a28-b351b6e4676e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b267cff820044171adf9b50ae603e835'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:36.140877 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 933/1849] 10.222.0.70 () {58 vars in 1223 bytes} [Tue May 10 19:21:35 2022] DELETE /identity/v3/users/b267cff820044171adf9b50ae603e835 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 19:21:36.145666 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1700f6-0b5a-427a-aaa6-fc038b9c96cf None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:36.145998 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1700f6-0b5a-427a-aaa6-fc038b9c96cf None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:36.146342 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1700f6-0b5a-427a-aaa6-fc038b9c96cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:36.167251 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-7e1700f6-0b5a-427a-aaa6-fc038b9c96cf None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:21:36.168570 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-7e1700f6-0b5a-427a-aaa6-fc038b9c96cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:21:36.234913 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 917/1850] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:21:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:21:36.244644 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8db3e58-b3f5-4808-8a28-b351b6e4676e admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:36.246065 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-a8db3e58-b3f5-4808-8a28-b351b6e4676e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:21:36.304141 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8db3e58-b3f5-4808-8a28-b351b6e4676e admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:36.307803 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb56ff0c-2231-4baa-b137-e9b199bf4f92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f1dc79540b48c0866478cc48cd8205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:36.308478 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb56ff0c-2231-4baa-b137-e9b199bf4f92 service neutron] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:36.308764 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb56ff0c-2231-4baa-b137-e9b199bf4f92 service neutron] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:36.309037 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb56ff0c-2231-4baa-b137-e9b199bf4f92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:36.318227 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb56ff0c-2231-4baa-b137-e9b199bf4f92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:36.319821 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb56ff0c-2231-4baa-b137-e9b199bf4f92 service neutron] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:36.330954 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 934/1851] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:21:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:21:36.357224 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1700f6-0b5a-427a-aaa6-fc038b9c96cf None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:36.358840 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-7e1700f6-0b5a-427a-aaa6-fc038b9c96cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:21:36.372185 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1700f6-0b5a-427a-aaa6-fc038b9c96cf None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:36.377743 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7ca905-d831-48d1-b7ae-5eb871bc6404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:36.378698 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7ca905-d831-48d1-b7ae-5eb871bc6404 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:36.379044 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7ca905-d831-48d1-b7ae-5eb871bc6404 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:36.379452 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7ca905-d831-48d1-b7ae-5eb871bc6404 admin admin] PATH_INFO: `/v3/projects/8c1508a0109242dcbe22ab6070dafe1b` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:36.381983 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7ca905-d831-48d1-b7ae-5eb871bc6404 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c1508a0109242dcbe22ab6070dafe1b)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:36.382697 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7ca905-d831-48d1-b7ae-5eb871bc6404 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:36.443738 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-6e7ca905-d831-48d1-b7ae-5eb871bc6404 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c1508a0109242dcbe22ab6070dafe1b', 'request_id': 'req-6e7ca905-d831-48d1-b7ae-5eb871bc6404'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:36.449598 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-6e7ca905-d831-48d1-b7ae-5eb871bc6404 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c1508a0109242dcbe22ab6070dafe1b', 'request_id': 'req-6e7ca905-d831-48d1-b7ae-5eb871bc6404'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:36.458109 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-6e7ca905-d831-48d1-b7ae-5eb871bc6404 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c1508a0109242dcbe22ab6070dafe1b', 'request_id': 'req-6e7ca905-d831-48d1-b7ae-5eb871bc6404'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:36.476120 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-6e7ca905-d831-48d1-b7ae-5eb871bc6404 admin admin] The token cache is being invalidate because project 8c1508a0109242dcbe22ab6070dafe1b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79993) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:21:36.476474 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-6e7ca905-d831-48d1-b7ae-5eb871bc6404 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:36.477785 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-6e7ca905-d831-48d1-b7ae-5eb871bc6404 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:36.483482 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 918/1852] 10.222.0.70 () {58 vars in 1232 bytes} [Tue May 10 19:21:36 2022] DELETE /identity/v3/projects/8c1508a0109242dcbe22ab6070dafe1b => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:21:36.485964 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a370a4-533e-4326-b075-5ae3d8f5f24f None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:36.485964 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a370a4-533e-4326-b075-5ae3d8f5f24f None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:36.485964 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a370a4-533e-4326-b075-5ae3d8f5f24f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:36.506438 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-e8a370a4-533e-4326-b075-5ae3d8f5f24f None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:21:36.507816 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-e8a370a4-533e-4326-b075-5ae3d8f5f24f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:21:36.592956 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 935/1853] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:21:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:21:36.601944 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2378f7-c03d-4da0-a354-3f4ee2e451d8 None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:36.602290 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2378f7-c03d-4da0-a354-3f4ee2e451d8 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:36.602584 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2378f7-c03d-4da0-a354-3f4ee2e451d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:36.623437 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-ca2378f7-c03d-4da0-a354-3f4ee2e451d8 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:21:36.624757 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-ca2378f7-c03d-4da0-a354-3f4ee2e451d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:21:36.634851 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 919/1854] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:21:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:21:36.637193 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a370a4-533e-4326-b075-5ae3d8f5f24f None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:36.650785 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a370a4-533e-4326-b075-5ae3d8f5f24f None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:36.657317 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ded9b8-62e8-4062-9251-9d43ad2c9c11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:36.658007 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ded9b8-62e8-4062-9251-9d43ad2c9c11 admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:36.658292 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ded9b8-62e8-4062-9251-9d43ad2c9c11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:36.658565 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ded9b8-62e8-4062-9251-9d43ad2c9c11 admin admin] PATH_INFO: `/v3/domains` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:36.659296 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ded9b8-62e8-4062-9251-9d43ad2c9c11 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:21:36.659601 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ded9b8-62e8-4062-9251-9d43ad2c9c11 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:36.661241 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ded9b8-62e8-4062-9251-9d43ad2c9c11 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:36.680985 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 936/1855] 10.222.0.70 () {58 vars in 1152 bytes} [Tue May 10 19:21:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:21:36.689762 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2378f7-c03d-4da0-a354-3f4ee2e451d8 None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:36.699699 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2378f7-c03d-4da0-a354-3f4ee2e451d8 None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:36.705403 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a6a7f9-8c6f-4e83-95e8-8c1e575972f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:36.706356 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a6a7f9-8c6f-4e83-95e8-8c1e575972f1 admin admin] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:36.706645 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a6a7f9-8c6f-4e83-95e8-8c1e575972f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:36.706921 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a6a7f9-8c6f-4e83-95e8-8c1e575972f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:36.707750 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a6a7f9-8c6f-4e83-95e8-8c1e575972f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:36.709736 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a6a7f9-8c6f-4e83-95e8-8c1e575972f1 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:36.739940 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 920/1856] 10.222.0.70 () {60 vars in 1152 bytes} [Tue May 10 19:21:36 2022] POST /identity/v3/projects => generated 379 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:21:36.741289 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ded9b8-62e8-4062-9251-9d43ad2c9c11 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:36.755999 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ded9b8-62e8-4062-9251-9d43ad2c9c11 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:36.829552 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdb1bd3-d023-405e-b87a-aa2c1f8d88f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:36.830395 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdb1bd3-d023-405e-b87a-aa2c1f8d88f7 admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:36.830677 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdb1bd3-d023-405e-b87a-aa2c1f8d88f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:36.830949 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdb1bd3-d023-405e-b87a-aa2c1f8d88f7 admin admin] PATH_INFO: `/v3/users` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:36.831642 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdb1bd3-d023-405e-b87a-aa2c1f8d88f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:36.833676 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdb1bd3-d023-405e-b87a-aa2c1f8d88f7 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:36.857061 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a6a7f9-8c6f-4e83-95e8-8c1e575972f1 admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:36.859112 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-53a6a7f9-8c6f-4e83-95e8-8c1e575972f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:21:36.869721 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 937/1857] 10.222.0.70 () {60 vars in 1143 bytes} [Tue May 10 19:21:36 2022] POST /identity/v3/users => generated 290 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:21:36.872649 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdb1bd3-d023-405e-b87a-aa2c1f8d88f7 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:36.883832 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a6a7f9-8c6f-4e83-95e8-8c1e575972f1 admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:36.886436 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdb1bd3-d023-405e-b87a-aa2c1f8d88f7 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:36.912576 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac2ce31-ee47-42d8-9703-98eb0fff2ff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:36.913831 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac2ce31-ee47-42d8-9703-98eb0fff2ff6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:36.914184 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac2ce31-ee47-42d8-9703-98eb0fff2ff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:36.914487 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac2ce31-ee47-42d8-9703-98eb0fff2ff6 admin admin] PATH_INFO: `/v3/projects/7e4e1824b43e482f85f7c8e073d31779` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:36.915842 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac2ce31-ee47-42d8-9703-98eb0fff2ff6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e4e1824b43e482f85f7c8e073d31779)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:36.916264 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b7b278-5e3b-417f-8dc2-ca3130bf6cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:36.918044 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b7b278-5e3b-417f-8dc2-ca3130bf6cfe admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:36.918291 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b7b278-5e3b-417f-8dc2-ca3130bf6cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:36.918603 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac2ce31-ee47-42d8-9703-98eb0fff2ff6 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:36.918707 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b7b278-5e3b-417f-8dc2-ca3130bf6cfe admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:36.919463 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b7b278-5e3b-417f-8dc2-ca3130bf6cfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:36.921475 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b7b278-5e3b-417f-8dc2-ca3130bf6cfe admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:36.944902 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 938/1858] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:21:36 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:21:36.954130 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b7b278-5e3b-417f-8dc2-ca3130bf6cfe admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:36.965012 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b7b278-5e3b-417f-8dc2-ca3130bf6cfe admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:36.969917 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9318fcf5-917b-47da-864b-f97a0099ed67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:36.970594 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9318fcf5-917b-47da-864b-f97a0099ed67 admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:36.971007 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9318fcf5-917b-47da-864b-f97a0099ed67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:36.971291 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9318fcf5-917b-47da-864b-f97a0099ed67 admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:36.972065 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9318fcf5-917b-47da-864b-f97a0099ed67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:36.974278 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9318fcf5-917b-47da-864b-f97a0099ed67 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:36.988979 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-eac2ce31-ee47-42d8-9703-98eb0fff2ff6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e4e1824b43e482f85f7c8e073d31779', 'request_id': 'req-eac2ce31-ee47-42d8-9703-98eb0fff2ff6'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:36.992553 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 939/1859] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:21:36 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:21:36.994013 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9318fcf5-917b-47da-864b-f97a0099ed67 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:36.997438 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-eac2ce31-ee47-42d8-9703-98eb0fff2ff6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e4e1824b43e482f85f7c8e073d31779', 'request_id': 'req-eac2ce31-ee47-42d8-9703-98eb0fff2ff6'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:37.006302 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9318fcf5-917b-47da-864b-f97a0099ed67 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:37.034212 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-eac2ce31-ee47-42d8-9703-98eb0fff2ff6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e4e1824b43e482f85f7c8e073d31779', 'request_id': 'req-eac2ce31-ee47-42d8-9703-98eb0fff2ff6'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:37.061888 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-eac2ce31-ee47-42d8-9703-98eb0fff2ff6 admin admin] The token cache is being invalidate because project 7e4e1824b43e482f85f7c8e073d31779 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79993) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:21:37.062542 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-eac2ce31-ee47-42d8-9703-98eb0fff2ff6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:37.064223 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-eac2ce31-ee47-42d8-9703-98eb0fff2ff6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:37.067664 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 921/1860] 10.222.0.70 () {58 vars in 1232 bytes} [Tue May 10 19:21:36 2022] DELETE /identity/v3/projects/7e4e1824b43e482f85f7c8e073d31779 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:21:37.072353 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac2ce31-ee47-42d8-9703-98eb0fff2ff6 admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:37.074858 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-eac2ce31-ee47-42d8-9703-98eb0fff2ff6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:21:37.147994 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdd3484-eed9-4496-9982-3e2460b14977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:37.149665 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdd3484-eed9-4496-9982-3e2460b14977 admin admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:37.149943 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdd3484-eed9-4496-9982-3e2460b14977 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:37.150220 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdd3484-eed9-4496-9982-3e2460b14977 admin admin] PATH_INFO: `/v3/projects/7283ae6dd9b243f79cd908143be79bb0/users/6358b563881a4b2dbe286e89b674e2e6/roles/5c07cf5bfbd3427db18428aa50420962` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:37.160954 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac2ce31-ee47-42d8-9703-98eb0fff2ff6 admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:37.167790 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1ec8ff-a1d3-44f3-aa64-2e95689b2860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:37.168741 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1ec8ff-a1d3-44f3-aa64-2e95689b2860 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:37.169026 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1ec8ff-a1d3-44f3-aa64-2e95689b2860 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:37.169229 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdd3484-eed9-4496-9982-3e2460b14977 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7283ae6dd9b243f79cd908143be79bb0, user_id=6358b563881a4b2dbe286e89b674e2e6, role_id=5c07cf5bfbd3427db18428aa50420962)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:37.169343 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1ec8ff-a1d3-44f3-aa64-2e95689b2860 admin admin] PATH_INFO: `/v3/users/6179124ada314bff8964576a12873d4b` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:37.170520 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1ec8ff-a1d3-44f3-aa64-2e95689b2860 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6179124ada314bff8964576a12873d4b)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:37.172560 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdd3484-eed9-4496-9982-3e2460b14977 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:37.172683 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1ec8ff-a1d3-44f3-aa64-2e95689b2860 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:37.211776 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 940/1861] 10.222.0.70 () {60 vars in 1482 bytes} [Tue May 10 19:21:36 2022] PUT /identity/v3/projects/7283ae6dd9b243f79cd908143be79bb0/users/6358b563881a4b2dbe286e89b674e2e6/roles/5c07cf5bfbd3427db18428aa50420962 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:21:37.222468 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e23b32-fe11-4b03-a6fc-39afea9f40bf None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:37.222975 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e23b32-fe11-4b03-a6fc-39afea9f40bf None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:37.223516 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e23b32-fe11-4b03-a6fc-39afea9f40bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:37.259289 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-0a1ec8ff-a1d3-44f3-aa64-2e95689b2860 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6179124ada314bff8964576a12873d4b'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:37.279332 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-39e23b32-fe11-4b03-a6fc-39afea9f40bf None None] MFA Rules not processed for user `6358b563881a4b2dbe286e89b674e2e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:21:37.280133 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-0a1ec8ff-a1d3-44f3-aa64-2e95689b2860 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6179124ada314bff8964576a12873d4b'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:37.280781 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-39e23b32-fe11-4b03-a6fc-39afea9f40bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:21:37.294871 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-0a1ec8ff-a1d3-44f3-aa64-2e95689b2860 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6179124ada314bff8964576a12873d4b'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:37.295855 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-0a1ec8ff-a1d3-44f3-aa64-2e95689b2860 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6179124ada314bff8964576a12873d4b'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:37.310298 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-0a1ec8ff-a1d3-44f3-aa64-2e95689b2860 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6179124ada314bff8964576a12873d4b'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:37.322948 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 922/1862] 10.222.0.70 () {58 vars in 1223 bytes} [Tue May 10 19:21:37 2022] DELETE /identity/v3/users/6179124ada314bff8964576a12873d4b => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 19:21:37.385515 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 941/1863] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:21:37 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:21:37.391247 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1ec8ff-a1d3-44f3-aa64-2e95689b2860 admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:37.392808 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-0a1ec8ff-a1d3-44f3-aa64-2e95689b2860 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:21:37.474751 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1ec8ff-a1d3-44f3-aa64-2e95689b2860 admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:37.480757 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126b2e2a-c095-4338-bb13-44ab9462557a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:37.481679 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126b2e2a-c095-4338-bb13-44ab9462557a admin admin] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:37.481967 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126b2e2a-c095-4338-bb13-44ab9462557a admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:37.482246 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126b2e2a-c095-4338-bb13-44ab9462557a admin admin] PATH_INFO: `/v3/projects` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:37.482941 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126b2e2a-c095-4338-bb13-44ab9462557a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:37.484895 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126b2e2a-c095-4338-bb13-44ab9462557a admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:37.524459 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 923/1864] 10.222.0.70 () {60 vars in 1152 bytes} [Tue May 10 19:21:37 2022] POST /identity/v3/projects => generated 377 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:21:37.527808 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e23b32-fe11-4b03-a6fc-39afea9f40bf None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:37.591824 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e23b32-fe11-4b03-a6fc-39afea9f40bf None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:37.637287 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126b2e2a-c095-4338-bb13-44ab9462557a admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:37.639072 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-126b2e2a-c095-4338-bb13-44ab9462557a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:21:37.672658 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35bd257-2a30-4dbb-bd30-e49c06d4858c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:37.673415 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35bd257-2a30-4dbb-bd30-e49c06d4858c admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:37.673698 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35bd257-2a30-4dbb-bd30-e49c06d4858c admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:37.674023 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35bd257-2a30-4dbb-bd30-e49c06d4858c admin admin] PATH_INFO: `/v3/users` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:37.674719 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35bd257-2a30-4dbb-bd30-e49c06d4858c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:37.676722 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35bd257-2a30-4dbb-bd30-e49c06d4858c admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:37.698811 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 942/1865] 10.222.0.70 () {60 vars in 1143 bytes} [Tue May 10 19:21:37 2022] POST /identity/v3/users => generated 289 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 19:21:37.705378 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35bd257-2a30-4dbb-bd30-e49c06d4858c admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:37.709885 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126b2e2a-c095-4338-bb13-44ab9462557a admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:37.715866 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35bd257-2a30-4dbb-bd30-e49c06d4858c admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:37.717279 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a61ed8-4ca9-485d-b2a2-f56d394a1859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:37.718239 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a61ed8-4ca9-485d-b2a2-f56d394a1859 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:37.718554 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a61ed8-4ca9-485d-b2a2-f56d394a1859 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:37.718846 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a61ed8-4ca9-485d-b2a2-f56d394a1859 admin admin] PATH_INFO: `/v3/projects/1bbc09deed8e445789402235b1908465` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:37.720116 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a61ed8-4ca9-485d-b2a2-f56d394a1859 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1bbc09deed8e445789402235b1908465)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:37.720643 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdf53f1-4d53-4e66-8eb0-3687ffcd2d2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:37.721307 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdf53f1-4d53-4e66-8eb0-3687ffcd2d2b admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:37.721590 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdf53f1-4d53-4e66-8eb0-3687ffcd2d2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:37.721864 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdf53f1-4d53-4e66-8eb0-3687ffcd2d2b admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:37.722205 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a61ed8-4ca9-485d-b2a2-f56d394a1859 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:37.722621 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdf53f1-4d53-4e66-8eb0-3687ffcd2d2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:37.724529 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdf53f1-4d53-4e66-8eb0-3687ffcd2d2b admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:37.735917 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 943/1866] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:21:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:21:37.740727 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdf53f1-4d53-4e66-8eb0-3687ffcd2d2b admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:37.753456 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdf53f1-4d53-4e66-8eb0-3687ffcd2d2b admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:37.758915 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed40c71e-5b86-4ecf-a225-b94b357d4de6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:37.759598 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed40c71e-5b86-4ecf-a225-b94b357d4de6 admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:37.759879 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed40c71e-5b86-4ecf-a225-b94b357d4de6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:37.760155 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed40c71e-5b86-4ecf-a225-b94b357d4de6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:37.761049 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed40c71e-5b86-4ecf-a225-b94b357d4de6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:37.762635 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed40c71e-5b86-4ecf-a225-b94b357d4de6 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:37.775280 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 944/1867] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:21:37 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 19:21:37.779600 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed40c71e-5b86-4ecf-a225-b94b357d4de6 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:37.781583 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-45a61ed8-4ca9-485d-b2a2-f56d394a1859 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1bbc09deed8e445789402235b1908465', 'request_id': 'req-45a61ed8-4ca9-485d-b2a2-f56d394a1859'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:37.789744 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed40c71e-5b86-4ecf-a225-b94b357d4de6 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:37.789904 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-45a61ed8-4ca9-485d-b2a2-f56d394a1859 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1bbc09deed8e445789402235b1908465', 'request_id': 'req-45a61ed8-4ca9-485d-b2a2-f56d394a1859'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:37.804059 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-45a61ed8-4ca9-485d-b2a2-f56d394a1859 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1bbc09deed8e445789402235b1908465', 'request_id': 'req-45a61ed8-4ca9-485d-b2a2-f56d394a1859'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:37.817388 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-45a61ed8-4ca9-485d-b2a2-f56d394a1859 admin admin] The token cache is being invalidate because project 1bbc09deed8e445789402235b1908465 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79993) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:21:37.818288 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-45a61ed8-4ca9-485d-b2a2-f56d394a1859 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:37.818699 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-45a61ed8-4ca9-485d-b2a2-f56d394a1859 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:37.820336 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 924/1868] 10.222.0.70 () {58 vars in 1232 bytes} [Tue May 10 19:21:37 2022] DELETE /identity/v3/projects/1bbc09deed8e445789402235b1908465 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:21:37.825596 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860f3a1b-4ecb-43eb-b962-8b84cf32930a None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:37.825893 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860f3a1b-4ecb-43eb-b962-8b84cf32930a None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:37.826174 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860f3a1b-4ecb-43eb-b962-8b84cf32930a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:37.849413 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-860f3a1b-4ecb-43eb-b962-8b84cf32930a None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:21:37.850772 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-860f3a1b-4ecb-43eb-b962-8b84cf32930a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:21:37.857154 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33dc661-1549-4702-bf82-b5a5f39f576f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:37.858192 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33dc661-1549-4702-bf82-b5a5f39f576f admin admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:37.858580 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33dc661-1549-4702-bf82-b5a5f39f576f admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:37.858842 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33dc661-1549-4702-bf82-b5a5f39f576f admin admin] PATH_INFO: `/v3/projects/70b97f9cf7484be6839ec564f51570b3/users/a62cfed7b19a4cb89189ecb0061fb1af/roles/5c07cf5bfbd3427db18428aa50420962` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:37.881203 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33dc661-1549-4702-bf82-b5a5f39f576f admin admin] RBAC: Authorizing `identity:create_grant(project_id=70b97f9cf7484be6839ec564f51570b3, user_id=a62cfed7b19a4cb89189ecb0061fb1af, role_id=5c07cf5bfbd3427db18428aa50420962)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:37.884164 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33dc661-1549-4702-bf82-b5a5f39f576f admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:37.903448 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 945/1869] 10.222.0.70 () {60 vars in 1482 bytes} [Tue May 10 19:21:37 2022] PUT /identity/v3/projects/70b97f9cf7484be6839ec564f51570b3/users/a62cfed7b19a4cb89189ecb0061fb1af/roles/5c07cf5bfbd3427db18428aa50420962 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 19:21:37.913526 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c991d79c-9f79-4b3e-b48c-744f03a311e5 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:37.913801 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c991d79c-9f79-4b3e-b48c-744f03a311e5 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:37.914081 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c991d79c-9f79-4b3e-b48c-744f03a311e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:37.928837 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 925/1870] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:21:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:21:37.935325 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e596de-8972-4fbc-ace1-b9424be4dff5 None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:37.935703 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e596de-8972-4fbc-ace1-b9424be4dff5 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:37.936038 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e596de-8972-4fbc-ace1-b9424be4dff5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:37.962039 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-c991d79c-9f79-4b3e-b48c-744f03a311e5 None None] MFA Rules not processed for user `a62cfed7b19a4cb89189ecb0061fb1af`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:21:37.963294 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-b7e596de-8972-4fbc-ace1-b9424be4dff5 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:21:37.964211 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-c991d79c-9f79-4b3e-b48c-744f03a311e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:21:37.965252 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-b7e596de-8972-4fbc-ace1-b9424be4dff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:21:38.023631 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 926/1871] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:21:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:21:38.027865 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e596de-8972-4fbc-ace1-b9424be4dff5 None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:38.030720 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 946/1872] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:21:37 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:21:38.034870 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c991d79c-9f79-4b3e-b48c-744f03a311e5 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:38.036476 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-c991d79c-9f79-4b3e-b48c-744f03a311e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:21:38.039811 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e596de-8972-4fbc-ace1-b9424be4dff5 None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:38.044565 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ce7740-844c-483f-be73-a0bc54405048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:38.045309 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ce7740-844c-483f-be73-a0bc54405048 admin admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:38.045600 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ce7740-844c-483f-be73-a0bc54405048 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:38.045877 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ce7740-844c-483f-be73-a0bc54405048 admin admin] PATH_INFO: `/v3/domains` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:38.046600 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ce7740-844c-483f-be73-a0bc54405048 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:21:38.046897 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ce7740-844c-483f-be73-a0bc54405048 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:38.048506 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ce7740-844c-483f-be73-a0bc54405048 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:38.050005 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c991d79c-9f79-4b3e-b48c-744f03a311e5 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:38.054915 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a1bef2-c799-403f-8b6d-7b96e662aab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:38.055543 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a1bef2-c799-403f-8b6d-7b96e662aab7 admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:38.055833 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a1bef2-c799-403f-8b6d-7b96e662aab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:38.056106 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a1bef2-c799-403f-8b6d-7b96e662aab7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:38.056827 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a1bef2-c799-403f-8b6d-7b96e662aab7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:38.059263 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a1bef2-c799-403f-8b6d-7b96e662aab7 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:38.061569 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 927/1873] 10.222.0.70 () {58 vars in 1152 bytes} [Tue May 10 19:21:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:21:38.066095 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ce7740-844c-483f-be73-a0bc54405048 admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:38.086011 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ce7740-844c-483f-be73-a0bc54405048 admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:38.086618 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 947/1874] 10.222.0.70 () {60 vars in 1152 bytes} [Tue May 10 19:21:38 2022] POST /identity/v3/projects => generated 377 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 19:21:38.090513 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a1bef2-c799-403f-8b6d-7b96e662aab7 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:38.145074 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e754af-b2de-4e7d-892c-3a9277f7b241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:38.145752 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e754af-b2de-4e7d-892c-3a9277f7b241 admin admin] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:38.146073 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e754af-b2de-4e7d-892c-3a9277f7b241 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:38.147024 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e754af-b2de-4e7d-892c-3a9277f7b241 admin admin] PATH_INFO: `/v3/projects` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:38.147213 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e754af-b2de-4e7d-892c-3a9277f7b241 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:38.149183 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e754af-b2de-4e7d-892c-3a9277f7b241 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:38.162591 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a1bef2-c799-403f-8b6d-7b96e662aab7 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:38.168294 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da1f349-f674-4aa9-9d54-b006d6286b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:38.169139 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da1f349-f674-4aa9-9d54-b006d6286b08 admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:38.170000 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da1f349-f674-4aa9-9d54-b006d6286b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:38.170477 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da1f349-f674-4aa9-9d54-b006d6286b08 admin admin] PATH_INFO: `/v3/users` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:38.171053 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da1f349-f674-4aa9-9d54-b006d6286b08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:38.173282 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da1f349-f674-4aa9-9d54-b006d6286b08 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:38.177758 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 928/1875] 10.222.0.70 () {60 vars in 1152 bytes} [Tue May 10 19:21:38 2022] POST /identity/v3/projects => generated 385 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:21:38.182697 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e754af-b2de-4e7d-892c-3a9277f7b241 admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:38.202147 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 948/1876] 10.222.0.70 () {60 vars in 1143 bytes} [Tue May 10 19:21:38 2022] POST /identity/v3/users => generated 295 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 19:21:38.203099 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da1f349-f674-4aa9-9d54-b006d6286b08 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:38.212533 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da1f349-f674-4aa9-9d54-b006d6286b08 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:38.264102 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e754af-b2de-4e7d-892c-3a9277f7b241 admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:38.269066 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47182c2-33ea-45bb-ac88-6e2921c481cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:38.269753 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47182c2-33ea-45bb-ac88-6e2921c481cd admin admin] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:38.270037 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47182c2-33ea-45bb-ac88-6e2921c481cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:38.270458 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47182c2-33ea-45bb-ac88-6e2921c481cd admin admin] PATH_INFO: `/v3/users` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:38.271159 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47182c2-33ea-45bb-ac88-6e2921c481cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:38.273152 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47182c2-33ea-45bb-ac88-6e2921c481cd admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:38.302830 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 929/1877] 10.222.0.70 () {60 vars in 1143 bytes} [Tue May 10 19:21:38 2022] POST /identity/v3/users => generated 293 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 19:21:38.303885 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47182c2-33ea-45bb-ac88-6e2921c481cd admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:38.316372 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47182c2-33ea-45bb-ac88-6e2921c481cd admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:38.327571 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd917dea-06f5-4557-92be-ed20ef8b4310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:38.327571 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd917dea-06f5-4557-92be-ed20ef8b4310 admin admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:38.327571 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd917dea-06f5-4557-92be-ed20ef8b4310 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:38.327571 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd917dea-06f5-4557-92be-ed20ef8b4310 admin admin] PATH_INFO: `/v3/roles` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:38.328086 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd917dea-06f5-4557-92be-ed20ef8b4310 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:38.328086 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd917dea-06f5-4557-92be-ed20ef8b4310 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:38.335610 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5748c1dd-f3a1-473c-b3fc-d8982724d797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:38.336342 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5748c1dd-f3a1-473c-b3fc-d8982724d797 admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:38.336712 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5748c1dd-f3a1-473c-b3fc-d8982724d797 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:38.336994 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5748c1dd-f3a1-473c-b3fc-d8982724d797 admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:38.337750 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5748c1dd-f3a1-473c-b3fc-d8982724d797 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:38.340057 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 930/1878] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:21:38 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 19:21:38.340170 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5748c1dd-f3a1-473c-b3fc-d8982724d797 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:38.351242 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd917dea-06f5-4557-92be-ed20ef8b4310 admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:38.356312 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 949/1879] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:21:38 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 19:21:38.357695 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5748c1dd-f3a1-473c-b3fc-d8982724d797 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:38.371876 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5748c1dd-f3a1-473c-b3fc-d8982724d797 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:38.383408 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd917dea-06f5-4557-92be-ed20ef8b4310 admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:38.387165 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7808c630-a051-4787-8b23-94b2f12a631e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:38.388365 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7808c630-a051-4787-8b23-94b2f12a631e admin admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:38.389145 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7808c630-a051-4787-8b23-94b2f12a631e admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:38.389145 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7808c630-a051-4787-8b23-94b2f12a631e admin admin] PATH_INFO: `/v3/projects/e9ed645476614ed98d75e5c61acd6b56/users/07e703d079224addb55708223ebe93fc/roles/634ba284303b4626b5a0402772c68f5c` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:38.402710 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fd7813-4c03-40ac-b383-d2467d947a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:38.404912 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fd7813-4c03-40ac-b383-d2467d947a79 admin admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:38.406439 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fd7813-4c03-40ac-b383-d2467d947a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:38.406561 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fd7813-4c03-40ac-b383-d2467d947a79 admin admin] PATH_INFO: `/v3/roles` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:38.407225 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fd7813-4c03-40ac-b383-d2467d947a79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:38.408980 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fd7813-4c03-40ac-b383-d2467d947a79 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:38.417845 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7808c630-a051-4787-8b23-94b2f12a631e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9ed645476614ed98d75e5c61acd6b56, user_id=07e703d079224addb55708223ebe93fc, role_id=634ba284303b4626b5a0402772c68f5c)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:38.420671 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7808c630-a051-4787-8b23-94b2f12a631e admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:38.439334 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 950/1880] 10.222.0.70 () {60 vars in 1482 bytes} [Tue May 10 19:21:38 2022] PUT /identity/v3/projects/e9ed645476614ed98d75e5c61acd6b56/users/07e703d079224addb55708223ebe93fc/roles/634ba284303b4626b5a0402772c68f5c => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 19:21:38.444048 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7808c630-a051-4787-8b23-94b2f12a631e admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:38.452136 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 931/1881] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:21:38 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 19:21:38.453454 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fd7813-4c03-40ac-b383-d2467d947a79 admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:38.471307 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fd7813-4c03-40ac-b383-d2467d947a79 admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:38.571580 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7808c630-a051-4787-8b23-94b2f12a631e admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:38.577823 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a1c641-ce70-4d6a-aed1-b9860a40b258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:38.578546 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a1c641-ce70-4d6a-aed1-b9860a40b258 admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:38.579168 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a1c641-ce70-4d6a-aed1-b9860a40b258 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:38.579168 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a1c641-ce70-4d6a-aed1-b9860a40b258 admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:38.579792 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a1c641-ce70-4d6a-aed1-b9860a40b258 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:38.581440 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a1c641-ce70-4d6a-aed1-b9860a40b258 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:38.585434 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5830ae60-cd48-4547-a6ba-e811fe450a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:38.586601 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5830ae60-cd48-4547-a6ba-e811fe450a36 admin admin] REQUEST_METHOD: `PUT` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:38.587481 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5830ae60-cd48-4547-a6ba-e811fe450a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:38.587802 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5830ae60-cd48-4547-a6ba-e811fe450a36 admin admin] PATH_INFO: `/v3/projects/8b974a84718b4b86afe8bb0936b4d326/users/c7685c7d774345b8a484952a994716dc/roles/5c07cf5bfbd3427db18428aa50420962` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:38.594984 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 951/1882] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:21:38 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:21:38.599110 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a1c641-ce70-4d6a-aed1-b9860a40b258 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:38.607275 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5830ae60-cd48-4547-a6ba-e811fe450a36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b974a84718b4b86afe8bb0936b4d326, user_id=c7685c7d774345b8a484952a994716dc, role_id=5c07cf5bfbd3427db18428aa50420962)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:38.610002 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5830ae60-cd48-4547-a6ba-e811fe450a36 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:38.610666 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a1c641-ce70-4d6a-aed1-b9860a40b258 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:38.616317 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38ed625-2199-4aac-a0e4-a8351d3ea6bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:38.617434 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38ed625-2199-4aac-a0e4-a8351d3ea6bd admin admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:38.617725 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38ed625-2199-4aac-a0e4-a8351d3ea6bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:38.618046 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38ed625-2199-4aac-a0e4-a8351d3ea6bd admin admin] PATH_INFO: `/v3/projects/e9ed645476614ed98d75e5c61acd6b56/users/07e703d079224addb55708223ebe93fc/roles/634ba284303b4626b5a0402772c68f5c` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:38.620298 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38ed625-2199-4aac-a0e4-a8351d3ea6bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9ed645476614ed98d75e5c61acd6b56, user_id=07e703d079224addb55708223ebe93fc, role_id=634ba284303b4626b5a0402772c68f5c)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:38.623006 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38ed625-2199-4aac-a0e4-a8351d3ea6bd admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:38.626372 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 932/1883] 10.222.0.70 () {60 vars in 1482 bytes} [Tue May 10 19:21:38 2022] PUT /identity/v3/projects/8b974a84718b4b86afe8bb0936b4d326/users/c7685c7d774345b8a484952a994716dc/roles/5c07cf5bfbd3427db18428aa50420962 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 19:21:38.638274 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ec3684-cbfd-44e8-a359-681139667d69 None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:38.638558 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ec3684-cbfd-44e8-a359-681139667d69 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:38.638856 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ec3684-cbfd-44e8-a359-681139667d69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:38.645108 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 952/1884] 10.222.0.70 () {60 vars in 1482 bytes} [Tue May 10 19:21:38 2022] PUT /identity/v3/projects/e9ed645476614ed98d75e5c61acd6b56/users/07e703d079224addb55708223ebe93fc/roles/634ba284303b4626b5a0402772c68f5c => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 19:21:38.657485 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dc5b15-344c-42fc-be8f-0ad0626e19b2 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:38.657777 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dc5b15-344c-42fc-be8f-0ad0626e19b2 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:38.658065 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dc5b15-344c-42fc-be8f-0ad0626e19b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:38.669320 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-e5ec3684-cbfd-44e8-a359-681139667d69 None None] MFA Rules not processed for user `c7685c7d774345b8a484952a994716dc`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:21:38.670633 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-e5ec3684-cbfd-44e8-a359-681139667d69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:21:38.689368 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-99dc5b15-344c-42fc-be8f-0ad0626e19b2 None None] MFA Rules not processed for user `07e703d079224addb55708223ebe93fc`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:21:38.692529 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-99dc5b15-344c-42fc-be8f-0ad0626e19b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:21:38.748801 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 933/1885] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:21:38 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:21:38.761189 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ec3684-cbfd-44e8-a359-681139667d69 None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:38.762855 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-e5ec3684-cbfd-44e8-a359-681139667d69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:21:38.781044 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 953/1886] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:21:38 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:21:38.792249 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dc5b15-344c-42fc-be8f-0ad0626e19b2 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:38.793985 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-99dc5b15-344c-42fc-be8f-0ad0626e19b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:21:38.842669 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ec3684-cbfd-44e8-a359-681139667d69 None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:38.847888 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b392694b-b74a-454d-b344-ef913e94f77e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15df2a8967aa43299c10e365f4200d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:38.848728 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b392694b-b74a-454d-b344-ef913e94f77e service cinder] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:38.849089 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b392694b-b74a-454d-b344-ef913e94f77e service cinder] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:38.849514 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b392694b-b74a-454d-b344-ef913e94f77e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:38.859403 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b392694b-b74a-454d-b344-ef913e94f77e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:38.861146 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b392694b-b74a-454d-b344-ef913e94f77e service cinder] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:38.866882 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dc5b15-344c-42fc-be8f-0ad0626e19b2 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:38.871187 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53907ead-80cb-4a35-ac38-9e78ea8c011f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15df2a8967aa43299c10e365f4200d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:38.871800 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53907ead-80cb-4a35-ac38-9e78ea8c011f service cinder] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:38.872086 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53907ead-80cb-4a35-ac38-9e78ea8c011f service cinder] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:38.872519 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53907ead-80cb-4a35-ac38-9e78ea8c011f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:38.880809 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 934/1887] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:21:38 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 19:21:38.882976 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53907ead-80cb-4a35-ac38-9e78ea8c011f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:38.884582 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53907ead-80cb-4a35-ac38-9e78ea8c011f service cinder] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:38.900535 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b392694b-b74a-454d-b344-ef913e94f77e service cinder] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:38.909388 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 954/1888] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:21:38 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 19:21:38.969752 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53907ead-80cb-4a35-ac38-9e78ea8c011f service cinder] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:38.980271 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b392694b-b74a-454d-b344-ef913e94f77e service cinder] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:38.985998 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7eeafb-2255-4853-a357-f8c2e7d5b8d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:38.986223 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7eeafb-2255-4853-a357-f8c2e7d5b8d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:38.986492 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7eeafb-2255-4853-a357-f8c2e7d5b8d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:38.986767 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7eeafb-2255-4853-a357-f8c2e7d5b8d5 admin admin] PATH_INFO: `/v3/users/c7685c7d774345b8a484952a994716dc` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:38.987997 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7eeafb-2255-4853-a357-f8c2e7d5b8d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7685c7d774345b8a484952a994716dc)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:38.990024 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7eeafb-2255-4853-a357-f8c2e7d5b8d5 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:38.991142 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53907ead-80cb-4a35-ac38-9e78ea8c011f service cinder] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:39.003489 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5b54f4-7a63-4139-8a07-7a9fa448083e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15df2a8967aa43299c10e365f4200d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:39.004765 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5b54f4-7a63-4139-8a07-7a9fa448083e service cinder] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:39.007019 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5b54f4-7a63-4139-8a07-7a9fa448083e service cinder] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:39.007376 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5b54f4-7a63-4139-8a07-7a9fa448083e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:39.011906 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-2a5b54f4-7a63-4139-8a07-7a9fa448083e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:21:39.062310 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-dc7eeafb-2255-4853-a357-f8c2e7d5b8d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7685c7d774345b8a484952a994716dc'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:39.075312 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-dc7eeafb-2255-4853-a357-f8c2e7d5b8d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7685c7d774345b8a484952a994716dc'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:39.088306 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-dc7eeafb-2255-4853-a357-f8c2e7d5b8d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7685c7d774345b8a484952a994716dc'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:39.089330 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-dc7eeafb-2255-4853-a357-f8c2e7d5b8d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7685c7d774345b8a484952a994716dc'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:39.104786 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-dc7eeafb-2255-4853-a357-f8c2e7d5b8d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7685c7d774345b8a484952a994716dc'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:39.114346 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 935/1889] 10.222.0.70 () {58 vars in 1223 bytes} [Tue May 10 19:21:38 2022] DELETE /identity/v3/users/c7685c7d774345b8a484952a994716dc => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 19:21:39.121205 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dfceba-1827-4483-bc86-591b8778cacc None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:39.121828 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dfceba-1827-4483-bc86-591b8778cacc None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:39.123186 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dfceba-1827-4483-bc86-591b8778cacc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:39.124648 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5b54f4-7a63-4139-8a07-7a9fa448083e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:39.126163 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5b54f4-7a63-4139-8a07-7a9fa448083e service cinder] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:39.142396 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 955/1890] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:21:38 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:21:39.146682 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-c6dfceba-1827-4483-bc86-591b8778cacc None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:21:39.148160 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-c6dfceba-1827-4483-bc86-591b8778cacc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:21:39.250208 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 936/1891] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:21:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:21:39.271072 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5b54f4-7a63-4139-8a07-7a9fa448083e service cinder] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:39.273665 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-2a5b54f4-7a63-4139-8a07-7a9fa448083e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:21:39.361910 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5b54f4-7a63-4139-8a07-7a9fa448083e service cinder] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:39.411721 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5839e3c-64c7-405b-8471-1b7f6955c425 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f1dc79540b48c0866478cc48cd8205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:39.412587 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5839e3c-64c7-405b-8471-1b7f6955c425 service neutron] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:39.413027 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5839e3c-64c7-405b-8471-1b7f6955c425 service neutron] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:39.413301 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5839e3c-64c7-405b-8471-1b7f6955c425 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:39.423653 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5839e3c-64c7-405b-8471-1b7f6955c425 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:39.425112 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5839e3c-64c7-405b-8471-1b7f6955c425 service neutron] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:39.435482 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 956/1892] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:21:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:21:39.731262 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dfceba-1827-4483-bc86-591b8778cacc None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:39.732817 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-c6dfceba-1827-4483-bc86-591b8778cacc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:21:39.750253 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dfceba-1827-4483-bc86-591b8778cacc None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:39.755094 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575b4580-a671-495e-91f7-b59c97f6aa9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:39.755999 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575b4580-a671-495e-91f7-b59c97f6aa9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:39.756331 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575b4580-a671-495e-91f7-b59c97f6aa9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:39.756642 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575b4580-a671-495e-91f7-b59c97f6aa9a admin admin] PATH_INFO: `/v3/projects/8b974a84718b4b86afe8bb0936b4d326` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:39.757839 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575b4580-a671-495e-91f7-b59c97f6aa9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b974a84718b4b86afe8bb0936b4d326)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:39.759925 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575b4580-a671-495e-91f7-b59c97f6aa9a admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:39.806300 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-575b4580-a671-495e-91f7-b59c97f6aa9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b974a84718b4b86afe8bb0936b4d326', 'request_id': 'req-575b4580-a671-495e-91f7-b59c97f6aa9a'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:39.814349 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-575b4580-a671-495e-91f7-b59c97f6aa9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b974a84718b4b86afe8bb0936b4d326', 'request_id': 'req-575b4580-a671-495e-91f7-b59c97f6aa9a'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:39.822129 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-575b4580-a671-495e-91f7-b59c97f6aa9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b974a84718b4b86afe8bb0936b4d326', 'request_id': 'req-575b4580-a671-495e-91f7-b59c97f6aa9a'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:39.836983 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-575b4580-a671-495e-91f7-b59c97f6aa9a admin admin] The token cache is being invalidate because project 8b974a84718b4b86afe8bb0936b4d326 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79993) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:21:39.837271 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-575b4580-a671-495e-91f7-b59c97f6aa9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:39.837904 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-575b4580-a671-495e-91f7-b59c97f6aa9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:39.839442 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 937/1893] 10.222.0.70 () {58 vars in 1232 bytes} [Tue May 10 19:21:39 2022] DELETE /identity/v3/projects/8b974a84718b4b86afe8bb0936b4d326 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:21:39.844673 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc62e0c5-ddb6-4a7d-9e49-ae46e54030b4 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:39.845158 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc62e0c5-ddb6-4a7d-9e49-ae46e54030b4 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:39.845253 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc62e0c5-ddb6-4a7d-9e49-ae46e54030b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:39.862466 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-cc62e0c5-ddb6-4a7d-9e49-ae46e54030b4 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:21:39.863638 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-cc62e0c5-ddb6-4a7d-9e49-ae46e54030b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:21:39.920118 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 957/1894] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:21:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:21:39.927777 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b7a7e9-43fe-47ff-943d-02de523bce34 None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:39.928164 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b7a7e9-43fe-47ff-943d-02de523bce34 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:39.928546 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b7a7e9-43fe-47ff-943d-02de523bce34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:39.947037 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-99b7a7e9-43fe-47ff-943d-02de523bce34 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:21:39.948336 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-99b7a7e9-43fe-47ff-943d-02de523bce34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:21:39.958312 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 938/1895] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:21:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:21:39.962721 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc62e0c5-ddb6-4a7d-9e49-ae46e54030b4 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:39.974349 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc62e0c5-ddb6-4a7d-9e49-ae46e54030b4 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:39.981706 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47248435-ff1a-4561-8bc7-679d25bf04fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:39.983032 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47248435-ff1a-4561-8bc7-679d25bf04fb admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:39.983268 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47248435-ff1a-4561-8bc7-679d25bf04fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:39.983546 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47248435-ff1a-4561-8bc7-679d25bf04fb admin admin] PATH_INFO: `/v3/domains` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:39.984286 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47248435-ff1a-4561-8bc7-679d25bf04fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:21:39.984623 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47248435-ff1a-4561-8bc7-679d25bf04fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:39.987668 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47248435-ff1a-4561-8bc7-679d25bf04fb admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:40.001490 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 958/1896] 10.222.0.70 () {58 vars in 1152 bytes} [Tue May 10 19:21:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:21:40.005539 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b7a7e9-43fe-47ff-943d-02de523bce34 None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:40.015816 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b7a7e9-43fe-47ff-943d-02de523bce34 None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:40.021244 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1347bf1-a140-4269-8e78-022e786aace2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:40.022058 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1347bf1-a140-4269-8e78-022e786aace2 admin admin] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:40.022344 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1347bf1-a140-4269-8e78-022e786aace2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:40.022620 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1347bf1-a140-4269-8e78-022e786aace2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:40.023319 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1347bf1-a140-4269-8e78-022e786aace2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:40.025365 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1347bf1-a140-4269-8e78-022e786aace2 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:40.059380 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 939/1897] 10.222.0.70 () {60 vars in 1152 bytes} [Tue May 10 19:21:40 2022] POST /identity/v3/projects => generated 383 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:21:40.063262 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47248435-ff1a-4561-8bc7-679d25bf04fb admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:40.077717 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47248435-ff1a-4561-8bc7-679d25bf04fb admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:40.190553 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6ef747-5fb7-4e95-b487-760e34ed8517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:40.191264 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6ef747-5fb7-4e95-b487-760e34ed8517 admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:40.191553 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6ef747-5fb7-4e95-b487-760e34ed8517 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:40.194006 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6ef747-5fb7-4e95-b487-760e34ed8517 admin admin] PATH_INFO: `/v3/users` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:40.195223 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6ef747-5fb7-4e95-b487-760e34ed8517 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:40.202872 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6ef747-5fb7-4e95-b487-760e34ed8517 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:40.243858 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 959/1898] 10.222.0.70 () {60 vars in 1143 bytes} [Tue May 10 19:21:40 2022] POST /identity/v3/users => generated 292 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:21:40.248295 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1347bf1-a140-4269-8e78-022e786aace2 admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:40.261784 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1347bf1-a140-4269-8e78-022e786aace2 admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:40.277533 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a787b56-ef28-4c1c-8409-1cedf73e8dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:40.278237 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a787b56-ef28-4c1c-8409-1cedf73e8dcc admin admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:40.278525 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a787b56-ef28-4c1c-8409-1cedf73e8dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:40.278806 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a787b56-ef28-4c1c-8409-1cedf73e8dcc admin admin] PATH_INFO: `/v3/roles` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:40.281267 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a787b56-ef28-4c1c-8409-1cedf73e8dcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:40.288697 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a787b56-ef28-4c1c-8409-1cedf73e8dcc admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:40.313526 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 940/1899] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:21:40 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:21:40.318048 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6ef747-5fb7-4e95-b487-760e34ed8517 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:40.344005 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6ef747-5fb7-4e95-b487-760e34ed8517 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:40.353940 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6541f55-f79f-43ac-a3f6-368dd429ae45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:40.354821 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6541f55-f79f-43ac-a3f6-368dd429ae45 admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:40.355269 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6541f55-f79f-43ac-a3f6-368dd429ae45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:40.355678 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6541f55-f79f-43ac-a3f6-368dd429ae45 admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:40.356467 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6541f55-f79f-43ac-a3f6-368dd429ae45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:40.358194 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6541f55-f79f-43ac-a3f6-368dd429ae45 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:40.378708 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 960/1900] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:21:40 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:21:40.380022 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a787b56-ef28-4c1c-8409-1cedf73e8dcc admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:40.392240 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a787b56-ef28-4c1c-8409-1cedf73e8dcc admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:40.397311 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a056ddcc-6515-430b-b42c-d9c31ee66e96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:40.398282 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a056ddcc-6515-430b-b42c-d9c31ee66e96 admin admin] REQUEST_METHOD: `PUT` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:40.398641 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a056ddcc-6515-430b-b42c-d9c31ee66e96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:40.399030 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a056ddcc-6515-430b-b42c-d9c31ee66e96 admin admin] PATH_INFO: `/v3/projects/a86324b248ca462997a6c1e307303b69/users/053ebadc81354855bd304e08b81a97c6/roles/5c07cf5bfbd3427db18428aa50420962` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:40.417196 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a056ddcc-6515-430b-b42c-d9c31ee66e96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a86324b248ca462997a6c1e307303b69, user_id=053ebadc81354855bd304e08b81a97c6, role_id=5c07cf5bfbd3427db18428aa50420962)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:40.420332 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a056ddcc-6515-430b-b42c-d9c31ee66e96 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:40.437812 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 941/1901] 10.222.0.70 () {60 vars in 1482 bytes} [Tue May 10 19:21:40 2022] PUT /identity/v3/projects/a86324b248ca462997a6c1e307303b69/users/053ebadc81354855bd304e08b81a97c6/roles/5c07cf5bfbd3427db18428aa50420962 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:21:40.448323 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e933dd-a6a8-4c16-a579-0aec82b261aa None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:40.448644 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e933dd-a6a8-4c16-a579-0aec82b261aa None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:40.448921 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e933dd-a6a8-4c16-a579-0aec82b261aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:40.480059 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-54e933dd-a6a8-4c16-a579-0aec82b261aa None None] MFA Rules not processed for user `053ebadc81354855bd304e08b81a97c6`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:21:40.481119 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-54e933dd-a6a8-4c16-a579-0aec82b261aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:21:40.549843 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 961/1902] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:21:40 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:21:40.560317 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a056ddcc-6515-430b-b42c-d9c31ee66e96 admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:40.562112 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-a056ddcc-6515-430b-b42c-d9c31ee66e96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:21:40.621978 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a056ddcc-6515-430b-b42c-d9c31ee66e96 admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:40.626676 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d080a341-2d2f-4c2c-aca4-3fdf9eeaae3b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15df2a8967aa43299c10e365f4200d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:40.627391 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d080a341-2d2f-4c2c-aca4-3fdf9eeaae3b service cinder] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:40.627681 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d080a341-2d2f-4c2c-aca4-3fdf9eeaae3b service cinder] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:40.627956 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d080a341-2d2f-4c2c-aca4-3fdf9eeaae3b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:40.639112 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d080a341-2d2f-4c2c-aca4-3fdf9eeaae3b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:40.640594 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d080a341-2d2f-4c2c-aca4-3fdf9eeaae3b service cinder] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:40.650618 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 942/1903] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:21:40 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:21:42.133042 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e933dd-a6a8-4c16-a579-0aec82b261aa None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:42.134474 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-54e933dd-a6a8-4c16-a579-0aec82b261aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:21:42.226886 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e933dd-a6a8-4c16-a579-0aec82b261aa None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:42.231505 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d71363-2dd9-477c-bc8e-8b3f33a0289a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:42.232388 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d71363-2dd9-477c-bc8e-8b3f33a0289a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:42.232739 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d71363-2dd9-477c-bc8e-8b3f33a0289a admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:42.233093 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d71363-2dd9-477c-bc8e-8b3f33a0289a admin admin] PATH_INFO: `/v3/users/6358b563881a4b2dbe286e89b674e2e6` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:42.234304 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d71363-2dd9-477c-bc8e-8b3f33a0289a admin admin] RBAC: Authorizing `identity:delete_user(user_id=6358b563881a4b2dbe286e89b674e2e6)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:42.236215 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d71363-2dd9-477c-bc8e-8b3f33a0289a admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:42.326522 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-b7d71363-2dd9-477c-bc8e-8b3f33a0289a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6358b563881a4b2dbe286e89b674e2e6'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:42.352354 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-b7d71363-2dd9-477c-bc8e-8b3f33a0289a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6358b563881a4b2dbe286e89b674e2e6'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:42.353427 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-b7d71363-2dd9-477c-bc8e-8b3f33a0289a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6358b563881a4b2dbe286e89b674e2e6'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:42.372976 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-b7d71363-2dd9-477c-bc8e-8b3f33a0289a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6358b563881a4b2dbe286e89b674e2e6'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:42.383983 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-b7d71363-2dd9-477c-bc8e-8b3f33a0289a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6358b563881a4b2dbe286e89b674e2e6'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:42.394045 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 962/1904] 10.222.0.70 () {58 vars in 1223 bytes} [Tue May 10 19:21:42 2022] DELETE /identity/v3/users/6358b563881a4b2dbe286e89b674e2e6 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:21:42.398717 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb22d9c-e2ad-49cb-bc8b-cbfcd4f0a14e None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:42.399641 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb22d9c-e2ad-49cb-bc8b-cbfcd4f0a14e None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:42.400096 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb22d9c-e2ad-49cb-bc8b-cbfcd4f0a14e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:42.433143 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-5cb22d9c-e2ad-49cb-bc8b-cbfcd4f0a14e None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:21:42.434780 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-5cb22d9c-e2ad-49cb-bc8b-cbfcd4f0a14e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:21:42.503322 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 943/1905] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:21:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:21:42.521332 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d71363-2dd9-477c-bc8e-8b3f33a0289a admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:42.523916 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-b7d71363-2dd9-477c-bc8e-8b3f33a0289a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:21:42.593458 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d71363-2dd9-477c-bc8e-8b3f33a0289a admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:42.597291 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e7c4ac-f7c9-4667-b937-1722a640c158 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f1dc79540b48c0866478cc48cd8205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:42.598087 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e7c4ac-f7c9-4667-b937-1722a640c158 service neutron] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:42.598498 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e7c4ac-f7c9-4667-b937-1722a640c158 service neutron] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:42.598779 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e7c4ac-f7c9-4667-b937-1722a640c158 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:42.608843 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e7c4ac-f7c9-4667-b937-1722a640c158 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:42.610482 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e7c4ac-f7c9-4667-b937-1722a640c158 service neutron] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:42.621262 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 963/1906] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:21:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:21:43.451307 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb22d9c-e2ad-49cb-bc8b-cbfcd4f0a14e None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:43.452789 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-5cb22d9c-e2ad-49cb-bc8b-cbfcd4f0a14e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:21:43.465427 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb22d9c-e2ad-49cb-bc8b-cbfcd4f0a14e None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:43.478982 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027fc40a-995b-407a-9e10-498648035efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:43.480677 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027fc40a-995b-407a-9e10-498648035efc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:43.481155 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027fc40a-995b-407a-9e10-498648035efc admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:43.481610 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027fc40a-995b-407a-9e10-498648035efc admin admin] PATH_INFO: `/v3/projects/7283ae6dd9b243f79cd908143be79bb0` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:43.483163 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027fc40a-995b-407a-9e10-498648035efc admin admin] RBAC: Authorizing `identity:delete_project(project_id=7283ae6dd9b243f79cd908143be79bb0)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:43.485835 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027fc40a-995b-407a-9e10-498648035efc admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:43.543756 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-027fc40a-995b-407a-9e10-498648035efc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7283ae6dd9b243f79cd908143be79bb0', 'request_id': 'req-027fc40a-995b-407a-9e10-498648035efc'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:43.549428 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-027fc40a-995b-407a-9e10-498648035efc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7283ae6dd9b243f79cd908143be79bb0', 'request_id': 'req-027fc40a-995b-407a-9e10-498648035efc'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:43.558661 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-027fc40a-995b-407a-9e10-498648035efc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7283ae6dd9b243f79cd908143be79bb0', 'request_id': 'req-027fc40a-995b-407a-9e10-498648035efc'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:43.570321 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-027fc40a-995b-407a-9e10-498648035efc admin admin] The token cache is being invalidate because project 7283ae6dd9b243f79cd908143be79bb0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79993) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:21:43.570549 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-027fc40a-995b-407a-9e10-498648035efc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:43.571278 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-027fc40a-995b-407a-9e10-498648035efc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:43.573750 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 944/1907] 10.222.0.70 () {58 vars in 1232 bytes} [Tue May 10 19:21:43 2022] DELETE /identity/v3/projects/7283ae6dd9b243f79cd908143be79bb0 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:21:43.577806 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e7c4ac-f7c9-4667-b937-1722a640c158 service neutron] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:43.587605 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e7c4ac-f7c9-4667-b937-1722a640c158 service neutron] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:43.653335 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a8b818-1e0e-425c-927d-01d64fc688bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:43.654445 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a8b818-1e0e-425c-927d-01d64fc688bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:43.654832 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a8b818-1e0e-425c-927d-01d64fc688bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:43.655212 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a8b818-1e0e-425c-927d-01d64fc688bc admin admin] PATH_INFO: `/v3/users/a62cfed7b19a4cb89189ecb0061fb1af` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:43.657628 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a8b818-1e0e-425c-927d-01d64fc688bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=a62cfed7b19a4cb89189ecb0061fb1af)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:43.660794 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a8b818-1e0e-425c-927d-01d64fc688bc admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:43.726520 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-91a8b818-1e0e-425c-927d-01d64fc688bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a62cfed7b19a4cb89189ecb0061fb1af'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:43.741634 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-91a8b818-1e0e-425c-927d-01d64fc688bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a62cfed7b19a4cb89189ecb0061fb1af'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:43.743585 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-91a8b818-1e0e-425c-927d-01d64fc688bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a62cfed7b19a4cb89189ecb0061fb1af'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:43.752292 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-91a8b818-1e0e-425c-927d-01d64fc688bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a62cfed7b19a4cb89189ecb0061fb1af'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:43.760951 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-91a8b818-1e0e-425c-927d-01d64fc688bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a62cfed7b19a4cb89189ecb0061fb1af'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:43.770521 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 964/1908] 10.222.0.70 () {58 vars in 1223 bytes} [Tue May 10 19:21:43 2022] DELETE /identity/v3/users/a62cfed7b19a4cb89189ecb0061fb1af => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:21:44.138153 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027fc40a-995b-407a-9e10-498648035efc admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:44.139638 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-027fc40a-995b-407a-9e10-498648035efc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:21:44.154424 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027fc40a-995b-407a-9e10-498648035efc admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:44.218915 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd66122-0f9d-4e77-95e8-ead918dd296e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:44.219863 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd66122-0f9d-4e77-95e8-ead918dd296e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:44.220148 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd66122-0f9d-4e77-95e8-ead918dd296e admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:44.220450 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd66122-0f9d-4e77-95e8-ead918dd296e admin admin] PATH_INFO: `/v3/projects/70b97f9cf7484be6839ec564f51570b3` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:44.221621 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd66122-0f9d-4e77-95e8-ead918dd296e admin admin] RBAC: Authorizing `identity:delete_project(project_id=70b97f9cf7484be6839ec564f51570b3)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:44.223533 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd66122-0f9d-4e77-95e8-ead918dd296e admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:44.282951 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-efd66122-0f9d-4e77-95e8-ead918dd296e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70b97f9cf7484be6839ec564f51570b3', 'request_id': 'req-efd66122-0f9d-4e77-95e8-ead918dd296e'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:44.305994 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-efd66122-0f9d-4e77-95e8-ead918dd296e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70b97f9cf7484be6839ec564f51570b3', 'request_id': 'req-efd66122-0f9d-4e77-95e8-ead918dd296e'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:44.321557 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-efd66122-0f9d-4e77-95e8-ead918dd296e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70b97f9cf7484be6839ec564f51570b3', 'request_id': 'req-efd66122-0f9d-4e77-95e8-ead918dd296e'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:44.340546 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-efd66122-0f9d-4e77-95e8-ead918dd296e admin admin] The token cache is being invalidate because project 70b97f9cf7484be6839ec564f51570b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79993) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:21:44.341034 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-efd66122-0f9d-4e77-95e8-ead918dd296e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:44.343052 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-efd66122-0f9d-4e77-95e8-ead918dd296e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:44.345911 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 945/1909] 10.222.0.70 () {58 vars in 1232 bytes} [Tue May 10 19:21:44 2022] DELETE /identity/v3/projects/70b97f9cf7484be6839ec564f51570b3 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:21:44.350081 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a8b818-1e0e-425c-927d-01d64fc688bc admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:44.351557 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-91a8b818-1e0e-425c-927d-01d64fc688bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:21:44.369653 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a8b818-1e0e-425c-927d-01d64fc688bc admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:44.493177 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d56a9c6-10c4-4e00-81c8-01d3224238dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:44.494073 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d56a9c6-10c4-4e00-81c8-01d3224238dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:44.494425 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d56a9c6-10c4-4e00-81c8-01d3224238dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:44.494707 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d56a9c6-10c4-4e00-81c8-01d3224238dc admin admin] PATH_INFO: `/v3/users/07e703d079224addb55708223ebe93fc` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:44.495970 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d56a9c6-10c4-4e00-81c8-01d3224238dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=07e703d079224addb55708223ebe93fc)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:44.498311 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d56a9c6-10c4-4e00-81c8-01d3224238dc admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:44.556931 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-4d56a9c6-10c4-4e00-81c8-01d3224238dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07e703d079224addb55708223ebe93fc'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:44.570101 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-4d56a9c6-10c4-4e00-81c8-01d3224238dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07e703d079224addb55708223ebe93fc'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:44.570877 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-4d56a9c6-10c4-4e00-81c8-01d3224238dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07e703d079224addb55708223ebe93fc'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:44.581112 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-4d56a9c6-10c4-4e00-81c8-01d3224238dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07e703d079224addb55708223ebe93fc'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:44.589552 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-4d56a9c6-10c4-4e00-81c8-01d3224238dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07e703d079224addb55708223ebe93fc'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:44.596941 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 965/1910] 10.222.0.70 () {58 vars in 1223 bytes} [Tue May 10 19:21:44 2022] DELETE /identity/v3/users/07e703d079224addb55708223ebe93fc => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:21:44.894916 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd66122-0f9d-4e77-95e8-ead918dd296e admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:44.896680 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-efd66122-0f9d-4e77-95e8-ead918dd296e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:21:44.918041 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd66122-0f9d-4e77-95e8-ead918dd296e admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:44.989387 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfded208-1851-4e9a-a6b5-f17e305479dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:44.990285 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfded208-1851-4e9a-a6b5-f17e305479dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:44.990574 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfded208-1851-4e9a-a6b5-f17e305479dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:44.990849 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfded208-1851-4e9a-a6b5-f17e305479dd admin admin] PATH_INFO: `/v3/projects/e9ed645476614ed98d75e5c61acd6b56` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:44.992037 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfded208-1851-4e9a-a6b5-f17e305479dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9ed645476614ed98d75e5c61acd6b56)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:44.993981 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfded208-1851-4e9a-a6b5-f17e305479dd admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:45.046956 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-bfded208-1851-4e9a-a6b5-f17e305479dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9ed645476614ed98d75e5c61acd6b56', 'request_id': 'req-bfded208-1851-4e9a-a6b5-f17e305479dd'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:45.052843 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-bfded208-1851-4e9a-a6b5-f17e305479dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9ed645476614ed98d75e5c61acd6b56', 'request_id': 'req-bfded208-1851-4e9a-a6b5-f17e305479dd'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:45.062718 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-bfded208-1851-4e9a-a6b5-f17e305479dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9ed645476614ed98d75e5c61acd6b56', 'request_id': 'req-bfded208-1851-4e9a-a6b5-f17e305479dd'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:45.078630 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-bfded208-1851-4e9a-a6b5-f17e305479dd admin admin] The token cache is being invalidate because project e9ed645476614ed98d75e5c61acd6b56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79993) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:21:45.079024 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-bfded208-1851-4e9a-a6b5-f17e305479dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:45.081048 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-bfded208-1851-4e9a-a6b5-f17e305479dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:45.082706 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 946/1911] 10.222.0.70 () {58 vars in 1232 bytes} [Tue May 10 19:21:44 2022] DELETE /identity/v3/projects/e9ed645476614ed98d75e5c61acd6b56 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:21:45.089130 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15936334-3b2c-4d04-8fc9-9bb954998d69 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:45.092357 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15936334-3b2c-4d04-8fc9-9bb954998d69 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:45.093326 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15936334-3b2c-4d04-8fc9-9bb954998d69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:45.117334 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-15936334-3b2c-4d04-8fc9-9bb954998d69 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:21:45.119269 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-15936334-3b2c-4d04-8fc9-9bb954998d69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:21:45.208484 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 966/1912] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:21:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:21:45.212602 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f00a574-f329-4e75-9b13-370c10717703 None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:45.212890 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f00a574-f329-4e75-9b13-370c10717703 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:45.213230 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f00a574-f329-4e75-9b13-370c10717703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:45.232887 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-6f00a574-f329-4e75-9b13-370c10717703 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:21:45.235481 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-6f00a574-f329-4e75-9b13-370c10717703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:21:45.252950 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 947/1913] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:21:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:21:45.253812 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15936334-3b2c-4d04-8fc9-9bb954998d69 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:45.264469 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15936334-3b2c-4d04-8fc9-9bb954998d69 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:45.277695 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dea2bab-8183-463e-8d97-d87c5ddea0c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:45.278493 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dea2bab-8183-463e-8d97-d87c5ddea0c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:45.278872 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dea2bab-8183-463e-8d97-d87c5ddea0c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:45.279154 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dea2bab-8183-463e-8d97-d87c5ddea0c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:45.279914 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dea2bab-8183-463e-8d97-d87c5ddea0c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:21:45.280193 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dea2bab-8183-463e-8d97-d87c5ddea0c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:45.282000 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dea2bab-8183-463e-8d97-d87c5ddea0c5 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:45.301261 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 967/1914] 10.222.0.70 () {58 vars in 1152 bytes} [Tue May 10 19:21:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:21:45.305727 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f00a574-f329-4e75-9b13-370c10717703 None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:45.316008 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f00a574-f329-4e75-9b13-370c10717703 None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:45.321003 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dd5175-fbfe-49fb-a199-ab285c5e8084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:45.321780 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dd5175-fbfe-49fb-a199-ab285c5e8084 admin admin] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:45.322156 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dd5175-fbfe-49fb-a199-ab285c5e8084 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:45.323001 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dd5175-fbfe-49fb-a199-ab285c5e8084 admin admin] PATH_INFO: `/v3/projects` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:45.325348 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dd5175-fbfe-49fb-a199-ab285c5e8084 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:45.327350 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dd5175-fbfe-49fb-a199-ab285c5e8084 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:45.357168 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 948/1915] 10.222.0.70 () {60 vars in 1152 bytes} [Tue May 10 19:21:45 2022] POST /identity/v3/projects => generated 365 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:21:45.361540 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dea2bab-8183-463e-8d97-d87c5ddea0c5 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:45.377359 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dea2bab-8183-463e-8d97-d87c5ddea0c5 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:45.440701 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14d03ee-2001-46dd-a78e-fc87f59a70e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:45.441384 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14d03ee-2001-46dd-a78e-fc87f59a70e9 admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:45.441668 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14d03ee-2001-46dd-a78e-fc87f59a70e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:45.441941 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14d03ee-2001-46dd-a78e-fc87f59a70e9 admin admin] PATH_INFO: `/v3/users` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:45.442662 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14d03ee-2001-46dd-a78e-fc87f59a70e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:45.444943 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14d03ee-2001-46dd-a78e-fc87f59a70e9 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:45.465444 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 968/1916] 10.222.0.70 () {60 vars in 1143 bytes} [Tue May 10 19:21:45 2022] POST /identity/v3/users => generated 283 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:21:45.469754 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dd5175-fbfe-49fb-a199-ab285c5e8084 admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:45.481546 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dd5175-fbfe-49fb-a199-ab285c5e8084 admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:45.487685 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f306849-2bbe-405a-a395-4fd9e75c0dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:45.489814 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f306849-2bbe-405a-a395-4fd9e75c0dd0 admin admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:45.490166 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f306849-2bbe-405a-a395-4fd9e75c0dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:45.490454 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f306849-2bbe-405a-a395-4fd9e75c0dd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:45.491385 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f306849-2bbe-405a-a395-4fd9e75c0dd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:45.493119 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f306849-2bbe-405a-a395-4fd9e75c0dd0 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:45.518579 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 949/1917] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:21:45 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:21:45.522237 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14d03ee-2001-46dd-a78e-fc87f59a70e9 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:45.533930 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14d03ee-2001-46dd-a78e-fc87f59a70e9 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:45.539467 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a671128-e3d7-4e5d-bbaa-88f9e903891f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:45.540165 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a671128-e3d7-4e5d-bbaa-88f9e903891f admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:45.540463 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a671128-e3d7-4e5d-bbaa-88f9e903891f admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:45.540744 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a671128-e3d7-4e5d-bbaa-88f9e903891f admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:45.541666 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a671128-e3d7-4e5d-bbaa-88f9e903891f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:45.543881 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a671128-e3d7-4e5d-bbaa-88f9e903891f admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:45.560480 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 969/1918] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:21:45 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 19:21:45.564690 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f306849-2bbe-405a-a395-4fd9e75c0dd0 admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:45.578282 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f306849-2bbe-405a-a395-4fd9e75c0dd0 admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:45.583525 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ca088a-d864-4493-843a-eaef44ad0ee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:45.584227 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ca088a-d864-4493-843a-eaef44ad0ee3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:45.584544 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ca088a-d864-4493-843a-eaef44ad0ee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:45.584815 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ca088a-d864-4493-843a-eaef44ad0ee3 admin admin] PATH_INFO: `/v3/projects/e1f877136e804c59b4bd9bac1fc89ab4/users/ca00999a9d9345588f0e50ce3398c2b0/roles/5c07cf5bfbd3427db18428aa50420962` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:45.605439 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ca088a-d864-4493-843a-eaef44ad0ee3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1f877136e804c59b4bd9bac1fc89ab4, user_id=ca00999a9d9345588f0e50ce3398c2b0, role_id=5c07cf5bfbd3427db18428aa50420962)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:45.608201 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ca088a-d864-4493-843a-eaef44ad0ee3 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:45.621686 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 950/1919] 10.222.0.70 () {60 vars in 1482 bytes} [Tue May 10 19:21:45 2022] PUT /identity/v3/projects/e1f877136e804c59b4bd9bac1fc89ab4/users/ca00999a9d9345588f0e50ce3398c2b0/roles/5c07cf5bfbd3427db18428aa50420962 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:21:45.634130 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3f8d2c-1cd6-49b9-ab54-a2e06841b2ed None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:45.634591 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3f8d2c-1cd6-49b9-ab54-a2e06841b2ed None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:45.634752 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3f8d2c-1cd6-49b9-ab54-a2e06841b2ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:45.664141 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-be3f8d2c-1cd6-49b9-ab54-a2e06841b2ed None None] MFA Rules not processed for user `ca00999a9d9345588f0e50ce3398c2b0`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:21:45.665377 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-be3f8d2c-1cd6-49b9-ab54-a2e06841b2ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:21:45.731158 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 970/1920] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:21:45 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:21:45.735464 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ca088a-d864-4493-843a-eaef44ad0ee3 admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:45.793817 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ca088a-d864-4493-843a-eaef44ad0ee3 admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:45.798395 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359de7fb-9ece-4c01-b21d-6a050e35685b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:45.799046 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359de7fb-9ece-4c01-b21d-6a050e35685b admin admin] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:45.799326 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359de7fb-9ece-4c01-b21d-6a050e35685b admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:45.799595 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359de7fb-9ece-4c01-b21d-6a050e35685b admin admin] PATH_INFO: `/v3/projects` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:45.800277 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359de7fb-9ece-4c01-b21d-6a050e35685b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:45.802186 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359de7fb-9ece-4c01-b21d-6a050e35685b admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:45.829719 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 951/1921] 10.222.0.70 () {60 vars in 1152 bytes} [Tue May 10 19:21:45 2022] POST /identity/v3/projects => generated 367 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:21:45.830944 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3f8d2c-1cd6-49b9-ab54-a2e06841b2ed None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:45.842426 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3f8d2c-1cd6-49b9-ab54-a2e06841b2ed None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:45.900577 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88258100-a8e6-4e0c-979e-deabe39e9dbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:45.901270 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88258100-a8e6-4e0c-979e-deabe39e9dbc admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:45.901547 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88258100-a8e6-4e0c-979e-deabe39e9dbc admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:45.901814 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88258100-a8e6-4e0c-979e-deabe39e9dbc admin admin] PATH_INFO: `/v3/users` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:45.902497 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88258100-a8e6-4e0c-979e-deabe39e9dbc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:45.904436 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88258100-a8e6-4e0c-979e-deabe39e9dbc admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:45.923406 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 971/1922] 10.222.0.70 () {60 vars in 1143 bytes} [Tue May 10 19:21:45 2022] POST /identity/v3/users => generated 290 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 19:21:45.927429 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359de7fb-9ece-4c01-b21d-6a050e35685b admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:45.938043 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359de7fb-9ece-4c01-b21d-6a050e35685b admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:45.942639 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0aa3c36-e790-48b4-8536-52cd9bedbea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:45.943307 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aa3c36-e790-48b4-8536-52cd9bedbea7 admin admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:45.943617 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aa3c36-e790-48b4-8536-52cd9bedbea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:45.943919 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aa3c36-e790-48b4-8536-52cd9bedbea7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:45.944631 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0aa3c36-e790-48b4-8536-52cd9bedbea7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:45.946379 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0aa3c36-e790-48b4-8536-52cd9bedbea7 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:45.957819 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 952/1923] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:21:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:21:45.961907 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88258100-a8e6-4e0c-979e-deabe39e9dbc admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:45.971673 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88258100-a8e6-4e0c-979e-deabe39e9dbc admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:45.976308 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82734d8a-e4b1-4f62-bfa0-6922fe6fedb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:45.977215 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82734d8a-e4b1-4f62-bfa0-6922fe6fedb2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:45.977495 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82734d8a-e4b1-4f62-bfa0-6922fe6fedb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:45.977762 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82734d8a-e4b1-4f62-bfa0-6922fe6fedb2 admin admin] PATH_INFO: `/v3/projects/1fdfb8e5cdb649618d84f66d5ef5a8be/users/083ea46b2c9243ad92bacbec9303eae5/roles/634ba284303b4626b5a0402772c68f5c` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:45.992490 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82734d8a-e4b1-4f62-bfa0-6922fe6fedb2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fdfb8e5cdb649618d84f66d5ef5a8be, user_id=083ea46b2c9243ad92bacbec9303eae5, role_id=634ba284303b4626b5a0402772c68f5c)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:45.995323 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82734d8a-e4b1-4f62-bfa0-6922fe6fedb2 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:46.007215 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 972/1924] 10.222.0.70 () {60 vars in 1482 bytes} [Tue May 10 19:21:45 2022] PUT /identity/v3/projects/1fdfb8e5cdb649618d84f66d5ef5a8be/users/083ea46b2c9243ad92bacbec9303eae5/roles/634ba284303b4626b5a0402772c68f5c => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:21:46.011789 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0aa3c36-e790-48b4-8536-52cd9bedbea7 admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:46.021457 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0aa3c36-e790-48b4-8536-52cd9bedbea7 admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:46.080506 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eb3c2a-4ecf-4b8c-922f-3efc60d1e602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:46.081183 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eb3c2a-4ecf-4b8c-922f-3efc60d1e602 admin admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:46.081490 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eb3c2a-4ecf-4b8c-922f-3efc60d1e602 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:46.081762 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eb3c2a-4ecf-4b8c-922f-3efc60d1e602 admin admin] PATH_INFO: `/v3/roles` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:46.082472 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52eb3c2a-4ecf-4b8c-922f-3efc60d1e602 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:46.084049 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52eb3c2a-4ecf-4b8c-922f-3efc60d1e602 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:46.093968 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 953/1925] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:21:46 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:21:46.098371 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82734d8a-e4b1-4f62-bfa0-6922fe6fedb2 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:46.108547 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82734d8a-e4b1-4f62-bfa0-6922fe6fedb2 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:46.113402 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9dfd8b-acc1-42c7-8edd-19ac0993d685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:46.114296 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9dfd8b-acc1-42c7-8edd-19ac0993d685 admin admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:46.114577 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9dfd8b-acc1-42c7-8edd-19ac0993d685 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:46.114851 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9dfd8b-acc1-42c7-8edd-19ac0993d685 admin admin] PATH_INFO: `/v3/projects/1fdfb8e5cdb649618d84f66d5ef5a8be/users/083ea46b2c9243ad92bacbec9303eae5/roles/634ba284303b4626b5a0402772c68f5c` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:46.116864 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9dfd8b-acc1-42c7-8edd-19ac0993d685 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fdfb8e5cdb649618d84f66d5ef5a8be, user_id=083ea46b2c9243ad92bacbec9303eae5, role_id=634ba284303b4626b5a0402772c68f5c)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:46.119517 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9dfd8b-acc1-42c7-8edd-19ac0993d685 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:46.129734 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 973/1926] 10.222.0.70 () {60 vars in 1482 bytes} [Tue May 10 19:21:46 2022] PUT /identity/v3/projects/1fdfb8e5cdb649618d84f66d5ef5a8be/users/083ea46b2c9243ad92bacbec9303eae5/roles/634ba284303b4626b5a0402772c68f5c => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:21:46.140230 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8375b57f-1da0-4c51-b8e6-017dc9f2ebd5 None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:46.140589 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8375b57f-1da0-4c51-b8e6-017dc9f2ebd5 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:46.140873 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8375b57f-1da0-4c51-b8e6-017dc9f2ebd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:46.166288 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-8375b57f-1da0-4c51-b8e6-017dc9f2ebd5 None None] MFA Rules not processed for user `083ea46b2c9243ad92bacbec9303eae5`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:21:46.167457 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-8375b57f-1da0-4c51-b8e6-017dc9f2ebd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:21:46.231290 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 954/1927] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:21:46 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:21:46.242854 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9dfd8b-acc1-42c7-8edd-19ac0993d685 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:46.245083 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-9a9dfd8b-acc1-42c7-8edd-19ac0993d685 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:21:46.305417 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9dfd8b-acc1-42c7-8edd-19ac0993d685 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:46.309472 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23408c51-c0e4-45e6-8185-face6f5ced70 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15df2a8967aa43299c10e365f4200d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:46.310156 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23408c51-c0e4-45e6-8185-face6f5ced70 service cinder] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:46.310444 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23408c51-c0e4-45e6-8185-face6f5ced70 service cinder] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:46.310715 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23408c51-c0e4-45e6-8185-face6f5ced70 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:46.319495 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23408c51-c0e4-45e6-8185-face6f5ced70 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:46.320910 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23408c51-c0e4-45e6-8185-face6f5ced70 service cinder] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:46.331628 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 974/1928] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:21:46 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:21:46.422839 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8375b57f-1da0-4c51-b8e6-017dc9f2ebd5 None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:46.435378 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8375b57f-1da0-4c51-b8e6-017dc9f2ebd5 None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:46.451167 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b5c67e-62de-4077-b143-678b7bc8bd85 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15df2a8967aa43299c10e365f4200d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:46.451902 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b5c67e-62de-4077-b143-678b7bc8bd85 service cinder] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:46.452275 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b5c67e-62de-4077-b143-678b7bc8bd85 service cinder] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:46.452676 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b5c67e-62de-4077-b143-678b7bc8bd85 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:46.535491 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b5c67e-62de-4077-b143-678b7bc8bd85 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:46.537013 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b5c67e-62de-4077-b143-678b7bc8bd85 service cinder] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:46.552111 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 955/1929] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:21:46 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:21:49.201406 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23408c51-c0e4-45e6-8185-face6f5ced70 service cinder] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:49.202881 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-23408c51-c0e4-45e6-8185-face6f5ced70 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:21:49.291241 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23408c51-c0e4-45e6-8185-face6f5ced70 service cinder] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:49.298977 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fefd5f8-6a34-4739-927b-931dd4daa64d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:49.300333 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fefd5f8-6a34-4739-927b-931dd4daa64d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:49.300850 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fefd5f8-6a34-4739-927b-931dd4daa64d admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:49.301335 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fefd5f8-6a34-4739-927b-931dd4daa64d admin admin] PATH_INFO: `/v3/users/b0af823276aa42339b1832983d57d3ba` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:49.302764 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fefd5f8-6a34-4739-927b-931dd4daa64d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0af823276aa42339b1832983d57d3ba)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:49.306296 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fefd5f8-6a34-4739-927b-931dd4daa64d admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:49.418503 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b5c67e-62de-4077-b143-678b7bc8bd85 service cinder] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:49.419981 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-e6b5c67e-62de-4077-b143-678b7bc8bd85 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:21:49.425019 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-9fefd5f8-6a34-4739-927b-931dd4daa64d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0af823276aa42339b1832983d57d3ba'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:49.451691 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b5c67e-62de-4077-b143-678b7bc8bd85 service cinder] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:49.457457 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8c999e-28dc-4ecf-9fb4-cd564a3f32e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:49.458787 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8c999e-28dc-4ecf-9fb4-cd564a3f32e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:49.459371 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8c999e-28dc-4ecf-9fb4-cd564a3f32e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:49.459734 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-9fefd5f8-6a34-4739-927b-931dd4daa64d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0af823276aa42339b1832983d57d3ba'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:49.459952 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8c999e-28dc-4ecf-9fb4-cd564a3f32e2 admin admin] PATH_INFO: `/v3/users/053ebadc81354855bd304e08b81a97c6` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:49.461186 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-9fefd5f8-6a34-4739-927b-931dd4daa64d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0af823276aa42339b1832983d57d3ba'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:49.462007 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8c999e-28dc-4ecf-9fb4-cd564a3f32e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=053ebadc81354855bd304e08b81a97c6)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:49.465809 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8c999e-28dc-4ecf-9fb4-cd564a3f32e2 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:49.486503 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-9fefd5f8-6a34-4739-927b-931dd4daa64d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0af823276aa42339b1832983d57d3ba'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:49.501812 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-9fefd5f8-6a34-4739-927b-931dd4daa64d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0af823276aa42339b1832983d57d3ba'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:49.514214 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 975/1930] 10.222.0.70 () {58 vars in 1223 bytes} [Tue May 10 19:21:49 2022] DELETE /identity/v3/users/b0af823276aa42339b1832983d57d3ba => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:21:49.522888 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a27216-ba5d-4f83-9eb1-721a0679aaa8 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:49.524038 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a27216-ba5d-4f83-9eb1-721a0679aaa8 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:49.525159 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a27216-ba5d-4f83-9eb1-721a0679aaa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:49.568302 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-9e8c999e-28dc-4ecf-9fb4-cd564a3f32e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '053ebadc81354855bd304e08b81a97c6'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:49.576287 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-49a27216-ba5d-4f83-9eb1-721a0679aaa8 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:21:49.581711 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-49a27216-ba5d-4f83-9eb1-721a0679aaa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:21:49.597155 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-9e8c999e-28dc-4ecf-9fb4-cd564a3f32e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '053ebadc81354855bd304e08b81a97c6'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:49.615097 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-9e8c999e-28dc-4ecf-9fb4-cd564a3f32e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '053ebadc81354855bd304e08b81a97c6'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:49.617463 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-9e8c999e-28dc-4ecf-9fb4-cd564a3f32e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '053ebadc81354855bd304e08b81a97c6'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:49.635896 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-9e8c999e-28dc-4ecf-9fb4-cd564a3f32e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '053ebadc81354855bd304e08b81a97c6'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:49.654079 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 956/1931] 10.222.0.70 () {58 vars in 1223 bytes} [Tue May 10 19:21:49 2022] DELETE /identity/v3/users/053ebadc81354855bd304e08b81a97c6 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:21:49.656019 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285ab6e5-3036-44e2-a1ac-d351ad3f49c4 None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:49.656387 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285ab6e5-3036-44e2-a1ac-d351ad3f49c4 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:49.657543 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285ab6e5-3036-44e2-a1ac-d351ad3f49c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:49.731793 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-285ab6e5-3036-44e2-a1ac-d351ad3f49c4 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:21:49.736669 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-285ab6e5-3036-44e2-a1ac-d351ad3f49c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:21:49.754466 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 976/1932] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:21:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:21:49.778166 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a27216-ba5d-4f83-9eb1-721a0679aaa8 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:49.779320 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-49a27216-ba5d-4f83-9eb1-721a0679aaa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:21:49.908691 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a27216-ba5d-4f83-9eb1-721a0679aaa8 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:49.962393 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 957/1933] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:21:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:21:49.985341 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285ab6e5-3036-44e2-a1ac-d351ad3f49c4 None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:50.029654 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094c311d-11ab-48b4-9019-0bd7727a7e1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f1dc79540b48c0866478cc48cd8205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:50.030519 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094c311d-11ab-48b4-9019-0bd7727a7e1b service neutron] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:50.030880 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094c311d-11ab-48b4-9019-0bd7727a7e1b service neutron] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:50.041078 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094c311d-11ab-48b4-9019-0bd7727a7e1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:50.052038 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094c311d-11ab-48b4-9019-0bd7727a7e1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:50.054106 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094c311d-11ab-48b4-9019-0bd7727a7e1b service neutron] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:50.067118 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 977/1934] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:21:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 19:21:50.127878 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285ab6e5-3036-44e2-a1ac-d351ad3f49c4 None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:50.131855 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7b10ea-f809-4edc-a377-565b8a333332 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f1dc79540b48c0866478cc48cd8205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:50.132814 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7b10ea-f809-4edc-a377-565b8a333332 service neutron] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:50.133141 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7b10ea-f809-4edc-a377-565b8a333332 service neutron] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:50.133625 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7b10ea-f809-4edc-a377-565b8a333332 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:50.144514 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7b10ea-f809-4edc-a377-565b8a333332 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:50.146052 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7b10ea-f809-4edc-a377-565b8a333332 service neutron] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:50.161411 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 958/1935] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:21:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 19:21:50.414938 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094c311d-11ab-48b4-9019-0bd7727a7e1b service neutron] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:50.417196 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-094c311d-11ab-48b4-9019-0bd7727a7e1b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:21:50.433808 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094c311d-11ab-48b4-9019-0bd7727a7e1b service neutron] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:50.440178 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af46bc7-ebd9-410d-9462-4e253ad340cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:50.441367 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af46bc7-ebd9-410d-9462-4e253ad340cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:50.442551 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af46bc7-ebd9-410d-9462-4e253ad340cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:50.443300 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af46bc7-ebd9-410d-9462-4e253ad340cf admin admin] PATH_INFO: `/v3/projects/2e92758b0ab445ae80cb636133b5d245` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:50.444990 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af46bc7-ebd9-410d-9462-4e253ad340cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e92758b0ab445ae80cb636133b5d245)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:50.447221 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af46bc7-ebd9-410d-9462-4e253ad340cf admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:50.538160 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-5af46bc7-ebd9-410d-9462-4e253ad340cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e92758b0ab445ae80cb636133b5d245', 'request_id': 'req-5af46bc7-ebd9-410d-9462-4e253ad340cf'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:50.549809 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-5af46bc7-ebd9-410d-9462-4e253ad340cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e92758b0ab445ae80cb636133b5d245', 'request_id': 'req-5af46bc7-ebd9-410d-9462-4e253ad340cf'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:50.574829 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-5af46bc7-ebd9-410d-9462-4e253ad340cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e92758b0ab445ae80cb636133b5d245', 'request_id': 'req-5af46bc7-ebd9-410d-9462-4e253ad340cf'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:50.576831 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7b10ea-f809-4edc-a377-565b8a333332 service neutron] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:50.580449 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-2a7b10ea-f809-4edc-a377-565b8a333332 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:21:50.591101 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-5af46bc7-ebd9-410d-9462-4e253ad340cf admin admin] The token cache is being invalidate because project 2e92758b0ab445ae80cb636133b5d245 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79994) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:21:50.597782 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-5af46bc7-ebd9-410d-9462-4e253ad340cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:50.598969 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-5af46bc7-ebd9-410d-9462-4e253ad340cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:50.604037 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 978/1936] 10.222.0.70 () {58 vars in 1232 bytes} [Tue May 10 19:21:50 2022] DELETE /identity/v3/projects/2e92758b0ab445ae80cb636133b5d245 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:21:50.604719 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7b10ea-f809-4edc-a377-565b8a333332 service neutron] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:50.614559 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a006c7-fb88-4a83-9c63-c8d70c73e07a None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:50.617208 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a006c7-fb88-4a83-9c63-c8d70c73e07a None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:50.617714 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a006c7-fb88-4a83-9c63-c8d70c73e07a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:50.657977 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-e9a006c7-fb88-4a83-9c63-c8d70c73e07a None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:21:50.659335 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-e9a006c7-fb88-4a83-9c63-c8d70c73e07a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:21:50.695986 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4b1aaf-670a-4917-9458-9228f2f234e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:50.696904 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4b1aaf-670a-4917-9458-9228f2f234e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:50.697917 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4b1aaf-670a-4917-9458-9228f2f234e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:50.698201 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4b1aaf-670a-4917-9458-9228f2f234e5 admin admin] PATH_INFO: `/v3/projects/a86324b248ca462997a6c1e307303b69` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:50.699424 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4b1aaf-670a-4917-9458-9228f2f234e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a86324b248ca462997a6c1e307303b69)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:50.702005 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4b1aaf-670a-4917-9458-9228f2f234e5 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:50.745533 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 979/1937] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:21:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:21:50.745533 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9214da7-5004-4406-b026-44c3097a20b1 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:50.745533 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9214da7-5004-4406-b026-44c3097a20b1 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:50.745533 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9214da7-5004-4406-b026-44c3097a20b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:50.764809 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-0e4b1aaf-670a-4917-9458-9228f2f234e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a86324b248ca462997a6c1e307303b69', 'request_id': 'req-0e4b1aaf-670a-4917-9458-9228f2f234e5'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:50.767788 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-e9214da7-5004-4406-b026-44c3097a20b1 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:21:50.769151 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-e9214da7-5004-4406-b026-44c3097a20b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:21:50.770581 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-0e4b1aaf-670a-4917-9458-9228f2f234e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a86324b248ca462997a6c1e307303b69', 'request_id': 'req-0e4b1aaf-670a-4917-9458-9228f2f234e5'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:50.779050 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-0e4b1aaf-670a-4917-9458-9228f2f234e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a86324b248ca462997a6c1e307303b69', 'request_id': 'req-0e4b1aaf-670a-4917-9458-9228f2f234e5'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:50.792587 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-0e4b1aaf-670a-4917-9458-9228f2f234e5 admin admin] The token cache is being invalidate because project a86324b248ca462997a6c1e307303b69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79993) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:21:50.792846 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-0e4b1aaf-670a-4917-9458-9228f2f234e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:50.793866 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-0e4b1aaf-670a-4917-9458-9228f2f234e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:50.798576 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 959/1938] 10.222.0.70 () {58 vars in 1232 bytes} [Tue May 10 19:21:50 2022] DELETE /identity/v3/projects/a86324b248ca462997a6c1e307303b69 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:21:50.804041 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145b3e2b-ae5a-4303-a92a-e7b4e6bab723 None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:50.805108 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145b3e2b-ae5a-4303-a92a-e7b4e6bab723 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:50.805427 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145b3e2b-ae5a-4303-a92a-e7b4e6bab723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:50.838985 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-145b3e2b-ae5a-4303-a92a-e7b4e6bab723 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:21:50.840652 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-145b3e2b-ae5a-4303-a92a-e7b4e6bab723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:21:50.846762 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 980/1939] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:21:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:21:50.852457 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 960/1940] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:21:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:21:50.853407 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9214da7-5004-4406-b026-44c3097a20b1 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:50.859674 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d1d24f-ca36-48fa-92dc-b1530f72dd2c None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:50.860111 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d1d24f-ca36-48fa-92dc-b1530f72dd2c None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:50.860391 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d1d24f-ca36-48fa-92dc-b1530f72dd2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:50.862526 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9214da7-5004-4406-b026-44c3097a20b1 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:50.867414 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38568db5-10f1-4f0f-82cc-0bd3c759b648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:50.868077 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38568db5-10f1-4f0f-82cc-0bd3c759b648 admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:50.868356 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38568db5-10f1-4f0f-82cc-0bd3c759b648 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:50.868656 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38568db5-10f1-4f0f-82cc-0bd3c759b648 admin admin] PATH_INFO: `/v3/domains` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:50.869985 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38568db5-10f1-4f0f-82cc-0bd3c759b648 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:21:50.870268 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38568db5-10f1-4f0f-82cc-0bd3c759b648 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:50.871914 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38568db5-10f1-4f0f-82cc-0bd3c759b648 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:50.886016 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 981/1941] 10.222.0.70 () {58 vars in 1152 bytes} [Tue May 10 19:21:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:21:50.886186 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-a5d1d24f-ca36-48fa-92dc-b1530f72dd2c None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:21:50.886961 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-a5d1d24f-ca36-48fa-92dc-b1530f72dd2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:21:50.888447 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38568db5-10f1-4f0f-82cc-0bd3c759b648 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:50.895062 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 961/1942] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:21:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:21:50.898037 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38568db5-10f1-4f0f-82cc-0bd3c759b648 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:50.899214 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d1d24f-ca36-48fa-92dc-b1530f72dd2c None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:50.903244 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ec0833-0849-465f-b4e3-207e6a9b20f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:50.903901 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ec0833-0849-465f-b4e3-207e6a9b20f9 admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:50.904216 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ec0833-0849-465f-b4e3-207e6a9b20f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:50.904848 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ec0833-0849-465f-b4e3-207e6a9b20f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:50.905366 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ec0833-0849-465f-b4e3-207e6a9b20f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:50.907078 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ec0833-0849-465f-b4e3-207e6a9b20f9 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:50.908893 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d1d24f-ca36-48fa-92dc-b1530f72dd2c None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:50.913624 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb2036b-15cf-4b4e-8c9f-6994ba573f9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:50.914283 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb2036b-15cf-4b4e-8c9f-6994ba573f9d admin admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:50.914568 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb2036b-15cf-4b4e-8c9f-6994ba573f9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:50.914843 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb2036b-15cf-4b4e-8c9f-6994ba573f9d admin admin] PATH_INFO: `/v3/domains` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:50.915596 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb2036b-15cf-4b4e-8c9f-6994ba573f9d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:21:50.915932 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb2036b-15cf-4b4e-8c9f-6994ba573f9d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:50.917569 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb2036b-15cf-4b4e-8c9f-6994ba573f9d admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:50.929767 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 962/1943] 10.222.0.70 () {58 vars in 1152 bytes} [Tue May 10 19:21:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:21:50.934553 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb2036b-15cf-4b4e-8c9f-6994ba573f9d admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:50.937854 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 982/1944] 10.222.0.70 () {60 vars in 1152 bytes} [Tue May 10 19:21:50 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 19:21:50.939380 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ec0833-0849-465f-b4e3-207e6a9b20f9 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:50.946842 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb2036b-15cf-4b4e-8c9f-6994ba573f9d admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:51.007347 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ec0833-0849-465f-b4e3-207e6a9b20f9 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:51.012307 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab71be3-9472-4dbd-ad33-d6fb68cb8aac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:51.012722 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d62853f-6b41-4148-8f3f-9258b3476449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:51.013006 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab71be3-9472-4dbd-ad33-d6fb68cb8aac admin admin] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:51.013326 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab71be3-9472-4dbd-ad33-d6fb68cb8aac admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:51.013437 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d62853f-6b41-4148-8f3f-9258b3476449 admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:51.013635 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab71be3-9472-4dbd-ad33-d6fb68cb8aac admin admin] PATH_INFO: `/v3/projects` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:51.013763 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d62853f-6b41-4148-8f3f-9258b3476449 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:51.013951 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d62853f-6b41-4148-8f3f-9258b3476449 admin admin] PATH_INFO: `/v3/users` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:51.014334 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab71be3-9472-4dbd-ad33-d6fb68cb8aac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:51.014634 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d62853f-6b41-4148-8f3f-9258b3476449 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:51.016223 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab71be3-9472-4dbd-ad33-d6fb68cb8aac admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:51.016541 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d62853f-6b41-4148-8f3f-9258b3476449 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:51.039962 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 983/1945] 10.222.0.70 () {60 vars in 1143 bytes} [Tue May 10 19:21:50 2022] POST /identity/v3/users => generated 287 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 19:21:51.042436 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d62853f-6b41-4148-8f3f-9258b3476449 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:51.046549 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 963/1946] 10.222.0.70 () {60 vars in 1152 bytes} [Tue May 10 19:21:50 2022] POST /identity/v3/projects => generated 375 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 19:21:51.050860 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab71be3-9472-4dbd-ad33-d6fb68cb8aac admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:51.052371 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d62853f-6b41-4148-8f3f-9258b3476449 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:51.125085 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e863b20c-48cc-4fbd-9aae-89d2595715b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:51.125770 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e863b20c-48cc-4fbd-9aae-89d2595715b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:51.126052 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e863b20c-48cc-4fbd-9aae-89d2595715b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:51.126326 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e863b20c-48cc-4fbd-9aae-89d2595715b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:51.127038 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e863b20c-48cc-4fbd-9aae-89d2595715b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:51.128743 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e863b20c-48cc-4fbd-9aae-89d2595715b5 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:51.129925 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab71be3-9472-4dbd-ad33-d6fb68cb8aac admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:51.135329 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166fe155-2e09-4991-9c20-a88fdbdf9187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:51.136149 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166fe155-2e09-4991-9c20-a88fdbdf9187 admin admin] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:51.136454 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166fe155-2e09-4991-9c20-a88fdbdf9187 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:51.136802 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166fe155-2e09-4991-9c20-a88fdbdf9187 admin admin] PATH_INFO: `/v3/users` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:51.137569 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166fe155-2e09-4991-9c20-a88fdbdf9187 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:51.140520 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 984/1947] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:21:51 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:21:51.140651 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166fe155-2e09-4991-9c20-a88fdbdf9187 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:51.143015 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e863b20c-48cc-4fbd-9aae-89d2595715b5 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:51.153472 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e863b20c-48cc-4fbd-9aae-89d2595715b5 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:51.158502 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7650d9-3006-433b-bb29-99933e30aee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:51.159321 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7650d9-3006-433b-bb29-99933e30aee3 admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:51.159598 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7650d9-3006-433b-bb29-99933e30aee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:51.159876 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7650d9-3006-433b-bb29-99933e30aee3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:51.160631 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7650d9-3006-433b-bb29-99933e30aee3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:51.162251 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7650d9-3006-433b-bb29-99933e30aee3 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:51.167718 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 964/1948] 10.222.0.70 () {60 vars in 1143 bytes} [Tue May 10 19:21:51 2022] POST /identity/v3/users => generated 288 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 19:21:51.168762 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166fe155-2e09-4991-9c20-a88fdbdf9187 admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:51.178812 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166fe155-2e09-4991-9c20-a88fdbdf9187 admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:51.182170 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 985/1949] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:21:51 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 19:21:51.186013 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e17dffd-e7cc-4613-ace1-37d3c2560967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:51.186305 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7650d9-3006-433b-bb29-99933e30aee3 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:51.186800 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e17dffd-e7cc-4613-ace1-37d3c2560967 admin admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:51.187153 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e17dffd-e7cc-4613-ace1-37d3c2560967 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:51.187437 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e17dffd-e7cc-4613-ace1-37d3c2560967 admin admin] PATH_INFO: `/v3/roles` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:51.188158 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e17dffd-e7cc-4613-ace1-37d3c2560967 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:51.189777 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e17dffd-e7cc-4613-ace1-37d3c2560967 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:51.195747 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7650d9-3006-433b-bb29-99933e30aee3 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:51.200462 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 965/1950] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:21:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 19:21:51.203076 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50efaa39-9a53-451c-8ec8-cc841c745071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:51.204021 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50efaa39-9a53-451c-8ec8-cc841c745071 admin admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:51.204303 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50efaa39-9a53-451c-8ec8-cc841c745071 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:51.204468 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e17dffd-e7cc-4613-ace1-37d3c2560967 admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:51.204651 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50efaa39-9a53-451c-8ec8-cc841c745071 admin admin] PATH_INFO: `/v3/projects/f2c181352e654eaab3d3b8fd89713620/users/1ea42e622a2e40db8e8b4c93a83f78c5/roles/5c07cf5bfbd3427db18428aa50420962` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:51.214542 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e17dffd-e7cc-4613-ace1-37d3c2560967 admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:51.219270 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34e255e-6757-4ffe-93cc-7b8afe2825bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:51.219514 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50efaa39-9a53-451c-8ec8-cc841c745071 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2c181352e654eaab3d3b8fd89713620, user_id=1ea42e622a2e40db8e8b4c93a83f78c5, role_id=5c07cf5bfbd3427db18428aa50420962)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:51.219815 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34e255e-6757-4ffe-93cc-7b8afe2825bf admin admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:51.220102 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34e255e-6757-4ffe-93cc-7b8afe2825bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:51.220385 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34e255e-6757-4ffe-93cc-7b8afe2825bf admin admin] PATH_INFO: `/v3/roles` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:51.221131 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34e255e-6757-4ffe-93cc-7b8afe2825bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:51.222170 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50efaa39-9a53-451c-8ec8-cc841c745071 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:51.222823 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34e255e-6757-4ffe-93cc-7b8afe2825bf admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:51.233689 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 966/1951] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:21:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 19:21:51.236143 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 986/1952] 10.222.0.70 () {60 vars in 1482 bytes} [Tue May 10 19:21:51 2022] PUT /identity/v3/projects/f2c181352e654eaab3d3b8fd89713620/users/1ea42e622a2e40db8e8b4c93a83f78c5/roles/5c07cf5bfbd3427db18428aa50420962 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 19:21:51.245759 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34e255e-6757-4ffe-93cc-7b8afe2825bf admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:51.246333 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a15b15-0a2b-46cb-9c82-f490026715bd None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:51.246635 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a15b15-0a2b-46cb-9c82-f490026715bd None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:51.246917 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a15b15-0a2b-46cb-9c82-f490026715bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:51.255929 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34e255e-6757-4ffe-93cc-7b8afe2825bf admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:51.272829 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-73a15b15-0a2b-46cb-9c82-f490026715bd None None] MFA Rules not processed for user `1ea42e622a2e40db8e8b4c93a83f78c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:21:51.274098 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-73a15b15-0a2b-46cb-9c82-f490026715bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:21:51.323154 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6886cb46-5e25-4ee9-88ee-60ab38e300c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:51.324156 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6886cb46-5e25-4ee9-88ee-60ab38e300c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:51.324482 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6886cb46-5e25-4ee9-88ee-60ab38e300c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:51.324767 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6886cb46-5e25-4ee9-88ee-60ab38e300c9 admin admin] PATH_INFO: `/v3/projects/e7b15023f7ac4a6d99462a9fe6101c70/users/cd895abbbf4f48939f658be1a1d369b5/roles/5c07cf5bfbd3427db18428aa50420962` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:51.340595 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6886cb46-5e25-4ee9-88ee-60ab38e300c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7b15023f7ac4a6d99462a9fe6101c70, user_id=cd895abbbf4f48939f658be1a1d369b5, role_id=5c07cf5bfbd3427db18428aa50420962)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:51.343365 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6886cb46-5e25-4ee9-88ee-60ab38e300c9 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:51.345439 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 987/1953] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:21:51 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:21:51.350231 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a15b15-0a2b-46cb-9c82-f490026715bd None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:51.362737 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a15b15-0a2b-46cb-9c82-f490026715bd None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:51.368534 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 967/1954] 10.222.0.70 () {60 vars in 1482 bytes} [Tue May 10 19:21:51 2022] PUT /identity/v3/projects/e7b15023f7ac4a6d99462a9fe6101c70/users/cd895abbbf4f48939f658be1a1d369b5/roles/5c07cf5bfbd3427db18428aa50420962 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:21:51.370722 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc167fa-c91d-4af0-91e2-82859c80d96d None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:51.371015 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc167fa-c91d-4af0-91e2-82859c80d96d None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:51.371357 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc167fa-c91d-4af0-91e2-82859c80d96d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:51.400397 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-7bc167fa-c91d-4af0-91e2-82859c80d96d None None] MFA Rules not processed for user `cd895abbbf4f48939f658be1a1d369b5`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:21:51.401926 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-7bc167fa-c91d-4af0-91e2-82859c80d96d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:21:51.438995 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b70403-b899-4392-b564-2f337dadb68d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:51.439933 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b70403-b899-4392-b564-2f337dadb68d admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:51.440404 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b70403-b899-4392-b564-2f337dadb68d admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:51.440719 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b70403-b899-4392-b564-2f337dadb68d admin admin] PATH_INFO: `/v3/projects` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:51.441467 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b70403-b899-4392-b564-2f337dadb68d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:51.444715 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b70403-b899-4392-b564-2f337dadb68d admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:51.469761 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 968/1955] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:21:51 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:21:51.472193 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 988/1956] 10.222.0.70 () {60 vars in 1152 bytes} [Tue May 10 19:21:51 2022] POST /identity/v3/projects => generated 375 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 19:21:51.477333 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc167fa-c91d-4af0-91e2-82859c80d96d None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:51.484503 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b70403-b899-4392-b564-2f337dadb68d admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:51.486351 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-c8b70403-b899-4392-b564-2f337dadb68d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:21:51.488246 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc167fa-c91d-4af0-91e2-82859c80d96d None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:51.540811 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b70403-b899-4392-b564-2f337dadb68d admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:51.542020 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cf6dfe-220b-42b6-bda3-ee7dc588fda2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:51.542695 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cf6dfe-220b-42b6-bda3-ee7dc588fda2 admin admin] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:51.542982 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cf6dfe-220b-42b6-bda3-ee7dc588fda2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:51.543252 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cf6dfe-220b-42b6-bda3-ee7dc588fda2 admin admin] PATH_INFO: `/v3/users` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:51.543934 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cf6dfe-220b-42b6-bda3-ee7dc588fda2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:51.544634 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05185be-3361-4334-9347-a85865748889 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15df2a8967aa43299c10e365f4200d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:51.545288 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05185be-3361-4334-9347-a85865748889 service cinder] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:51.545573 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05185be-3361-4334-9347-a85865748889 service cinder] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:51.545849 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05185be-3361-4334-9347-a85865748889 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:51.545941 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cf6dfe-220b-42b6-bda3-ee7dc588fda2 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:51.566755 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 969/1957] 10.222.0.70 () {60 vars in 1143 bytes} [Tue May 10 19:21:51 2022] POST /identity/v3/users => generated 294 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:21:51.570813 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cf6dfe-220b-42b6-bda3-ee7dc588fda2 admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:51.580365 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cf6dfe-220b-42b6-bda3-ee7dc588fda2 admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:51.585033 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1878818-6347-4660-876e-b174e6ae0b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:51.585679 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1878818-6347-4660-876e-b174e6ae0b46 admin admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:51.585964 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1878818-6347-4660-876e-b174e6ae0b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:51.586248 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1878818-6347-4660-876e-b174e6ae0b46 admin admin] PATH_INFO: `/v3/roles` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:51.586963 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1878818-6347-4660-876e-b174e6ae0b46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:51.589087 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1878818-6347-4660-876e-b174e6ae0b46 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:51.599109 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 970/1958] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:21:51 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 19:21:51.602800 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1878818-6347-4660-876e-b174e6ae0b46 admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:51.603655 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05185be-3361-4334-9347-a85865748889 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:51.605129 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05185be-3361-4334-9347-a85865748889 service cinder] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:51.612097 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1878818-6347-4660-876e-b174e6ae0b46 admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:51.614095 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 989/1959] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:21:51 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 19:21:51.616756 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e603dbb-015c-4ff1-a60f-a5694c179b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:51.617629 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e603dbb-015c-4ff1-a60f-a5694c179b08 admin admin] REQUEST_METHOD: `PUT` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:51.617914 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e603dbb-015c-4ff1-a60f-a5694c179b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:51.618193 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e603dbb-015c-4ff1-a60f-a5694c179b08 admin admin] PATH_INFO: `/v3/projects/1a05fb8b13ad420eb04b77f51ff21e63/users/a7ee11ddcba545d58da8babe7a574562/roles/634ba284303b4626b5a0402772c68f5c` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:51.633648 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e603dbb-015c-4ff1-a60f-a5694c179b08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a05fb8b13ad420eb04b77f51ff21e63, user_id=a7ee11ddcba545d58da8babe7a574562, role_id=634ba284303b4626b5a0402772c68f5c)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:51.636354 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e603dbb-015c-4ff1-a60f-a5694c179b08 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:51.650215 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 971/1960] 10.222.0.70 () {60 vars in 1482 bytes} [Tue May 10 19:21:51 2022] PUT /identity/v3/projects/1a05fb8b13ad420eb04b77f51ff21e63/users/a7ee11ddcba545d58da8babe7a574562/roles/634ba284303b4626b5a0402772c68f5c => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 19:21:51.654680 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05185be-3361-4334-9347-a85865748889 service cinder] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:51.665536 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05185be-3361-4334-9347-a85865748889 service cinder] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:51.720544 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21778be-f112-4605-934d-85ebbc043fd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:51.721308 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21778be-f112-4605-934d-85ebbc043fd4 admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:51.721592 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21778be-f112-4605-934d-85ebbc043fd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:51.721867 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21778be-f112-4605-934d-85ebbc043fd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:51.722586 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21778be-f112-4605-934d-85ebbc043fd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:51.724214 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21778be-f112-4605-934d-85ebbc043fd4 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:51.734069 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 990/1961] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:21:51 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 19:21:51.738425 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e603dbb-015c-4ff1-a60f-a5694c179b08 admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:51.749616 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e603dbb-015c-4ff1-a60f-a5694c179b08 admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:51.754813 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa0d794-b6f5-4125-8f9b-c50bcf3353c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:51.755779 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa0d794-b6f5-4125-8f9b-c50bcf3353c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:51.756135 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa0d794-b6f5-4125-8f9b-c50bcf3353c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:51.756431 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa0d794-b6f5-4125-8f9b-c50bcf3353c7 admin admin] PATH_INFO: `/v3/projects/1a05fb8b13ad420eb04b77f51ff21e63/users/a7ee11ddcba545d58da8babe7a574562/roles/634ba284303b4626b5a0402772c68f5c` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:51.758432 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa0d794-b6f5-4125-8f9b-c50bcf3353c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a05fb8b13ad420eb04b77f51ff21e63, user_id=a7ee11ddcba545d58da8babe7a574562, role_id=634ba284303b4626b5a0402772c68f5c)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:51.761245 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa0d794-b6f5-4125-8f9b-c50bcf3353c7 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:51.771735 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 972/1962] 10.222.0.70 () {60 vars in 1482 bytes} [Tue May 10 19:21:51 2022] PUT /identity/v3/projects/1a05fb8b13ad420eb04b77f51ff21e63/users/a7ee11ddcba545d58da8babe7a574562/roles/634ba284303b4626b5a0402772c68f5c => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:21:51.782606 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5970b086-4c87-4997-9848-843aed3347f2 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:51.782903 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5970b086-4c87-4997-9848-843aed3347f2 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:51.783184 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5970b086-4c87-4997-9848-843aed3347f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:51.810332 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-5970b086-4c87-4997-9848-843aed3347f2 None None] MFA Rules not processed for user `a7ee11ddcba545d58da8babe7a574562`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:21:51.811559 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-5970b086-4c87-4997-9848-843aed3347f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:21:51.883873 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 991/1963] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:21:51 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:21:51.910574 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa0d794-b6f5-4125-8f9b-c50bcf3353c7 admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:52.000387 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa0d794-b6f5-4125-8f9b-c50bcf3353c7 admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:52.006888 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a17877-480b-4d26-ac67-a70421cb5ef9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15df2a8967aa43299c10e365f4200d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:52.007790 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a17877-480b-4d26-ac67-a70421cb5ef9 service cinder] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:52.008074 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a17877-480b-4d26-ac67-a70421cb5ef9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:52.008352 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a17877-480b-4d26-ac67-a70421cb5ef9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:52.080892 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a17877-480b-4d26-ac67-a70421cb5ef9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:52.082501 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a17877-480b-4d26-ac67-a70421cb5ef9 service cinder] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:52.089109 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5970b086-4c87-4997-9848-843aed3347f2 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:52.090589 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-5970b086-4c87-4997-9848-843aed3347f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:21:52.094183 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 973/1964] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:21:51 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:21:52.155822 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5970b086-4c87-4997-9848-843aed3347f2 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:52.160336 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f50e7b9-b495-4517-bcdc-e9bcc140ea9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:52.161229 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f50e7b9-b495-4517-bcdc-e9bcc140ea9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:52.161509 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f50e7b9-b495-4517-bcdc-e9bcc140ea9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:52.161782 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f50e7b9-b495-4517-bcdc-e9bcc140ea9b admin admin] PATH_INFO: `/v3/users/ca00999a9d9345588f0e50ce3398c2b0` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:52.162967 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f50e7b9-b495-4517-bcdc-e9bcc140ea9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca00999a9d9345588f0e50ce3398c2b0)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:52.164920 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f50e7b9-b495-4517-bcdc-e9bcc140ea9b admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:52.224963 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-7f50e7b9-b495-4517-bcdc-e9bcc140ea9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca00999a9d9345588f0e50ce3398c2b0'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:52.243057 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-7f50e7b9-b495-4517-bcdc-e9bcc140ea9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca00999a9d9345588f0e50ce3398c2b0'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:52.243743 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-7f50e7b9-b495-4517-bcdc-e9bcc140ea9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca00999a9d9345588f0e50ce3398c2b0'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:52.251225 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-7f50e7b9-b495-4517-bcdc-e9bcc140ea9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca00999a9d9345588f0e50ce3398c2b0'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:52.259287 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-7f50e7b9-b495-4517-bcdc-e9bcc140ea9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca00999a9d9345588f0e50ce3398c2b0'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:52.266506 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 992/1965] 10.222.0.70 () {58 vars in 1223 bytes} [Tue May 10 19:21:52 2022] DELETE /identity/v3/users/ca00999a9d9345588f0e50ce3398c2b0 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:21:52.271201 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11edb727-d9e7-42c4-9800-8d329360a6b7 None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:52.271538 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11edb727-d9e7-42c4-9800-8d329360a6b7 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:52.271816 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11edb727-d9e7-42c4-9800-8d329360a6b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:52.289878 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-11edb727-d9e7-42c4-9800-8d329360a6b7 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:21:52.291919 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-11edb727-d9e7-42c4-9800-8d329360a6b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:21:52.375667 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 974/1966] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:21:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:21:52.389096 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f50e7b9-b495-4517-bcdc-e9bcc140ea9b admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:52.391628 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-7f50e7b9-b495-4517-bcdc-e9bcc140ea9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:21:52.454428 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f50e7b9-b495-4517-bcdc-e9bcc140ea9b admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:52.458071 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64231ac2-1f02-4eab-a483-286a499ab3c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f1dc79540b48c0866478cc48cd8205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:52.458729 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64231ac2-1f02-4eab-a483-286a499ab3c3 service neutron] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:52.459010 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64231ac2-1f02-4eab-a483-286a499ab3c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:52.459311 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64231ac2-1f02-4eab-a483-286a499ab3c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:52.469858 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64231ac2-1f02-4eab-a483-286a499ab3c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:52.471324 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64231ac2-1f02-4eab-a483-286a499ab3c3 service neutron] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:52.481252 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 993/1967] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:21:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:21:52.751535 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11edb727-d9e7-42c4-9800-8d329360a6b7 None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:52.753102 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-11edb727-d9e7-42c4-9800-8d329360a6b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:21:52.770546 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11edb727-d9e7-42c4-9800-8d329360a6b7 None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:52.775951 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a239d921-8896-440f-bad0-a8ffd074b3c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:52.776867 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a239d921-8896-440f-bad0-a8ffd074b3c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:52.777153 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a239d921-8896-440f-bad0-a8ffd074b3c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:52.777499 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a239d921-8896-440f-bad0-a8ffd074b3c8 admin admin] PATH_INFO: `/v3/projects/e1f877136e804c59b4bd9bac1fc89ab4` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:52.778681 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a239d921-8896-440f-bad0-a8ffd074b3c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1f877136e804c59b4bd9bac1fc89ab4)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:52.780623 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a239d921-8896-440f-bad0-a8ffd074b3c8 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:52.826291 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-a239d921-8896-440f-bad0-a8ffd074b3c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1f877136e804c59b4bd9bac1fc89ab4', 'request_id': 'req-a239d921-8896-440f-bad0-a8ffd074b3c8'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:52.832007 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-a239d921-8896-440f-bad0-a8ffd074b3c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1f877136e804c59b4bd9bac1fc89ab4', 'request_id': 'req-a239d921-8896-440f-bad0-a8ffd074b3c8'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:52.839750 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-a239d921-8896-440f-bad0-a8ffd074b3c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1f877136e804c59b4bd9bac1fc89ab4', 'request_id': 'req-a239d921-8896-440f-bad0-a8ffd074b3c8'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:52.852834 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-a239d921-8896-440f-bad0-a8ffd074b3c8 admin admin] The token cache is being invalidate because project e1f877136e804c59b4bd9bac1fc89ab4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79993) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:21:52.853122 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-a239d921-8896-440f-bad0-a8ffd074b3c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:52.853758 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-a239d921-8896-440f-bad0-a8ffd074b3c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:52.855285 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 975/1968] 10.222.0.70 () {58 vars in 1232 bytes} [Tue May 10 19:21:52 2022] DELETE /identity/v3/projects/e1f877136e804c59b4bd9bac1fc89ab4 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:21:52.859380 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64231ac2-1f02-4eab-a483-286a499ab3c3 service neutron] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:52.869543 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64231ac2-1f02-4eab-a483-286a499ab3c3 service neutron] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:52.925702 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ffff3d-1e18-426f-9999-f76e0c1fb8c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:52.926706 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ffff3d-1e18-426f-9999-f76e0c1fb8c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:52.926842 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ffff3d-1e18-426f-9999-f76e0c1fb8c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:52.927121 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ffff3d-1e18-426f-9999-f76e0c1fb8c2 admin admin] PATH_INFO: `/v3/users/083ea46b2c9243ad92bacbec9303eae5` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:52.928307 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ffff3d-1e18-426f-9999-f76e0c1fb8c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=083ea46b2c9243ad92bacbec9303eae5)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:52.930341 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ffff3d-1e18-426f-9999-f76e0c1fb8c2 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:52.976294 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-c6ffff3d-1e18-426f-9999-f76e0c1fb8c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '083ea46b2c9243ad92bacbec9303eae5'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:52.988482 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-c6ffff3d-1e18-426f-9999-f76e0c1fb8c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '083ea46b2c9243ad92bacbec9303eae5'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:52.989253 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-c6ffff3d-1e18-426f-9999-f76e0c1fb8c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '083ea46b2c9243ad92bacbec9303eae5'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:52.996985 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-c6ffff3d-1e18-426f-9999-f76e0c1fb8c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '083ea46b2c9243ad92bacbec9303eae5'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:53.003870 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-c6ffff3d-1e18-426f-9999-f76e0c1fb8c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '083ea46b2c9243ad92bacbec9303eae5'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:53.009726 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 994/1969] 10.222.0.70 () {58 vars in 1223 bytes} [Tue May 10 19:21:52 2022] DELETE /identity/v3/users/083ea46b2c9243ad92bacbec9303eae5 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:21:53.353891 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a239d921-8896-440f-bad0-a8ffd074b3c8 admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:53.355290 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-a239d921-8896-440f-bad0-a8ffd074b3c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:21:53.368819 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a239d921-8896-440f-bad0-a8ffd074b3c8 admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:53.426873 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d520abf1-834f-422e-902a-524d187c0e6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:53.427744 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d520abf1-834f-422e-902a-524d187c0e6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:53.428027 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d520abf1-834f-422e-902a-524d187c0e6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:53.428319 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d520abf1-834f-422e-902a-524d187c0e6c admin admin] PATH_INFO: `/v3/projects/1fdfb8e5cdb649618d84f66d5ef5a8be` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:53.429596 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d520abf1-834f-422e-902a-524d187c0e6c admin admin] RBAC: Authorizing `identity:delete_project(project_id=1fdfb8e5cdb649618d84f66d5ef5a8be)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:53.432068 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d520abf1-834f-422e-902a-524d187c0e6c admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:53.477022 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-d520abf1-834f-422e-902a-524d187c0e6c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1fdfb8e5cdb649618d84f66d5ef5a8be', 'request_id': 'req-d520abf1-834f-422e-902a-524d187c0e6c'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:53.483243 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-d520abf1-834f-422e-902a-524d187c0e6c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1fdfb8e5cdb649618d84f66d5ef5a8be', 'request_id': 'req-d520abf1-834f-422e-902a-524d187c0e6c'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:53.491072 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-d520abf1-834f-422e-902a-524d187c0e6c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1fdfb8e5cdb649618d84f66d5ef5a8be', 'request_id': 'req-d520abf1-834f-422e-902a-524d187c0e6c'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:53.505202 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-d520abf1-834f-422e-902a-524d187c0e6c admin admin] The token cache is being invalidate because project 1fdfb8e5cdb649618d84f66d5ef5a8be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79993) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:21:53.505496 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-d520abf1-834f-422e-902a-524d187c0e6c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:53.506185 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-d520abf1-834f-422e-902a-524d187c0e6c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:53.507767 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 976/1970] 10.222.0.70 () {58 vars in 1232 bytes} [Tue May 10 19:21:53 2022] DELETE /identity/v3/projects/1fdfb8e5cdb649618d84f66d5ef5a8be => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:21:53.513132 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e8e7d7-8690-441b-9a99-bc05cc774529 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:53.513643 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e8e7d7-8690-441b-9a99-bc05cc774529 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:53.514020 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e8e7d7-8690-441b-9a99-bc05cc774529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:53.536013 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-e0e8e7d7-8690-441b-9a99-bc05cc774529 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:21:53.537462 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-e0e8e7d7-8690-441b-9a99-bc05cc774529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:21:53.622254 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 995/1971] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:21:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:21:53.630354 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb767945-a4b5-4ae5-9a89-81593ba10c78 None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:53.630646 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb767945-a4b5-4ae5-9a89-81593ba10c78 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:53.630926 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb767945-a4b5-4ae5-9a89-81593ba10c78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:53.652611 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-eb767945-a4b5-4ae5-9a89-81593ba10c78 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:21:53.653867 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-eb767945-a4b5-4ae5-9a89-81593ba10c78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:21:53.663195 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 977/1972] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:21:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:21:53.670529 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e8e7d7-8690-441b-9a99-bc05cc774529 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:53.678178 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e8e7d7-8690-441b-9a99-bc05cc774529 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:53.683296 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2d4d13-fcf3-4f14-bee5-f654d1946768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:53.683951 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2d4d13-fcf3-4f14-bee5-f654d1946768 admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:53.684231 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2d4d13-fcf3-4f14-bee5-f654d1946768 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:53.684531 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2d4d13-fcf3-4f14-bee5-f654d1946768 admin admin] PATH_INFO: `/v3/domains` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:53.685305 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2d4d13-fcf3-4f14-bee5-f654d1946768 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:21:53.685611 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2d4d13-fcf3-4f14-bee5-f654d1946768 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:53.687277 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2d4d13-fcf3-4f14-bee5-f654d1946768 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:53.701114 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 996/1973] 10.222.0.70 () {58 vars in 1152 bytes} [Tue May 10 19:21:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:21:53.705311 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb767945-a4b5-4ae5-9a89-81593ba10c78 None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:53.715983 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb767945-a4b5-4ae5-9a89-81593ba10c78 None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:53.721226 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd06a7cc-27b9-4522-87e1-30f26faa47d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:53.721921 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd06a7cc-27b9-4522-87e1-30f26faa47d9 admin admin] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:53.722204 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd06a7cc-27b9-4522-87e1-30f26faa47d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:53.722478 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd06a7cc-27b9-4522-87e1-30f26faa47d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:53.723166 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd06a7cc-27b9-4522-87e1-30f26faa47d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:53.725160 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd06a7cc-27b9-4522-87e1-30f26faa47d9 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:53.751240 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 978/1974] 10.222.0.70 () {60 vars in 1152 bytes} [Tue May 10 19:21:53 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 19:21:53.755456 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2d4d13-fcf3-4f14-bee5-f654d1946768 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:53.765667 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2d4d13-fcf3-4f14-bee5-f654d1946768 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:53.822153 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfbce48-f0c1-4c96-ba14-a76080fcb3a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:53.822816 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfbce48-f0c1-4c96-ba14-a76080fcb3a8 admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:53.823098 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfbce48-f0c1-4c96-ba14-a76080fcb3a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:53.823374 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfbce48-f0c1-4c96-ba14-a76080fcb3a8 admin admin] PATH_INFO: `/v3/users` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:53.824073 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfbce48-f0c1-4c96-ba14-a76080fcb3a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:53.826285 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfbce48-f0c1-4c96-ba14-a76080fcb3a8 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:53.850189 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 997/1975] 10.222.0.70 () {60 vars in 1143 bytes} [Tue May 10 19:21:53 2022] POST /identity/v3/users => generated 287 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 19:21:53.851483 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd06a7cc-27b9-4522-87e1-30f26faa47d9 admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:53.863396 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd06a7cc-27b9-4522-87e1-30f26faa47d9 admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:53.867568 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04690fa-093d-4ef1-9444-c6abed0c0777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:53.868237 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04690fa-093d-4ef1-9444-c6abed0c0777 admin admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:53.868581 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04690fa-093d-4ef1-9444-c6abed0c0777 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:53.868858 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04690fa-093d-4ef1-9444-c6abed0c0777 admin admin] PATH_INFO: `/v3/roles` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:53.870072 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04690fa-093d-4ef1-9444-c6abed0c0777 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:53.871715 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04690fa-093d-4ef1-9444-c6abed0c0777 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:53.883086 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 979/1976] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:21:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:21:53.887653 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfbce48-f0c1-4c96-ba14-a76080fcb3a8 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:53.897285 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfbce48-f0c1-4c96-ba14-a76080fcb3a8 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:53.901889 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21a5f7a-e868-4502-8a69-8e0c086e0c54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:53.902536 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21a5f7a-e868-4502-8a69-8e0c086e0c54 admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:53.902819 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21a5f7a-e868-4502-8a69-8e0c086e0c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:53.903092 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21a5f7a-e868-4502-8a69-8e0c086e0c54 admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:53.903807 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21a5f7a-e868-4502-8a69-8e0c086e0c54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:53.905408 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21a5f7a-e868-4502-8a69-8e0c086e0c54 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:53.915604 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 998/1977] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:21:53 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:21:53.920173 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04690fa-093d-4ef1-9444-c6abed0c0777 admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:53.930137 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04690fa-093d-4ef1-9444-c6abed0c0777 admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:53.936778 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb038259-862c-478e-b032-3826b3a5c3e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:53.937755 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb038259-862c-478e-b032-3826b3a5c3e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:53.938201 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb038259-862c-478e-b032-3826b3a5c3e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:53.938694 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb038259-862c-478e-b032-3826b3a5c3e5 admin admin] PATH_INFO: `/v3/projects/42262f61351e4942a9f814d9def32fa4/users/6282a9911b8d4b84b717dfd4d693b29b/roles/5c07cf5bfbd3427db18428aa50420962` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:53.955036 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb038259-862c-478e-b032-3826b3a5c3e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42262f61351e4942a9f814d9def32fa4, user_id=6282a9911b8d4b84b717dfd4d693b29b, role_id=5c07cf5bfbd3427db18428aa50420962)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:53.957998 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb038259-862c-478e-b032-3826b3a5c3e5 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:53.971749 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 980/1978] 10.222.0.70 () {60 vars in 1482 bytes} [Tue May 10 19:21:53 2022] PUT /identity/v3/projects/42262f61351e4942a9f814d9def32fa4/users/6282a9911b8d4b84b717dfd4d693b29b/roles/5c07cf5bfbd3427db18428aa50420962 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:21:53.982746 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f114b98-2d4f-4873-a2a5-920ef0d1cef8 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:53.983030 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f114b98-2d4f-4873-a2a5-920ef0d1cef8 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:53.983303 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f114b98-2d4f-4873-a2a5-920ef0d1cef8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:54.011039 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-7f114b98-2d4f-4873-a2a5-920ef0d1cef8 None None] MFA Rules not processed for user `6282a9911b8d4b84b717dfd4d693b29b`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:21:54.012248 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-7f114b98-2d4f-4873-a2a5-920ef0d1cef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:21:54.081866 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 999/1979] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:21:53 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:21:54.092299 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb038259-862c-478e-b032-3826b3a5c3e5 admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:54.094014 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-bb038259-862c-478e-b032-3826b3a5c3e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:21:54.149381 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb038259-862c-478e-b032-3826b3a5c3e5 admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:54.153162 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dbd4ff-654c-47a1-8125-a47b317a6268 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15df2a8967aa43299c10e365f4200d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:54.153810 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dbd4ff-654c-47a1-8125-a47b317a6268 service cinder] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:54.154097 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dbd4ff-654c-47a1-8125-a47b317a6268 service cinder] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:54.154376 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dbd4ff-654c-47a1-8125-a47b317a6268 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:54.165318 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dbd4ff-654c-47a1-8125-a47b317a6268 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:54.167434 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dbd4ff-654c-47a1-8125-a47b317a6268 service cinder] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:54.178450 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 981/1980] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:21:54 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:21:54.316826 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f114b98-2d4f-4873-a2a5-920ef0d1cef8 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:54.318410 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-7f114b98-2d4f-4873-a2a5-920ef0d1cef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:21:54.391103 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f114b98-2d4f-4873-a2a5-920ef0d1cef8 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:54.396516 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec05322-8e25-46ea-925d-1db941d53535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:54.397404 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec05322-8e25-46ea-925d-1db941d53535 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:54.397714 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec05322-8e25-46ea-925d-1db941d53535 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:54.397998 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec05322-8e25-46ea-925d-1db941d53535 admin admin] PATH_INFO: `/v3/users/7081de6673aa463292118a0673959ea9` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:54.399217 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec05322-8e25-46ea-925d-1db941d53535 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7081de6673aa463292118a0673959ea9)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:54.401259 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec05322-8e25-46ea-925d-1db941d53535 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:54.451343 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-aec05322-8e25-46ea-925d-1db941d53535 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7081de6673aa463292118a0673959ea9'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:54.464170 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-aec05322-8e25-46ea-925d-1db941d53535 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7081de6673aa463292118a0673959ea9'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:54.464990 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-aec05322-8e25-46ea-925d-1db941d53535 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7081de6673aa463292118a0673959ea9'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:54.473710 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-aec05322-8e25-46ea-925d-1db941d53535 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7081de6673aa463292118a0673959ea9'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:54.481989 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-aec05322-8e25-46ea-925d-1db941d53535 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7081de6673aa463292118a0673959ea9'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:54.488844 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1000/1981] 10.222.0.70 () {58 vars in 1223 bytes} [Tue May 10 19:21:54 2022] DELETE /identity/v3/users/7081de6673aa463292118a0673959ea9 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:21:54.693997 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dbd4ff-654c-47a1-8125-a47b317a6268 service cinder] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:54.706399 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dbd4ff-654c-47a1-8125-a47b317a6268 service cinder] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:54.762212 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d21237-6732-488c-bb38-f9d00963658c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:54.763148 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d21237-6732-488c-bb38-f9d00963658c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:54.763445 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d21237-6732-488c-bb38-f9d00963658c admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:54.763716 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d21237-6732-488c-bb38-f9d00963658c admin admin] PATH_INFO: `/v3/projects/2f6baa22c9994643b63ecfe6b43988f6` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:54.764922 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d21237-6732-488c-bb38-f9d00963658c admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f6baa22c9994643b63ecfe6b43988f6)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:54.766822 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d21237-6732-488c-bb38-f9d00963658c admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:54.810765 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-21d21237-6732-488c-bb38-f9d00963658c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f6baa22c9994643b63ecfe6b43988f6', 'request_id': 'req-21d21237-6732-488c-bb38-f9d00963658c'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:54.815842 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-21d21237-6732-488c-bb38-f9d00963658c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f6baa22c9994643b63ecfe6b43988f6', 'request_id': 'req-21d21237-6732-488c-bb38-f9d00963658c'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:54.824017 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-21d21237-6732-488c-bb38-f9d00963658c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f6baa22c9994643b63ecfe6b43988f6', 'request_id': 'req-21d21237-6732-488c-bb38-f9d00963658c'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:54.834823 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-21d21237-6732-488c-bb38-f9d00963658c admin admin] The token cache is being invalidate because project 2f6baa22c9994643b63ecfe6b43988f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79993) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:21:54.835109 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-21d21237-6732-488c-bb38-f9d00963658c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:54.835735 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-21d21237-6732-488c-bb38-f9d00963658c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:54.837298 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 982/1982] 10.222.0.70 () {58 vars in 1232 bytes} [Tue May 10 19:21:54 2022] DELETE /identity/v3/projects/2f6baa22c9994643b63ecfe6b43988f6 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:21:54.842185 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5b23d8-f808-4562-9c8f-93393850286c None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:54.842656 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5b23d8-f808-4562-9c8f-93393850286c None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:54.842774 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5b23d8-f808-4562-9c8f-93393850286c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:54.860273 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-2e5b23d8-f808-4562-9c8f-93393850286c None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:21:54.861496 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-2e5b23d8-f808-4562-9c8f-93393850286c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:21:54.917607 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1001/1983] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:21:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:21:54.925299 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e24d5da-cd83-4c81-add0-d168b9c57065 None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:54.925779 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e24d5da-cd83-4c81-add0-d168b9c57065 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:54.925967 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e24d5da-cd83-4c81-add0-d168b9c57065 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:54.943664 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-6e24d5da-cd83-4c81-add0-d168b9c57065 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:21:54.944913 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-6e24d5da-cd83-4c81-add0-d168b9c57065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:21:54.953610 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 983/1984] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:21:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:21:54.957888 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5b23d8-f808-4562-9c8f-93393850286c None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:54.967847 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5b23d8-f808-4562-9c8f-93393850286c None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:54.972300 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b215f704-a7eb-4fdf-ab31-00a1772deed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:54.972988 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b215f704-a7eb-4fdf-ab31-00a1772deed0 admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:54.973269 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b215f704-a7eb-4fdf-ab31-00a1772deed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:54.973543 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b215f704-a7eb-4fdf-ab31-00a1772deed0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:54.974264 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b215f704-a7eb-4fdf-ab31-00a1772deed0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:21:54.974567 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b215f704-a7eb-4fdf-ab31-00a1772deed0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:54.976154 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b215f704-a7eb-4fdf-ab31-00a1772deed0 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:54.987145 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1002/1985] 10.222.0.70 () {58 vars in 1152 bytes} [Tue May 10 19:21:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:21:54.991360 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e24d5da-cd83-4c81-add0-d168b9c57065 None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:55.000567 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e24d5da-cd83-4c81-add0-d168b9c57065 None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:55.005590 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e84c83-3eb4-42eb-a4ac-0a786c20373a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:55.006237 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e84c83-3eb4-42eb-a4ac-0a786c20373a admin admin] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:55.006523 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e84c83-3eb4-42eb-a4ac-0a786c20373a admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:55.006798 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e84c83-3eb4-42eb-a4ac-0a786c20373a admin admin] PATH_INFO: `/v3/projects` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:55.007492 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e84c83-3eb4-42eb-a4ac-0a786c20373a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:55.009442 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e84c83-3eb4-42eb-a4ac-0a786c20373a admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:55.034542 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 984/1986] 10.222.0.70 () {60 vars in 1152 bytes} [Tue May 10 19:21:54 2022] POST /identity/v3/projects => generated 375 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:21:55.038513 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b215f704-a7eb-4fdf-ab31-00a1772deed0 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:55.048470 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b215f704-a7eb-4fdf-ab31-00a1772deed0 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:55.102704 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68bdb60-85cb-44db-8934-a07ed37ae6af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:55.103388 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68bdb60-85cb-44db-8934-a07ed37ae6af admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:55.103668 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68bdb60-85cb-44db-8934-a07ed37ae6af admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:55.103943 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68bdb60-85cb-44db-8934-a07ed37ae6af admin admin] PATH_INFO: `/v3/users` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:55.104668 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68bdb60-85cb-44db-8934-a07ed37ae6af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:55.106864 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68bdb60-85cb-44db-8934-a07ed37ae6af admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:55.126356 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1003/1987] 10.222.0.70 () {60 vars in 1143 bytes} [Tue May 10 19:21:55 2022] POST /identity/v3/users => generated 288 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:21:55.130500 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e84c83-3eb4-42eb-a4ac-0a786c20373a admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:55.140923 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e84c83-3eb4-42eb-a4ac-0a786c20373a admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:55.145678 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6683715b-dfcb-40e8-a67e-b3acce38e75a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:55.146331 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6683715b-dfcb-40e8-a67e-b3acce38e75a admin admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:55.146617 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6683715b-dfcb-40e8-a67e-b3acce38e75a admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:55.146894 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6683715b-dfcb-40e8-a67e-b3acce38e75a admin admin] PATH_INFO: `/v3/roles` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:55.147611 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6683715b-dfcb-40e8-a67e-b3acce38e75a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:55.149295 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6683715b-dfcb-40e8-a67e-b3acce38e75a admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:55.159911 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 985/1988] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:21:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:21:55.163768 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68bdb60-85cb-44db-8934-a07ed37ae6af admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:55.173410 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68bdb60-85cb-44db-8934-a07ed37ae6af admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:55.177928 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b7d5c9-8268-4982-b5b2-3f0417e8a693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:55.178573 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b7d5c9-8268-4982-b5b2-3f0417e8a693 admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:55.178856 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b7d5c9-8268-4982-b5b2-3f0417e8a693 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:55.179134 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b7d5c9-8268-4982-b5b2-3f0417e8a693 admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:55.179874 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b7d5c9-8268-4982-b5b2-3f0417e8a693 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:55.181988 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b7d5c9-8268-4982-b5b2-3f0417e8a693 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:55.194490 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1004/1989] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:21:55 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:21:55.195711 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6683715b-dfcb-40e8-a67e-b3acce38e75a admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:55.206476 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6683715b-dfcb-40e8-a67e-b3acce38e75a admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:55.211081 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb53f61-b30a-43e2-a860-2b8c329109b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:55.212116 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb53f61-b30a-43e2-a860-2b8c329109b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:55.212227 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb53f61-b30a-43e2-a860-2b8c329109b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:55.212536 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb53f61-b30a-43e2-a860-2b8c329109b4 admin admin] PATH_INFO: `/v3/projects/266993d889f44f4bad8c69cba0f97279/users/f35f25af2fdc4369be2cd93d1cebc7f0/roles/5c07cf5bfbd3427db18428aa50420962` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:55.226499 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb53f61-b30a-43e2-a860-2b8c329109b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=266993d889f44f4bad8c69cba0f97279, user_id=f35f25af2fdc4369be2cd93d1cebc7f0, role_id=5c07cf5bfbd3427db18428aa50420962)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:55.229193 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb53f61-b30a-43e2-a860-2b8c329109b4 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:55.241366 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 986/1990] 10.222.0.70 () {60 vars in 1482 bytes} [Tue May 10 19:21:55 2022] PUT /identity/v3/projects/266993d889f44f4bad8c69cba0f97279/users/f35f25af2fdc4369be2cd93d1cebc7f0/roles/5c07cf5bfbd3427db18428aa50420962 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:21:55.252016 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0d519e-54f9-4d55-a5b4-3588407c4e40 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:55.252306 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0d519e-54f9-4d55-a5b4-3588407c4e40 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:55.252622 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0d519e-54f9-4d55-a5b4-3588407c4e40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:55.278249 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-9c0d519e-54f9-4d55-a5b4-3588407c4e40 None None] MFA Rules not processed for user `f35f25af2fdc4369be2cd93d1cebc7f0`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:21:55.279433 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-9c0d519e-54f9-4d55-a5b4-3588407c4e40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:21:55.339586 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1005/1991] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:21:55 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:21:55.343948 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb53f61-b30a-43e2-a860-2b8c329109b4 admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:55.403338 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb53f61-b30a-43e2-a860-2b8c329109b4 admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:55.408016 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b6a07f-827a-49ed-b95b-cfab18f3b8b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:55.408707 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b6a07f-827a-49ed-b95b-cfab18f3b8b0 admin admin] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:55.408995 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b6a07f-827a-49ed-b95b-cfab18f3b8b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:55.409272 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b6a07f-827a-49ed-b95b-cfab18f3b8b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:55.409953 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b6a07f-827a-49ed-b95b-cfab18f3b8b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:55.411858 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b6a07f-827a-49ed-b95b-cfab18f3b8b0 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:55.436401 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 987/1992] 10.222.0.70 () {60 vars in 1152 bytes} [Tue May 10 19:21:55 2022] POST /identity/v3/projects => generated 377 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:21:55.440437 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0d519e-54f9-4d55-a5b4-3588407c4e40 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:55.451093 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0d519e-54f9-4d55-a5b4-3588407c4e40 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:55.503789 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f920a17-fe29-4c0d-8b09-5061f1a5d945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:55.504475 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f920a17-fe29-4c0d-8b09-5061f1a5d945 admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:55.504763 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f920a17-fe29-4c0d-8b09-5061f1a5d945 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:55.505037 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f920a17-fe29-4c0d-8b09-5061f1a5d945 admin admin] PATH_INFO: `/v3/users` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:55.505732 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f920a17-fe29-4c0d-8b09-5061f1a5d945 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:55.507630 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f920a17-fe29-4c0d-8b09-5061f1a5d945 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:55.526889 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1006/1993] 10.222.0.70 () {60 vars in 1143 bytes} [Tue May 10 19:21:55 2022] POST /identity/v3/users => generated 295 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 19:21:55.530838 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b6a07f-827a-49ed-b95b-cfab18f3b8b0 admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:55.541540 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b6a07f-827a-49ed-b95b-cfab18f3b8b0 admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:55.546109 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4f6a7e-0b67-4f26-b047-22fd8b2b41ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:55.546760 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4f6a7e-0b67-4f26-b047-22fd8b2b41ba admin admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:55.547043 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4f6a7e-0b67-4f26-b047-22fd8b2b41ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:55.547320 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4f6a7e-0b67-4f26-b047-22fd8b2b41ba admin admin] PATH_INFO: `/v3/roles` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:55.548037 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4f6a7e-0b67-4f26-b047-22fd8b2b41ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:55.549673 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4f6a7e-0b67-4f26-b047-22fd8b2b41ba admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:55.559802 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 988/1994] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:21:55 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:21:55.563890 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f920a17-fe29-4c0d-8b09-5061f1a5d945 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:55.574336 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f920a17-fe29-4c0d-8b09-5061f1a5d945 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:55.579257 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f61b95-80ed-4d59-98b7-b248a4da1b2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:55.580203 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f61b95-80ed-4d59-98b7-b248a4da1b2f admin admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:55.580503 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f61b95-80ed-4d59-98b7-b248a4da1b2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:55.580712 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f61b95-80ed-4d59-98b7-b248a4da1b2f admin admin] PATH_INFO: `/v3/projects/fb449e52f9044880a60e3d6f2bf28c8e/users/f1ae8243ba2f47bda36226bb0c8fd9b3/roles/634ba284303b4626b5a0402772c68f5c` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:55.596354 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f61b95-80ed-4d59-98b7-b248a4da1b2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb449e52f9044880a60e3d6f2bf28c8e, user_id=f1ae8243ba2f47bda36226bb0c8fd9b3, role_id=634ba284303b4626b5a0402772c68f5c)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:55.599161 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f61b95-80ed-4d59-98b7-b248a4da1b2f admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:55.617474 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1007/1995] 10.222.0.70 () {60 vars in 1482 bytes} [Tue May 10 19:21:55 2022] PUT /identity/v3/projects/fb449e52f9044880a60e3d6f2bf28c8e/users/f1ae8243ba2f47bda36226bb0c8fd9b3/roles/634ba284303b4626b5a0402772c68f5c => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:21:55.621705 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4f6a7e-0b67-4f26-b047-22fd8b2b41ba admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:55.631800 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4f6a7e-0b67-4f26-b047-22fd8b2b41ba admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:55.691888 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5491f452-f9f1-4593-923b-cd850ac42d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:55.692984 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5491f452-f9f1-4593-923b-cd850ac42d60 admin admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:55.693342 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5491f452-f9f1-4593-923b-cd850ac42d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:55.693624 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5491f452-f9f1-4593-923b-cd850ac42d60 admin admin] PATH_INFO: `/v3/roles` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:55.694353 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5491f452-f9f1-4593-923b-cd850ac42d60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:55.695956 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5491f452-f9f1-4593-923b-cd850ac42d60 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:55.707517 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 989/1996] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:21:55 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:21:55.711603 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f61b95-80ed-4d59-98b7-b248a4da1b2f admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:55.721955 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f61b95-80ed-4d59-98b7-b248a4da1b2f admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:55.726562 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad0545e-49f7-47ba-a3de-773d02ffede1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:55.727449 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad0545e-49f7-47ba-a3de-773d02ffede1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:55.727729 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad0545e-49f7-47ba-a3de-773d02ffede1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:55.728001 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad0545e-49f7-47ba-a3de-773d02ffede1 admin admin] PATH_INFO: `/v3/projects/fb449e52f9044880a60e3d6f2bf28c8e/users/f1ae8243ba2f47bda36226bb0c8fd9b3/roles/634ba284303b4626b5a0402772c68f5c` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:55.732015 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad0545e-49f7-47ba-a3de-773d02ffede1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb449e52f9044880a60e3d6f2bf28c8e, user_id=f1ae8243ba2f47bda36226bb0c8fd9b3, role_id=634ba284303b4626b5a0402772c68f5c)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:55.734569 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad0545e-49f7-47ba-a3de-773d02ffede1 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:55.745037 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1008/1997] 10.222.0.70 () {60 vars in 1482 bytes} [Tue May 10 19:21:55 2022] PUT /identity/v3/projects/fb449e52f9044880a60e3d6f2bf28c8e/users/f1ae8243ba2f47bda36226bb0c8fd9b3/roles/634ba284303b4626b5a0402772c68f5c => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:21:55.755875 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a1a51c-2032-42f5-91b9-9a38574ddc58 None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:55.756165 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a1a51c-2032-42f5-91b9-9a38574ddc58 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:55.756464 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a1a51c-2032-42f5-91b9-9a38574ddc58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:55.782376 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-82a1a51c-2032-42f5-91b9-9a38574ddc58 None None] MFA Rules not processed for user `f1ae8243ba2f47bda36226bb0c8fd9b3`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:21:55.783551 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-82a1a51c-2032-42f5-91b9-9a38574ddc58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:21:55.852770 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 990/1998] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:21:55 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:21:55.863618 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad0545e-49f7-47ba-a3de-773d02ffede1 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:55.865442 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-bad0545e-49f7-47ba-a3de-773d02ffede1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:21:55.921349 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad0545e-49f7-47ba-a3de-773d02ffede1 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:55.924950 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7767d5f5-6ec3-4c17-8650-bc00a9dad09b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15df2a8967aa43299c10e365f4200d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:55.925592 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7767d5f5-6ec3-4c17-8650-bc00a9dad09b service cinder] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:55.925873 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7767d5f5-6ec3-4c17-8650-bc00a9dad09b service cinder] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:55.926146 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7767d5f5-6ec3-4c17-8650-bc00a9dad09b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:55.980839 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7767d5f5-6ec3-4c17-8650-bc00a9dad09b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:55.982273 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7767d5f5-6ec3-4c17-8650-bc00a9dad09b service cinder] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:55.990880 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1009/1999] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:21:55 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:21:57.795571 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a1a51c-2032-42f5-91b9-9a38574ddc58 None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:57.797031 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-82a1a51c-2032-42f5-91b9-9a38574ddc58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:21:57.859057 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a1a51c-2032-42f5-91b9-9a38574ddc58 None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:57.863672 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de963f5d-70f1-44f0-bde7-0ffcd915192f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:57.864581 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de963f5d-70f1-44f0-bde7-0ffcd915192f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:57.864867 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de963f5d-70f1-44f0-bde7-0ffcd915192f admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:57.865142 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de963f5d-70f1-44f0-bde7-0ffcd915192f admin admin] PATH_INFO: `/v3/users/1ea42e622a2e40db8e8b4c93a83f78c5` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:57.866318 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de963f5d-70f1-44f0-bde7-0ffcd915192f admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ea42e622a2e40db8e8b4c93a83f78c5)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:57.868231 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de963f5d-70f1-44f0-bde7-0ffcd915192f admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:57.913267 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-de963f5d-70f1-44f0-bde7-0ffcd915192f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ea42e622a2e40db8e8b4c93a83f78c5'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:57.924563 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-de963f5d-70f1-44f0-bde7-0ffcd915192f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ea42e622a2e40db8e8b4c93a83f78c5'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:57.931397 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-de963f5d-70f1-44f0-bde7-0ffcd915192f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ea42e622a2e40db8e8b4c93a83f78c5'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:57.932081 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-de963f5d-70f1-44f0-bde7-0ffcd915192f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ea42e622a2e40db8e8b4c93a83f78c5'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:57.939691 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-de963f5d-70f1-44f0-bde7-0ffcd915192f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ea42e622a2e40db8e8b4c93a83f78c5'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:57.951095 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 991/2000] 10.222.0.70 () {58 vars in 1223 bytes} [Tue May 10 19:21:57 2022] DELETE /identity/v3/users/1ea42e622a2e40db8e8b4c93a83f78c5 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:21:57.955705 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8d0971-1377-4f6d-ba89-6c4122bb17bf None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:57.956149 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8d0971-1377-4f6d-ba89-6c4122bb17bf None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:57.958327 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8d0971-1377-4f6d-ba89-6c4122bb17bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:57.975455 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-3d8d0971-1377-4f6d-ba89-6c4122bb17bf None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:21:57.976673 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-3d8d0971-1377-4f6d-ba89-6c4122bb17bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:21:58.048972 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1010/2001] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:21:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:21:58.057112 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de963f5d-70f1-44f0-bde7-0ffcd915192f admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:58.058553 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-de963f5d-70f1-44f0-bde7-0ffcd915192f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:21:58.117232 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de963f5d-70f1-44f0-bde7-0ffcd915192f admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:58.121386 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bdba0f-e4f0-4759-981b-b38ff5a8a0f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f1dc79540b48c0866478cc48cd8205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:58.122033 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bdba0f-e4f0-4759-981b-b38ff5a8a0f1 service neutron] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:58.122315 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bdba0f-e4f0-4759-981b-b38ff5a8a0f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:58.122590 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bdba0f-e4f0-4759-981b-b38ff5a8a0f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:58.131872 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bdba0f-e4f0-4759-981b-b38ff5a8a0f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:58.134043 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bdba0f-e4f0-4759-981b-b38ff5a8a0f1 service neutron] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:58.143218 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 992/2002] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:21:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:21:58.428009 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8d0971-1377-4f6d-ba89-6c4122bb17bf None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:58.429516 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-3d8d0971-1377-4f6d-ba89-6c4122bb17bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:21:58.443488 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8d0971-1377-4f6d-ba89-6c4122bb17bf None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:58.448384 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78cdd37-c47d-490f-a7f7-32e324578b5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:58.449286 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78cdd37-c47d-490f-a7f7-32e324578b5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:58.449565 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78cdd37-c47d-490f-a7f7-32e324578b5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:58.450091 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78cdd37-c47d-490f-a7f7-32e324578b5c admin admin] PATH_INFO: `/v3/projects/f2c181352e654eaab3d3b8fd89713620` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:58.451288 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78cdd37-c47d-490f-a7f7-32e324578b5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2c181352e654eaab3d3b8fd89713620)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:58.453642 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78cdd37-c47d-490f-a7f7-32e324578b5c admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:58.501187 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-e78cdd37-c47d-490f-a7f7-32e324578b5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2c181352e654eaab3d3b8fd89713620', 'request_id': 'req-e78cdd37-c47d-490f-a7f7-32e324578b5c'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:58.506372 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-e78cdd37-c47d-490f-a7f7-32e324578b5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2c181352e654eaab3d3b8fd89713620', 'request_id': 'req-e78cdd37-c47d-490f-a7f7-32e324578b5c'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:58.517050 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-e78cdd37-c47d-490f-a7f7-32e324578b5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2c181352e654eaab3d3b8fd89713620', 'request_id': 'req-e78cdd37-c47d-490f-a7f7-32e324578b5c'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:58.528635 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-e78cdd37-c47d-490f-a7f7-32e324578b5c admin admin] The token cache is being invalidate because project f2c181352e654eaab3d3b8fd89713620 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79994) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:21:58.528922 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-e78cdd37-c47d-490f-a7f7-32e324578b5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:58.529551 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-e78cdd37-c47d-490f-a7f7-32e324578b5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:58.531086 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1011/2003] 10.222.0.70 () {58 vars in 1232 bytes} [Tue May 10 19:21:58 2022] DELETE /identity/v3/projects/f2c181352e654eaab3d3b8fd89713620 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 19:21:58.535029 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bdba0f-e4f0-4759-981b-b38ff5a8a0f1 service neutron] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:58.545129 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bdba0f-e4f0-4759-981b-b38ff5a8a0f1 service neutron] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:58.599651 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f33a12-6393-4f22-88b4-86d5d0e2139a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:58.600566 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f33a12-6393-4f22-88b4-86d5d0e2139a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:58.600853 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f33a12-6393-4f22-88b4-86d5d0e2139a admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:58.601132 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f33a12-6393-4f22-88b4-86d5d0e2139a admin admin] PATH_INFO: `/v3/users/a7ee11ddcba545d58da8babe7a574562` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:58.602306 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f33a12-6393-4f22-88b4-86d5d0e2139a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7ee11ddcba545d58da8babe7a574562)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:58.604288 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f33a12-6393-4f22-88b4-86d5d0e2139a admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:58.648397 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-60f33a12-6393-4f22-88b4-86d5d0e2139a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7ee11ddcba545d58da8babe7a574562'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:58.660539 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-60f33a12-6393-4f22-88b4-86d5d0e2139a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7ee11ddcba545d58da8babe7a574562'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:58.667239 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-60f33a12-6393-4f22-88b4-86d5d0e2139a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7ee11ddcba545d58da8babe7a574562'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:58.667910 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-60f33a12-6393-4f22-88b4-86d5d0e2139a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7ee11ddcba545d58da8babe7a574562'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:58.674595 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-60f33a12-6393-4f22-88b4-86d5d0e2139a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7ee11ddcba545d58da8babe7a574562'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:58.680390 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 993/2004] 10.222.0.70 () {58 vars in 1223 bytes} [Tue May 10 19:21:58 2022] DELETE /identity/v3/users/a7ee11ddcba545d58da8babe7a574562 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:21:58.942001 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78cdd37-c47d-490f-a7f7-32e324578b5c admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:58.943470 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-e78cdd37-c47d-490f-a7f7-32e324578b5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:21:58.966450 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78cdd37-c47d-490f-a7f7-32e324578b5c admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:59.021492 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c0b10a-a66a-4a99-be4b-d9cbd90ff254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:59.022346 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c0b10a-a66a-4a99-be4b-d9cbd90ff254 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:59.022625 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c0b10a-a66a-4a99-be4b-d9cbd90ff254 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:59.022900 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c0b10a-a66a-4a99-be4b-d9cbd90ff254 admin admin] PATH_INFO: `/v3/projects/1a05fb8b13ad420eb04b77f51ff21e63` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:59.024049 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c0b10a-a66a-4a99-be4b-d9cbd90ff254 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a05fb8b13ad420eb04b77f51ff21e63)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:59.026532 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c0b10a-a66a-4a99-be4b-d9cbd90ff254 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:59.068725 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-57c0b10a-a66a-4a99-be4b-d9cbd90ff254 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a05fb8b13ad420eb04b77f51ff21e63', 'request_id': 'req-57c0b10a-a66a-4a99-be4b-d9cbd90ff254'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:59.073708 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-57c0b10a-a66a-4a99-be4b-d9cbd90ff254 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a05fb8b13ad420eb04b77f51ff21e63', 'request_id': 'req-57c0b10a-a66a-4a99-be4b-d9cbd90ff254'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:59.080902 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-57c0b10a-a66a-4a99-be4b-d9cbd90ff254 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a05fb8b13ad420eb04b77f51ff21e63', 'request_id': 'req-57c0b10a-a66a-4a99-be4b-d9cbd90ff254'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:59.092025 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-57c0b10a-a66a-4a99-be4b-d9cbd90ff254 admin admin] The token cache is being invalidate because project 1a05fb8b13ad420eb04b77f51ff21e63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79994) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:21:59.092317 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-57c0b10a-a66a-4a99-be4b-d9cbd90ff254 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:59.092964 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-57c0b10a-a66a-4a99-be4b-d9cbd90ff254 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:21:59.094488 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1012/2005] 10.222.0.70 () {58 vars in 1232 bytes} [Tue May 10 19:21:58 2022] DELETE /identity/v3/projects/1a05fb8b13ad420eb04b77f51ff21e63 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:21:59.099553 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a066e8-73cd-4f37-a063-d61d4b6cce2f None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:59.099996 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a066e8-73cd-4f37-a063-d61d4b6cce2f None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:59.100133 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a066e8-73cd-4f37-a063-d61d4b6cce2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:59.117942 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-d2a066e8-73cd-4f37-a063-d61d4b6cce2f None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:21:59.119132 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-d2a066e8-73cd-4f37-a063-d61d4b6cce2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:21:59.177719 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 994/2006] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:21:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:21:59.186342 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6707963-edf6-4894-bf6c-ac00bd955a0f None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:59.186664 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6707963-edf6-4894-bf6c-ac00bd955a0f None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:59.186942 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6707963-edf6-4894-bf6c-ac00bd955a0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:59.204990 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-a6707963-edf6-4894-bf6c-ac00bd955a0f None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:21:59.206238 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-a6707963-edf6-4894-bf6c-ac00bd955a0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:21:59.214939 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1013/2007] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:21:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:21:59.219340 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a066e8-73cd-4f37-a063-d61d4b6cce2f None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:59.228961 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a066e8-73cd-4f37-a063-d61d4b6cce2f None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:59.233569 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49af64c8-ba64-44fe-beeb-1c1f1e0e8357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:59.234264 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49af64c8-ba64-44fe-beeb-1c1f1e0e8357 admin admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:59.234554 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49af64c8-ba64-44fe-beeb-1c1f1e0e8357 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:59.234830 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49af64c8-ba64-44fe-beeb-1c1f1e0e8357 admin admin] PATH_INFO: `/v3/domains` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:59.235548 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49af64c8-ba64-44fe-beeb-1c1f1e0e8357 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:21:59.235850 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49af64c8-ba64-44fe-beeb-1c1f1e0e8357 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:59.237504 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49af64c8-ba64-44fe-beeb-1c1f1e0e8357 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:59.249502 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 995/2008] 10.222.0.70 () {58 vars in 1152 bytes} [Tue May 10 19:21:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:21:59.253854 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6707963-edf6-4894-bf6c-ac00bd955a0f None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:59.262835 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6707963-edf6-4894-bf6c-ac00bd955a0f None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:59.267374 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc5ef01-cde6-4fb0-a7a9-161c0ff29856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:59.268021 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc5ef01-cde6-4fb0-a7a9-161c0ff29856 admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:59.268299 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc5ef01-cde6-4fb0-a7a9-161c0ff29856 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:59.268605 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc5ef01-cde6-4fb0-a7a9-161c0ff29856 admin admin] PATH_INFO: `/v3/projects` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:59.269319 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc5ef01-cde6-4fb0-a7a9-161c0ff29856 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:59.271184 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc5ef01-cde6-4fb0-a7a9-161c0ff29856 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:59.298100 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1014/2009] 10.222.0.70 () {60 vars in 1152 bytes} [Tue May 10 19:21:59 2022] POST /identity/v3/projects => generated 385 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 19:21:59.302373 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49af64c8-ba64-44fe-beeb-1c1f1e0e8357 admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:59.313210 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49af64c8-ba64-44fe-beeb-1c1f1e0e8357 admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:59.368705 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6474662b-8428-47e9-8ed8-78722ca8a783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:59.369386 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6474662b-8428-47e9-8ed8-78722ca8a783 admin admin] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:59.369681 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6474662b-8428-47e9-8ed8-78722ca8a783 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:59.369985 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6474662b-8428-47e9-8ed8-78722ca8a783 admin admin] PATH_INFO: `/v3/users` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:59.370703 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6474662b-8428-47e9-8ed8-78722ca8a783 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:59.372643 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6474662b-8428-47e9-8ed8-78722ca8a783 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:59.392773 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 996/2010] 10.222.0.70 () {60 vars in 1143 bytes} [Tue May 10 19:21:59 2022] POST /identity/v3/users => generated 293 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:21:59.396669 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc5ef01-cde6-4fb0-a7a9-161c0ff29856 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:59.407132 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc5ef01-cde6-4fb0-a7a9-161c0ff29856 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:59.411582 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa76d2d-c32c-4d48-9fe8-1363c9fb56f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:59.412230 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa76d2d-c32c-4d48-9fe8-1363c9fb56f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:59.412542 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa76d2d-c32c-4d48-9fe8-1363c9fb56f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:59.412816 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa76d2d-c32c-4d48-9fe8-1363c9fb56f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:59.413523 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa76d2d-c32c-4d48-9fe8-1363c9fb56f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:59.415426 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa76d2d-c32c-4d48-9fe8-1363c9fb56f9 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:59.425744 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1015/2011] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:21:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:21:59.429556 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6474662b-8428-47e9-8ed8-78722ca8a783 admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:59.439104 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6474662b-8428-47e9-8ed8-78722ca8a783 admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:59.443630 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8e47d5-c415-44c0-af57-d6b508225840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:59.444306 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8e47d5-c415-44c0-af57-d6b508225840 admin admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:59.444638 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8e47d5-c415-44c0-af57-d6b508225840 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:59.444910 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8e47d5-c415-44c0-af57-d6b508225840 admin admin] PATH_INFO: `/v3/roles` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:59.445623 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8e47d5-c415-44c0-af57-d6b508225840 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:59.447732 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8e47d5-c415-44c0-af57-d6b508225840 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:59.458156 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 997/2012] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:21:59 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 19:21:59.461965 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa76d2d-c32c-4d48-9fe8-1363c9fb56f9 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:59.472049 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa76d2d-c32c-4d48-9fe8-1363c9fb56f9 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:59.477880 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc618d27-35ea-4483-aef9-578d091b36f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:59.478779 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc618d27-35ea-4483-aef9-578d091b36f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:59.479063 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc618d27-35ea-4483-aef9-578d091b36f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:59.479335 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc618d27-35ea-4483-aef9-578d091b36f9 admin admin] PATH_INFO: `/v3/projects/ca236cd277854efeb4f3631e1568bb06/users/6b1a8bf4cf974b8bbf161c49a099a8cb/roles/5c07cf5bfbd3427db18428aa50420962` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:59.493804 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc618d27-35ea-4483-aef9-578d091b36f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca236cd277854efeb4f3631e1568bb06, user_id=6b1a8bf4cf974b8bbf161c49a099a8cb, role_id=5c07cf5bfbd3427db18428aa50420962)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:59.496532 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc618d27-35ea-4483-aef9-578d091b36f9 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:59.512059 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1016/2013] 10.222.0.70 () {60 vars in 1482 bytes} [Tue May 10 19:21:59 2022] PUT /identity/v3/projects/ca236cd277854efeb4f3631e1568bb06/users/6b1a8bf4cf974b8bbf161c49a099a8cb/roles/5c07cf5bfbd3427db18428aa50420962 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:21:59.523083 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3929470e-c94e-42e5-bcbe-d009a19373cf None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:59.523377 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3929470e-c94e-42e5-bcbe-d009a19373cf None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:59.523657 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3929470e-c94e-42e5-bcbe-d009a19373cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:59.550703 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-3929470e-c94e-42e5-bcbe-d009a19373cf None None] MFA Rules not processed for user `6b1a8bf4cf974b8bbf161c49a099a8cb`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:21:59.551882 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-3929470e-c94e-42e5-bcbe-d009a19373cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:21:59.611774 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 998/2014] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:21:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:21:59.616281 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc618d27-35ea-4483-aef9-578d091b36f9 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:59.677631 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc618d27-35ea-4483-aef9-578d091b36f9 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:59.682762 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44858b8b-b802-4363-840e-a01297ce3603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:59.683420 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44858b8b-b802-4363-840e-a01297ce3603 admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:59.683706 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44858b8b-b802-4363-840e-a01297ce3603 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:59.683982 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44858b8b-b802-4363-840e-a01297ce3603 admin admin] PATH_INFO: `/v3/projects` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:59.684724 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44858b8b-b802-4363-840e-a01297ce3603 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:59.686623 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44858b8b-b802-4363-840e-a01297ce3603 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:59.711160 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1017/2015] 10.222.0.70 () {60 vars in 1152 bytes} [Tue May 10 19:21:59 2022] POST /identity/v3/projects => generated 385 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:21:59.715900 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3929470e-c94e-42e5-bcbe-d009a19373cf None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:59.726779 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3929470e-c94e-42e5-bcbe-d009a19373cf None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:59.781440 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedad256-2795-44b2-9f1a-c755c510c390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:59.782099 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedad256-2795-44b2-9f1a-c755c510c390 admin admin] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:59.782403 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedad256-2795-44b2-9f1a-c755c510c390 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:59.782677 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedad256-2795-44b2-9f1a-c755c510c390 admin admin] PATH_INFO: `/v3/users` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:59.783390 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedad256-2795-44b2-9f1a-c755c510c390 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:59.785331 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedad256-2795-44b2-9f1a-c755c510c390 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:59.804764 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 999/2016] 10.222.0.70 () {60 vars in 1143 bytes} [Tue May 10 19:21:59 2022] POST /identity/v3/users => generated 293 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 19:21:59.808755 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44858b8b-b802-4363-840e-a01297ce3603 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:59.819269 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44858b8b-b802-4363-840e-a01297ce3603 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:59.824136 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cffe28-d96b-42ec-ab85-95c593f35bbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:59.825107 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cffe28-d96b-42ec-ab85-95c593f35bbf admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:59.825417 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cffe28-d96b-42ec-ab85-95c593f35bbf admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:59.825693 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cffe28-d96b-42ec-ab85-95c593f35bbf admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:59.826414 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cffe28-d96b-42ec-ab85-95c593f35bbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:59.828002 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cffe28-d96b-42ec-ab85-95c593f35bbf admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:59.838918 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1018/2017] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:21:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:21:59.842720 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedad256-2795-44b2-9f1a-c755c510c390 admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:59.852253 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedad256-2795-44b2-9f1a-c755c510c390 admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:59.857440 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d58b5f-8873-47e9-8f69-5917799fc794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:59.858083 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d58b5f-8873-47e9-8f69-5917799fc794 admin admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:59.858361 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d58b5f-8873-47e9-8f69-5917799fc794 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:59.858633 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d58b5f-8873-47e9-8f69-5917799fc794 admin admin] PATH_INFO: `/v3/roles` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:59.859341 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d58b5f-8873-47e9-8f69-5917799fc794 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:59.860961 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d58b5f-8873-47e9-8f69-5917799fc794 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:59.870464 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1000/2018] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:21:59 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 19:21:59.874514 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cffe28-d96b-42ec-ab85-95c593f35bbf admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:21:59.884169 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cffe28-d96b-42ec-ab85-95c593f35bbf admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:21:59.888821 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6177622-9151-4a5b-9762-4af19ab6b3c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:21:59.889697 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6177622-9151-4a5b-9762-4af19ab6b3c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:59.889983 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6177622-9151-4a5b-9762-4af19ab6b3c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:59.890261 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6177622-9151-4a5b-9762-4af19ab6b3c7 admin admin] PATH_INFO: `/v3/projects/7a6e63626c594ca49a3ec6f6177366ff/users/edc1cef4b92b43a689e40e65b232974f/roles/5c07cf5bfbd3427db18428aa50420962` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:59.905058 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6177622-9151-4a5b-9762-4af19ab6b3c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a6e63626c594ca49a3ec6f6177366ff, user_id=edc1cef4b92b43a689e40e65b232974f, role_id=5c07cf5bfbd3427db18428aa50420962)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:21:59.907766 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6177622-9151-4a5b-9762-4af19ab6b3c7 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:21:59.920776 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1019/2019] 10.222.0.70 () {60 vars in 1482 bytes} [Tue May 10 19:21:59 2022] PUT /identity/v3/projects/7a6e63626c594ca49a3ec6f6177366ff/users/edc1cef4b92b43a689e40e65b232974f/roles/5c07cf5bfbd3427db18428aa50420962 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 19:21:59.930852 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef075fc-6ce5-487f-b707-e504ebacc306 None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:21:59.931455 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef075fc-6ce5-487f-b707-e504ebacc306 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:21:59.931756 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef075fc-6ce5-487f-b707-e504ebacc306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:21:59.958852 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-1ef075fc-6ce5-487f-b707-e504ebacc306 None None] MFA Rules not processed for user `edc1cef4b92b43a689e40e65b232974f`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:21:59.960347 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-1ef075fc-6ce5-487f-b707-e504ebacc306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:22:00.024896 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1001/2020] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:21:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:22:00.029356 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6177622-9151-4a5b-9762-4af19ab6b3c7 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:22:00.088369 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6177622-9151-4a5b-9762-4af19ab6b3c7 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:22:00.093022 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d85ebc-2a13-4354-86b8-089401370d9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:22:00.093674 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d85ebc-2a13-4354-86b8-089401370d9d admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:22:00.093959 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d85ebc-2a13-4354-86b8-089401370d9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:22:00.094235 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d85ebc-2a13-4354-86b8-089401370d9d admin admin] PATH_INFO: `/v3/projects` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:22:00.094925 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d85ebc-2a13-4354-86b8-089401370d9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:22:00.096870 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d85ebc-2a13-4354-86b8-089401370d9d admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:22:00.121972 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1020/2021] 10.222.0.70 () {60 vars in 1152 bytes} [Tue May 10 19:22:00 2022] POST /identity/v3/projects => generated 383 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 19:22:00.125982 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef075fc-6ce5-487f-b707-e504ebacc306 None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:22:00.136309 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef075fc-6ce5-487f-b707-e504ebacc306 None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:22:00.188996 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1688cfcf-2cca-4fb9-ac83-8c84c11ef1ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:22:00.189667 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1688cfcf-2cca-4fb9-ac83-8c84c11ef1ec admin admin] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:22:00.189956 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1688cfcf-2cca-4fb9-ac83-8c84c11ef1ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:22:00.190235 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1688cfcf-2cca-4fb9-ac83-8c84c11ef1ec admin admin] PATH_INFO: `/v3/users` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:22:00.190934 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1688cfcf-2cca-4fb9-ac83-8c84c11ef1ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:22:00.192892 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1688cfcf-2cca-4fb9-ac83-8c84c11ef1ec admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:22:00.213997 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1002/2022] 10.222.0.70 () {60 vars in 1143 bytes} [Tue May 10 19:22:00 2022] POST /identity/v3/users => generated 298 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:22:00.218061 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d85ebc-2a13-4354-86b8-089401370d9d admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:22:00.228004 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d85ebc-2a13-4354-86b8-089401370d9d admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:22:00.232636 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1693d2c-12ff-4e8d-a7ba-dd57d492589d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:22:00.233286 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1693d2c-12ff-4e8d-a7ba-dd57d492589d admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:22:00.233567 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1693d2c-12ff-4e8d-a7ba-dd57d492589d admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:22:00.233841 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1693d2c-12ff-4e8d-a7ba-dd57d492589d admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:22:00.234554 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1693d2c-12ff-4e8d-a7ba-dd57d492589d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:22:00.236136 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1693d2c-12ff-4e8d-a7ba-dd57d492589d admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:22:00.246562 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1021/2023] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:22:00 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 19:22:00.250585 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1688cfcf-2cca-4fb9-ac83-8c84c11ef1ec admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:22:00.260553 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1688cfcf-2cca-4fb9-ac83-8c84c11ef1ec admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:22:00.265064 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed1188b-90c1-4621-9a6b-26eb880bee4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:22:00.265927 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed1188b-90c1-4621-9a6b-26eb880bee4f admin admin] REQUEST_METHOD: `PUT` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:22:00.266208 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed1188b-90c1-4621-9a6b-26eb880bee4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:22:00.266481 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed1188b-90c1-4621-9a6b-26eb880bee4f admin admin] PATH_INFO: `/v3/projects/7ab077ace57d4933b9c92be2c0c9d4a2/users/80165fd5e34f4bd2976ad1f61d6c9ad6/roles/634ba284303b4626b5a0402772c68f5c` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:22:00.281191 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed1188b-90c1-4621-9a6b-26eb880bee4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ab077ace57d4933b9c92be2c0c9d4a2, user_id=80165fd5e34f4bd2976ad1f61d6c9ad6, role_id=634ba284303b4626b5a0402772c68f5c)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:22:00.283815 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed1188b-90c1-4621-9a6b-26eb880bee4f admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:22:00.296372 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1003/2024] 10.222.0.70 () {60 vars in 1482 bytes} [Tue May 10 19:22:00 2022] PUT /identity/v3/projects/7ab077ace57d4933b9c92be2c0c9d4a2/users/80165fd5e34f4bd2976ad1f61d6c9ad6/roles/634ba284303b4626b5a0402772c68f5c => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:22:00.300565 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1693d2c-12ff-4e8d-a7ba-dd57d492589d admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:22:00.310605 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1693d2c-12ff-4e8d-a7ba-dd57d492589d admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:22:00.367919 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4a26f2-b9ad-467f-97fe-cf2365a10192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:22:00.368740 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4a26f2-b9ad-467f-97fe-cf2365a10192 admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:22:00.369023 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4a26f2-b9ad-467f-97fe-cf2365a10192 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:22:00.369299 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4a26f2-b9ad-467f-97fe-cf2365a10192 admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:22:00.370151 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4a26f2-b9ad-467f-97fe-cf2365a10192 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:22:00.371742 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4a26f2-b9ad-467f-97fe-cf2365a10192 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:22:00.381723 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1022/2025] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:22:00 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:22:00.386210 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed1188b-90c1-4621-9a6b-26eb880bee4f admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:22:00.396219 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed1188b-90c1-4621-9a6b-26eb880bee4f admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:22:00.401563 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cdd7bf-8ec1-4b9d-8aa5-6eba4df57c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:22:00.402460 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cdd7bf-8ec1-4b9d-8aa5-6eba4df57c5f admin admin] REQUEST_METHOD: `PUT` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:22:00.402746 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cdd7bf-8ec1-4b9d-8aa5-6eba4df57c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:22:00.403020 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cdd7bf-8ec1-4b9d-8aa5-6eba4df57c5f admin admin] PATH_INFO: `/v3/projects/7ab077ace57d4933b9c92be2c0c9d4a2/users/80165fd5e34f4bd2976ad1f61d6c9ad6/roles/634ba284303b4626b5a0402772c68f5c` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:22:00.405099 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cdd7bf-8ec1-4b9d-8aa5-6eba4df57c5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ab077ace57d4933b9c92be2c0c9d4a2, user_id=80165fd5e34f4bd2976ad1f61d6c9ad6, role_id=634ba284303b4626b5a0402772c68f5c)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:22:00.407731 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cdd7bf-8ec1-4b9d-8aa5-6eba4df57c5f admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:22:00.431676 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1004/2026] 10.222.0.70 () {60 vars in 1482 bytes} [Tue May 10 19:22:00 2022] PUT /identity/v3/projects/7ab077ace57d4933b9c92be2c0c9d4a2/users/80165fd5e34f4bd2976ad1f61d6c9ad6/roles/634ba284303b4626b5a0402772c68f5c => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:22:00.442717 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddec9d9-93f6-4f25-b67b-6141771bd4b6 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:22:00.443007 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddec9d9-93f6-4f25-b67b-6141771bd4b6 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:22:00.443335 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddec9d9-93f6-4f25-b67b-6141771bd4b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:22:00.469393 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-8ddec9d9-93f6-4f25-b67b-6141771bd4b6 None None] MFA Rules not processed for user `80165fd5e34f4bd2976ad1f61d6c9ad6`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:22:00.470560 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-8ddec9d9-93f6-4f25-b67b-6141771bd4b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:22:00.536877 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1023/2027] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:22:00 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:22:00.548549 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cdd7bf-8ec1-4b9d-8aa5-6eba4df57c5f admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:22:00.551598 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-48cdd7bf-8ec1-4b9d-8aa5-6eba4df57c5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:22:00.607868 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cdd7bf-8ec1-4b9d-8aa5-6eba4df57c5f admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:22:00.611459 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcad2702-a291-451b-ad48-b4256a87ca4c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15df2a8967aa43299c10e365f4200d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:22:00.612102 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcad2702-a291-451b-ad48-b4256a87ca4c service cinder] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:22:00.612386 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcad2702-a291-451b-ad48-b4256a87ca4c service cinder] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:22:00.612705 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcad2702-a291-451b-ad48-b4256a87ca4c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:22:00.667715 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcad2702-a291-451b-ad48-b4256a87ca4c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:22:00.669110 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcad2702-a291-451b-ad48-b4256a87ca4c service cinder] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:22:00.678222 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1005/2028] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:22:00 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:22:04.693166 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddec9d9-93f6-4f25-b67b-6141771bd4b6 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:22:04.694564 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-8ddec9d9-93f6-4f25-b67b-6141771bd4b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:22:04.706408 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddec9d9-93f6-4f25-b67b-6141771bd4b6 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:22:04.709918 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53080e3f-b15f-45e3-ab9b-64bf7aaddd36 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15df2a8967aa43299c10e365f4200d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:22:04.710583 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53080e3f-b15f-45e3-ab9b-64bf7aaddd36 service cinder] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:22:04.710863 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53080e3f-b15f-45e3-ab9b-64bf7aaddd36 service cinder] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:22:04.711273 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53080e3f-b15f-45e3-ab9b-64bf7aaddd36 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:22:04.713088 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-53080e3f-b15f-45e3-ab9b-64bf7aaddd36 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:22:04.782858 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53080e3f-b15f-45e3-ab9b-64bf7aaddd36 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:22:04.784550 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53080e3f-b15f-45e3-ab9b-64bf7aaddd36 service cinder] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:22:04.794799 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1024/2029] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:22:04 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:22:05.321312 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcad2702-a291-451b-ad48-b4256a87ca4c service cinder] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:22:05.330459 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcad2702-a291-451b-ad48-b4256a87ca4c service cinder] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:22:05.334034 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d5ae75-8395-4859-9953-764f1e10d449 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15df2a8967aa43299c10e365f4200d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:22:05.334653 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d5ae75-8395-4859-9953-764f1e10d449 service cinder] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:22:05.334933 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d5ae75-8395-4859-9953-764f1e10d449 service cinder] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:22:05.335210 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d5ae75-8395-4859-9953-764f1e10d449 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:22:05.390188 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d5ae75-8395-4859-9953-764f1e10d449 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:22:05.391631 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d5ae75-8395-4859-9953-764f1e10d449 service cinder] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:22:05.401061 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1006/2030] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:22:05 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:22:06.658214 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53080e3f-b15f-45e3-ab9b-64bf7aaddd36 service cinder] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:22:06.666599 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53080e3f-b15f-45e3-ab9b-64bf7aaddd36 service cinder] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:22:06.670233 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d5fb5b-27e8-4df6-9f1c-e3cfd10a3805 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15df2a8967aa43299c10e365f4200d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:22:06.670866 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d5fb5b-27e8-4df6-9f1c-e3cfd10a3805 service cinder] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:22:06.671146 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d5fb5b-27e8-4df6-9f1c-e3cfd10a3805 service cinder] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:22:06.671421 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d5fb5b-27e8-4df6-9f1c-e3cfd10a3805 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:22:06.680287 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d5fb5b-27e8-4df6-9f1c-e3cfd10a3805 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:22:06.682257 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d5fb5b-27e8-4df6-9f1c-e3cfd10a3805 service cinder] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:22:06.691788 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1025/2031] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:22:06 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:22:17.889326 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d5ae75-8395-4859-9953-764f1e10d449 service cinder] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:22:17.890396 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-b9d5ae75-8395-4859-9953-764f1e10d449 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:22:17.962115 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d5ae75-8395-4859-9953-764f1e10d449 service cinder] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:22:17.967842 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc64e207-182e-47a4-a135-0138ec5e9831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:22:17.968606 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc64e207-182e-47a4-a135-0138ec5e9831 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:22:17.968921 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc64e207-182e-47a4-a135-0138ec5e9831 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:22:17.969163 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc64e207-182e-47a4-a135-0138ec5e9831 admin admin] PATH_INFO: `/v3/users/6282a9911b8d4b84b717dfd4d693b29b` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:22:17.970618 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc64e207-182e-47a4-a135-0138ec5e9831 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6282a9911b8d4b84b717dfd4d693b29b)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:22:17.973745 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc64e207-182e-47a4-a135-0138ec5e9831 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:22:18.023016 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-dc64e207-182e-47a4-a135-0138ec5e9831 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6282a9911b8d4b84b717dfd4d693b29b'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:22:18.036623 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-dc64e207-182e-47a4-a135-0138ec5e9831 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6282a9911b8d4b84b717dfd4d693b29b'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:22:18.039273 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d5fb5b-27e8-4df6-9f1c-e3cfd10a3805 service cinder] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:22:18.043750 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-dc64e207-182e-47a4-a135-0138ec5e9831 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6282a9911b8d4b84b717dfd4d693b29b'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:22:18.044521 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-dc64e207-182e-47a4-a135-0138ec5e9831 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6282a9911b8d4b84b717dfd4d693b29b'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:22:18.050369 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d5fb5b-27e8-4df6-9f1c-e3cfd10a3805 service cinder] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:22:18.056319 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4011cb4-1f43-4d31-8a27-07c407045c2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:22:18.057350 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4011cb4-1f43-4d31-8a27-07c407045c2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:22:18.057646 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4011cb4-1f43-4d31-8a27-07c407045c2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:22:18.057910 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4011cb4-1f43-4d31-8a27-07c407045c2a admin admin] PATH_INFO: `/v3/users/6b1a8bf4cf974b8bbf161c49a099a8cb` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:22:18.061737 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-dc64e207-182e-47a4-a135-0138ec5e9831 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6282a9911b8d4b84b717dfd4d693b29b'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:22:18.068176 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4011cb4-1f43-4d31-8a27-07c407045c2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b1a8bf4cf974b8bbf161c49a099a8cb)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:22:18.069786 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1007/2032] 10.222.0.70 () {58 vars in 1223 bytes} [Tue May 10 19:22:17 2022] DELETE /identity/v3/users/6282a9911b8d4b84b717dfd4d693b29b => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:22:18.070543 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4011cb4-1f43-4d31-8a27-07c407045c2a admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:22:18.073893 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65256f1-c66e-4bce-a05a-27bb8fbb45fd None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:22:18.074262 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65256f1-c66e-4bce-a05a-27bb8fbb45fd None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:22:18.074846 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65256f1-c66e-4bce-a05a-27bb8fbb45fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:22:18.092824 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-d65256f1-c66e-4bce-a05a-27bb8fbb45fd None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:22:18.094032 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-d65256f1-c66e-4bce-a05a-27bb8fbb45fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:22:18.119477 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-d4011cb4-1f43-4d31-8a27-07c407045c2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b1a8bf4cf974b8bbf161c49a099a8cb'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:22:18.134655 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-d4011cb4-1f43-4d31-8a27-07c407045c2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b1a8bf4cf974b8bbf161c49a099a8cb'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:22:18.135554 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-d4011cb4-1f43-4d31-8a27-07c407045c2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b1a8bf4cf974b8bbf161c49a099a8cb'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:22:18.151755 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-d4011cb4-1f43-4d31-8a27-07c407045c2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b1a8bf4cf974b8bbf161c49a099a8cb'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:22:18.158999 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1008/2033] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:22:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:22:18.159293 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-d4011cb4-1f43-4d31-8a27-07c407045c2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b1a8bf4cf974b8bbf161c49a099a8cb'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:22:18.170541 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65256f1-c66e-4bce-a05a-27bb8fbb45fd None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:22:18.172520 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1026/2034] 10.222.0.70 () {58 vars in 1223 bytes} [Tue May 10 19:22:18 2022] DELETE /identity/v3/users/6b1a8bf4cf974b8bbf161c49a099a8cb => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:22:18.172668 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-d65256f1-c66e-4bce-a05a-27bb8fbb45fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:22:18.175721 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105335d2-546e-4be0-8eb5-1f9a30d838fe None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:22:18.176193 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105335d2-546e-4be0-8eb5-1f9a30d838fe None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:22:18.176661 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105335d2-546e-4be0-8eb5-1f9a30d838fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:22:18.195697 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-105335d2-546e-4be0-8eb5-1f9a30d838fe None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:22:18.196943 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-105335d2-546e-4be0-8eb5-1f9a30d838fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:22:18.231318 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65256f1-c66e-4bce-a05a-27bb8fbb45fd None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:22:18.258589 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1027/2035] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:22:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:22:18.269703 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105335d2-546e-4be0-8eb5-1f9a30d838fe None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:22:18.271425 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-105335d2-546e-4be0-8eb5-1f9a30d838fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:22:18.293832 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3a152a-b98f-4958-8f46-42eeb8643b3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f1dc79540b48c0866478cc48cd8205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:22:18.294526 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3a152a-b98f-4958-8f46-42eeb8643b3e service neutron] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:22:18.294821 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3a152a-b98f-4958-8f46-42eeb8643b3e service neutron] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:22:18.295053 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3a152a-b98f-4958-8f46-42eeb8643b3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:22:18.296965 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-cf3a152a-b98f-4958-8f46-42eeb8643b3e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:22:18.311384 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3a152a-b98f-4958-8f46-42eeb8643b3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:22:18.312948 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3a152a-b98f-4958-8f46-42eeb8643b3e service neutron] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:22:18.323098 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1009/2036] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:22:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:22:18.343633 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105335d2-546e-4be0-8eb5-1f9a30d838fe None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:22:18.347838 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e4e6a3-cba6-4460-8854-5d3d666ebf97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f1dc79540b48c0866478cc48cd8205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:22:18.348551 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e4e6a3-cba6-4460-8854-5d3d666ebf97 service neutron] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:22:18.348835 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e4e6a3-cba6-4460-8854-5d3d666ebf97 service neutron] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:22:18.349138 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e4e6a3-cba6-4460-8854-5d3d666ebf97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:22:18.358713 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e4e6a3-cba6-4460-8854-5d3d666ebf97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:22:18.360146 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e4e6a3-cba6-4460-8854-5d3d666ebf97 service neutron] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:22:18.370457 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1028/2037] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:22:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 19:22:18.667292 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3a152a-b98f-4958-8f46-42eeb8643b3e service neutron] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:22:18.668898 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-cf3a152a-b98f-4958-8f46-42eeb8643b3e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:22:18.694099 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3a152a-b98f-4958-8f46-42eeb8643b3e service neutron] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:22:18.705343 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91f9214-2514-437e-a063-d7c0a8ea94b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:22:18.707814 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91f9214-2514-437e-a063-d7c0a8ea94b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:22:18.708169 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91f9214-2514-437e-a063-d7c0a8ea94b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:22:18.708534 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91f9214-2514-437e-a063-d7c0a8ea94b7 admin admin] PATH_INFO: `/v3/projects/42262f61351e4942a9f814d9def32fa4` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:22:18.709941 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91f9214-2514-437e-a063-d7c0a8ea94b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=42262f61351e4942a9f814d9def32fa4)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:22:18.712686 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91f9214-2514-437e-a063-d7c0a8ea94b7 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:22:18.751869 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e4e6a3-cba6-4460-8854-5d3d666ebf97 service neutron] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:22:18.753292 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-07e4e6a3-cba6-4460-8854-5d3d666ebf97 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:22:18.775102 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e4e6a3-cba6-4460-8854-5d3d666ebf97 service neutron] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:22:18.781189 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-a91f9214-2514-437e-a063-d7c0a8ea94b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42262f61351e4942a9f814d9def32fa4', 'request_id': 'req-a91f9214-2514-437e-a063-d7c0a8ea94b7'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:22:18.787141 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-a91f9214-2514-437e-a063-d7c0a8ea94b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42262f61351e4942a9f814d9def32fa4', 'request_id': 'req-a91f9214-2514-437e-a063-d7c0a8ea94b7'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:22:18.795578 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-a91f9214-2514-437e-a063-d7c0a8ea94b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42262f61351e4942a9f814d9def32fa4', 'request_id': 'req-a91f9214-2514-437e-a063-d7c0a8ea94b7'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:22:18.807665 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-a91f9214-2514-437e-a063-d7c0a8ea94b7 admin admin] The token cache is being invalidate because project 42262f61351e4942a9f814d9def32fa4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79993) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:22:18.807965 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-a91f9214-2514-437e-a063-d7c0a8ea94b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:22:18.808638 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-a91f9214-2514-437e-a063-d7c0a8ea94b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:22:18.810382 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1010/2038] 10.222.0.70 () {58 vars in 1232 bytes} [Tue May 10 19:22:18 2022] DELETE /identity/v3/projects/42262f61351e4942a9f814d9def32fa4 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:22:18.815038 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2193e9-c21d-4ca8-a2b2-f1ac4cd28a1c None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:22:18.815397 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2193e9-c21d-4ca8-a2b2-f1ac4cd28a1c None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:22:18.815746 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2193e9-c21d-4ca8-a2b2-f1ac4cd28a1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:22:18.838998 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-ae2193e9-c21d-4ca8-a2b2-f1ac4cd28a1c None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:22:18.840234 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-ae2193e9-c21d-4ca8-a2b2-f1ac4cd28a1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:22:18.848119 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a6e6ca-f1d1-498a-9faf-52885b06b4c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:22:18.849020 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a6e6ca-f1d1-498a-9faf-52885b06b4c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:22:18.849299 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a6e6ca-f1d1-498a-9faf-52885b06b4c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:22:18.849567 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a6e6ca-f1d1-498a-9faf-52885b06b4c6 admin admin] PATH_INFO: `/v3/projects/ca236cd277854efeb4f3631e1568bb06` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:22:18.850835 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a6e6ca-f1d1-498a-9faf-52885b06b4c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca236cd277854efeb4f3631e1568bb06)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:22:18.853440 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a6e6ca-f1d1-498a-9faf-52885b06b4c6 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:22:18.896990 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-27a6e6ca-f1d1-498a-9faf-52885b06b4c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca236cd277854efeb4f3631e1568bb06', 'request_id': 'req-27a6e6ca-f1d1-498a-9faf-52885b06b4c6'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:22:18.900162 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1011/2039] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:22:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:22:18.902892 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-27a6e6ca-f1d1-498a-9faf-52885b06b4c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca236cd277854efeb4f3631e1568bb06', 'request_id': 'req-27a6e6ca-f1d1-498a-9faf-52885b06b4c6'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:22:18.907834 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85425d3e-e99f-4b7b-b38e-0b1d91b990c8 None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:22:18.908119 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85425d3e-e99f-4b7b-b38e-0b1d91b990c8 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:22:18.908462 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85425d3e-e99f-4b7b-b38e-0b1d91b990c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:22:18.910651 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-27a6e6ca-f1d1-498a-9faf-52885b06b4c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca236cd277854efeb4f3631e1568bb06', 'request_id': 'req-27a6e6ca-f1d1-498a-9faf-52885b06b4c6'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:22:18.921785 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-27a6e6ca-f1d1-498a-9faf-52885b06b4c6 admin admin] The token cache is being invalidate because project ca236cd277854efeb4f3631e1568bb06 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79994) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:22:18.922072 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-27a6e6ca-f1d1-498a-9faf-52885b06b4c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:22:18.922697 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-27a6e6ca-f1d1-498a-9faf-52885b06b4c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:22:18.924229 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1029/2040] 10.222.0.70 () {58 vars in 1232 bytes} [Tue May 10 19:22:18 2022] DELETE /identity/v3/projects/ca236cd277854efeb4f3631e1568bb06 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 19:22:18.925818 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-85425d3e-e99f-4b7b-b38e-0b1d91b990c8 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:22:18.927327 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-85425d3e-e99f-4b7b-b38e-0b1d91b990c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:22:18.927902 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a6e6ca-f1d1-498a-9faf-52885b06b4c6 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:22:18.929167 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-27a6e6ca-f1d1-498a-9faf-52885b06b4c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:22:18.988144 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1012/2041] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:22:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:22:18.992192 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85425d3e-e99f-4b7b-b38e-0b1d91b990c8 None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:22:19.001351 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85425d3e-e99f-4b7b-b38e-0b1d91b990c8 None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:22:19.001528 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a6e6ca-f1d1-498a-9faf-52885b06b4c6 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:22:19.005897 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c35a903-37cf-4112-8a2c-745ba8a0ded5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:22:19.006130 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a63c8c8-f355-48c7-a621-9f35b6f74d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:22:19.006544 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c35a903-37cf-4112-8a2c-745ba8a0ded5 admin admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:22:19.006828 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c35a903-37cf-4112-8a2c-745ba8a0ded5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:22:19.006995 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a63c8c8-f355-48c7-a621-9f35b6f74d38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:22:19.007101 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c35a903-37cf-4112-8a2c-745ba8a0ded5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:22:19.007279 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a63c8c8-f355-48c7-a621-9f35b6f74d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:22:19.007549 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a63c8c8-f355-48c7-a621-9f35b6f74d38 admin admin] PATH_INFO: `/v3/users/edc1cef4b92b43a689e40e65b232974f` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:22:19.007848 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c35a903-37cf-4112-8a2c-745ba8a0ded5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:22:19.008155 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c35a903-37cf-4112-8a2c-745ba8a0ded5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:22:19.009300 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a63c8c8-f355-48c7-a621-9f35b6f74d38 admin admin] RBAC: Authorizing `identity:delete_user(user_id=edc1cef4b92b43a689e40e65b232974f)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:22:19.010333 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c35a903-37cf-4112-8a2c-745ba8a0ded5 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:22:19.011184 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a63c8c8-f355-48c7-a621-9f35b6f74d38 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:22:19.022028 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1013/2042] 10.222.0.70 () {58 vars in 1152 bytes} [Tue May 10 19:22:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:22:19.026288 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c35a903-37cf-4112-8a2c-745ba8a0ded5 admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:22:19.036020 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c35a903-37cf-4112-8a2c-745ba8a0ded5 admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:22:19.041679 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3ef438-4bf2-4f75-a672-bbd00c229d4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:22:19.042471 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3ef438-4bf2-4f75-a672-bbd00c229d4c admin admin] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:22:19.042846 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3ef438-4bf2-4f75-a672-bbd00c229d4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:22:19.043142 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3ef438-4bf2-4f75-a672-bbd00c229d4c admin admin] PATH_INFO: `/v3/projects` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:22:19.043826 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3ef438-4bf2-4f75-a672-bbd00c229d4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:22:19.046005 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3ef438-4bf2-4f75-a672-bbd00c229d4c admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:22:19.057777 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-4a63c8c8-f355-48c7-a621-9f35b6f74d38 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'edc1cef4b92b43a689e40e65b232974f'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:22:19.070525 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-4a63c8c8-f355-48c7-a621-9f35b6f74d38 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'edc1cef4b92b43a689e40e65b232974f'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:22:19.071778 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-4a63c8c8-f355-48c7-a621-9f35b6f74d38 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'edc1cef4b92b43a689e40e65b232974f'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:22:19.072314 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1014/2043] 10.222.0.70 () {60 vars in 1152 bytes} [Tue May 10 19:22:19 2022] POST /identity/v3/projects => generated 381 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 19:22:19.076902 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3ef438-4bf2-4f75-a672-bbd00c229d4c admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:22:19.080877 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-4a63c8c8-f355-48c7-a621-9f35b6f74d38 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'edc1cef4b92b43a689e40e65b232974f'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:22:19.088955 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-4a63c8c8-f355-48c7-a621-9f35b6f74d38 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'edc1cef4b92b43a689e40e65b232974f'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:22:19.094994 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1030/2044] 10.222.0.70 () {58 vars in 1223 bytes} [Tue May 10 19:22:18 2022] DELETE /identity/v3/users/edc1cef4b92b43a689e40e65b232974f => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 19:22:19.150325 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3ef438-4bf2-4f75-a672-bbd00c229d4c admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:22:19.214631 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb52f82-e15a-4cb1-b796-be0115053a23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:22:19.215238 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb52f82-e15a-4cb1-b796-be0115053a23 admin admin] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:22:19.216145 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb52f82-e15a-4cb1-b796-be0115053a23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:22:19.216145 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb52f82-e15a-4cb1-b796-be0115053a23 admin admin] PATH_INFO: `/v3/users` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:22:19.216588 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb52f82-e15a-4cb1-b796-be0115053a23 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:22:19.218489 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb52f82-e15a-4cb1-b796-be0115053a23 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:22:19.240640 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1015/2045] 10.222.0.70 () {60 vars in 1143 bytes} [Tue May 10 19:22:19 2022] POST /identity/v3/users => generated 291 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 19:22:19.245730 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a63c8c8-f355-48c7-a621-9f35b6f74d38 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:22:19.247156 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-4a63c8c8-f355-48c7-a621-9f35b6f74d38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:22:19.260239 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a63c8c8-f355-48c7-a621-9f35b6f74d38 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:22:19.264966 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c654ff17-cfc9-4485-87ab-a602ef6e46e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:22:19.265647 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c654ff17-cfc9-4485-87ab-a602ef6e46e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:22:19.265930 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c654ff17-cfc9-4485-87ab-a602ef6e46e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:22:19.266206 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c654ff17-cfc9-4485-87ab-a602ef6e46e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:22:19.266925 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c654ff17-cfc9-4485-87ab-a602ef6e46e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:22:19.268629 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c654ff17-cfc9-4485-87ab-a602ef6e46e3 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:22:19.279484 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1031/2046] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:22:19 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:22:19.283457 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb52f82-e15a-4cb1-b796-be0115053a23 admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:22:19.295193 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb52f82-e15a-4cb1-b796-be0115053a23 admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:22:19.300139 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4c907d-0e9f-47f6-9662-cebba177026a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:22:19.300835 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4c907d-0e9f-47f6-9662-cebba177026a admin admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:22:19.301123 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4c907d-0e9f-47f6-9662-cebba177026a admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:22:19.301397 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4c907d-0e9f-47f6-9662-cebba177026a admin admin] PATH_INFO: `/v3/roles` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:22:19.302115 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4c907d-0e9f-47f6-9662-cebba177026a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:22:19.303706 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4c907d-0e9f-47f6-9662-cebba177026a admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:22:19.313965 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1016/2047] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:22:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:22:19.318272 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c654ff17-cfc9-4485-87ab-a602ef6e46e3 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:22:19.330608 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c654ff17-cfc9-4485-87ab-a602ef6e46e3 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:22:19.336195 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db03f75-abf9-4f43-9a49-e6e886af1893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:22:19.337763 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db03f75-abf9-4f43-9a49-e6e886af1893 admin admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:22:19.337968 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db03f75-abf9-4f43-9a49-e6e886af1893 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:22:19.338244 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db03f75-abf9-4f43-9a49-e6e886af1893 admin admin] PATH_INFO: `/v3/projects/5f9cf73cfc1043eb95dd842193435253/users/221e215caae34d08a9b8f36c711b4318/roles/5c07cf5bfbd3427db18428aa50420962` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:22:19.354408 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db03f75-abf9-4f43-9a49-e6e886af1893 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f9cf73cfc1043eb95dd842193435253, user_id=221e215caae34d08a9b8f36c711b4318, role_id=5c07cf5bfbd3427db18428aa50420962)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:22:19.357140 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db03f75-abf9-4f43-9a49-e6e886af1893 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:22:19.370702 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1032/2048] 10.222.0.70 () {60 vars in 1482 bytes} [Tue May 10 19:22:19 2022] PUT /identity/v3/projects/5f9cf73cfc1043eb95dd842193435253/users/221e215caae34d08a9b8f36c711b4318/roles/5c07cf5bfbd3427db18428aa50420962 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:22:19.376308 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a1bf4a-9143-4d1a-84a7-cb8ab25a4772 None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:22:19.376846 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a1bf4a-9143-4d1a-84a7-cb8ab25a4772 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:22:19.377130 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a1bf4a-9143-4d1a-84a7-cb8ab25a4772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:22:19.378536 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db03f75-abf9-4f43-9a49-e6e886af1893 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:22:19.380341 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-6db03f75-abf9-4f43-9a49-e6e886af1893 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:22:19.403226 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-47a1bf4a-9143-4d1a-84a7-cb8ab25a4772 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:22:19.404365 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-47a1bf4a-9143-4d1a-84a7-cb8ab25a4772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:22:19.447089 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db03f75-abf9-4f43-9a49-e6e886af1893 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:22:19.452264 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b0f7c5-8cc4-4556-8b5a-37613b4f5632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:22:19.453152 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b0f7c5-8cc4-4556-8b5a-37613b4f5632 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:22:19.453436 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b0f7c5-8cc4-4556-8b5a-37613b4f5632 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:22:19.453823 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b0f7c5-8cc4-4556-8b5a-37613b4f5632 admin admin] PATH_INFO: `/v3/projects/7a6e63626c594ca49a3ec6f6177366ff` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:22:19.455014 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b0f7c5-8cc4-4556-8b5a-37613b4f5632 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a6e63626c594ca49a3ec6f6177366ff)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:22:19.456945 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b0f7c5-8cc4-4556-8b5a-37613b4f5632 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:22:19.462012 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1017/2049] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:22:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:22:19.471468 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a1bf4a-9143-4d1a-84a7-cb8ab25a4772 None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:22:19.472856 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-47a1bf4a-9143-4d1a-84a7-cb8ab25a4772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:22:19.508544 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-d5b0f7c5-8cc4-4556-8b5a-37613b4f5632 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a6e63626c594ca49a3ec6f6177366ff', 'request_id': 'req-d5b0f7c5-8cc4-4556-8b5a-37613b4f5632'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:22:19.514080 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-d5b0f7c5-8cc4-4556-8b5a-37613b4f5632 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a6e63626c594ca49a3ec6f6177366ff', 'request_id': 'req-d5b0f7c5-8cc4-4556-8b5a-37613b4f5632'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:22:19.520918 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-d5b0f7c5-8cc4-4556-8b5a-37613b4f5632 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a6e63626c594ca49a3ec6f6177366ff', 'request_id': 'req-d5b0f7c5-8cc4-4556-8b5a-37613b4f5632'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:22:19.528973 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a1bf4a-9143-4d1a-84a7-cb8ab25a4772 None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:22:19.532688 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-d5b0f7c5-8cc4-4556-8b5a-37613b4f5632 admin admin] The token cache is being invalidate because project 7a6e63626c594ca49a3ec6f6177366ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79994) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:22:19.532977 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-d5b0f7c5-8cc4-4556-8b5a-37613b4f5632 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:22:19.533671 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-d5b0f7c5-8cc4-4556-8b5a-37613b4f5632 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:22:19.535260 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1033/2050] 10.222.0.70 () {58 vars in 1232 bytes} [Tue May 10 19:22:19 2022] DELETE /identity/v3/projects/7a6e63626c594ca49a3ec6f6177366ff => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 19:22:19.539344 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b0f7c5-8cc4-4556-8b5a-37613b4f5632 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:22:19.540780 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-d5b0f7c5-8cc4-4556-8b5a-37613b4f5632 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:22:19.578752 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5cd5a5-0268-4a71-8b4a-e6f2f9ecadaa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f1dc79540b48c0866478cc48cd8205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:22:19.579398 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5cd5a5-0268-4a71-8b4a-e6f2f9ecadaa service neutron] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:22:19.579679 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5cd5a5-0268-4a71-8b4a-e6f2f9ecadaa service neutron] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:22:19.579951 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5cd5a5-0268-4a71-8b4a-e6f2f9ecadaa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:22:19.581789 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-ed5cd5a5-0268-4a71-8b4a-e6f2f9ecadaa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:22:19.600881 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b0f7c5-8cc4-4556-8b5a-37613b4f5632 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:22:19.606096 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e5b83b-d626-4f19-ab29-8e0daa0bb11f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:22:19.606963 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e5b83b-d626-4f19-ab29-8e0daa0bb11f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:22:19.607249 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e5b83b-d626-4f19-ab29-8e0daa0bb11f admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:22:19.607521 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e5b83b-d626-4f19-ab29-8e0daa0bb11f admin admin] PATH_INFO: `/v3/users/80165fd5e34f4bd2976ad1f61d6c9ad6` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:22:19.608740 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e5b83b-d626-4f19-ab29-8e0daa0bb11f admin admin] RBAC: Authorizing `identity:delete_user(user_id=80165fd5e34f4bd2976ad1f61d6c9ad6)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:22:19.610649 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e5b83b-d626-4f19-ab29-8e0daa0bb11f admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:22:19.643765 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5cd5a5-0268-4a71-8b4a-e6f2f9ecadaa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:22:19.645253 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5cd5a5-0268-4a71-8b4a-e6f2f9ecadaa service neutron] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:22:19.656354 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-b3e5b83b-d626-4f19-ab29-8e0daa0bb11f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80165fd5e34f4bd2976ad1f61d6c9ad6'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:22:19.657560 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1018/2051] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:22:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 19:22:19.668179 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-b3e5b83b-d626-4f19-ab29-8e0daa0bb11f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80165fd5e34f4bd2976ad1f61d6c9ad6'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:22:19.668928 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-b3e5b83b-d626-4f19-ab29-8e0daa0bb11f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80165fd5e34f4bd2976ad1f61d6c9ad6'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:22:19.676249 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-b3e5b83b-d626-4f19-ab29-8e0daa0bb11f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80165fd5e34f4bd2976ad1f61d6c9ad6'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:22:19.683298 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-b3e5b83b-d626-4f19-ab29-8e0daa0bb11f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80165fd5e34f4bd2976ad1f61d6c9ad6'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:22:19.689614 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1034/2052] 10.222.0.70 () {58 vars in 1223 bytes} [Tue May 10 19:22:19 2022] DELETE /identity/v3/users/80165fd5e34f4bd2976ad1f61d6c9ad6 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 19:22:19.965973 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5cd5a5-0268-4a71-8b4a-e6f2f9ecadaa service neutron] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:22:19.991402 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5cd5a5-0268-4a71-8b4a-e6f2f9ecadaa service neutron] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:22:20.060895 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfe628d-cd2a-460b-860a-aa19f457adc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:22:20.062214 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfe628d-cd2a-460b-860a-aa19f457adc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:22:20.062426 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfe628d-cd2a-460b-860a-aa19f457adc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:22:20.062701 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfe628d-cd2a-460b-860a-aa19f457adc3 admin admin] PATH_INFO: `/v3/projects/7ab077ace57d4933b9c92be2c0c9d4a2` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:22:20.063984 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfe628d-cd2a-460b-860a-aa19f457adc3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ab077ace57d4933b9c92be2c0c9d4a2)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:22:20.065937 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfe628d-cd2a-460b-860a-aa19f457adc3 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:22:20.113701 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-3bfe628d-cd2a-460b-860a-aa19f457adc3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ab077ace57d4933b9c92be2c0c9d4a2', 'request_id': 'req-3bfe628d-cd2a-460b-860a-aa19f457adc3'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:22:20.118913 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-3bfe628d-cd2a-460b-860a-aa19f457adc3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ab077ace57d4933b9c92be2c0c9d4a2', 'request_id': 'req-3bfe628d-cd2a-460b-860a-aa19f457adc3'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:22:20.126490 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-3bfe628d-cd2a-460b-860a-aa19f457adc3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ab077ace57d4933b9c92be2c0c9d4a2', 'request_id': 'req-3bfe628d-cd2a-460b-860a-aa19f457adc3'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:22:20.137967 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-3bfe628d-cd2a-460b-860a-aa19f457adc3 admin admin] The token cache is being invalidate because project 7ab077ace57d4933b9c92be2c0c9d4a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79993) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:22:20.138258 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-3bfe628d-cd2a-460b-860a-aa19f457adc3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:22:20.138926 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-3bfe628d-cd2a-460b-860a-aa19f457adc3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:22:20.140493 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1019/2053] 10.222.0.70 () {58 vars in 1232 bytes} [Tue May 10 19:22:19 2022] DELETE /identity/v3/projects/7ab077ace57d4933b9c92be2c0c9d4a2 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:22:20.145471 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e787cec-253a-4867-b6b5-443d4ec59e02 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:22:20.145941 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e787cec-253a-4867-b6b5-443d4ec59e02 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:22:20.146068 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e787cec-253a-4867-b6b5-443d4ec59e02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:22:20.164718 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-8e787cec-253a-4867-b6b5-443d4ec59e02 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:22:20.166039 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-8e787cec-253a-4867-b6b5-443d4ec59e02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:22:20.230486 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1035/2054] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:22:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:22:20.238204 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5c0fb0-9500-4904-bfc3-91781af65db8 None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:22:20.238502 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5c0fb0-9500-4904-bfc3-91781af65db8 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:22:20.238783 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5c0fb0-9500-4904-bfc3-91781af65db8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:22:20.260007 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-2c5c0fb0-9500-4904-bfc3-91781af65db8 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:22:20.262370 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-2c5c0fb0-9500-4904-bfc3-91781af65db8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:22:20.277390 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1020/2055] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:22:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:22:20.278769 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e787cec-253a-4867-b6b5-443d4ec59e02 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:22:20.292778 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e787cec-253a-4867-b6b5-443d4ec59e02 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:22:20.299098 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec563fc-59d5-492b-b0fd-f3ab240d652a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:22:20.299882 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec563fc-59d5-492b-b0fd-f3ab240d652a admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:22:20.300330 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec563fc-59d5-492b-b0fd-f3ab240d652a admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:22:20.300706 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec563fc-59d5-492b-b0fd-f3ab240d652a admin admin] PATH_INFO: `/v3/domains` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:22:20.301512 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec563fc-59d5-492b-b0fd-f3ab240d652a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:22:20.301925 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec563fc-59d5-492b-b0fd-f3ab240d652a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:22:20.303643 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec563fc-59d5-492b-b0fd-f3ab240d652a admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:22:20.317128 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6e7a0f-cadd-4242-823f-50f14493b148 None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:22:20.317464 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6e7a0f-cadd-4242-823f-50f14493b148 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:22:20.317752 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6e7a0f-cadd-4242-823f-50f14493b148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:22:20.329245 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1036/2056] 10.222.0.70 () {58 vars in 1152 bytes} [Tue May 10 19:22:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:22:20.333267 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec563fc-59d5-492b-b0fd-f3ab240d652a admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:22:20.346544 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec563fc-59d5-492b-b0fd-f3ab240d652a admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:22:20.352653 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-9a6e7a0f-cadd-4242-823f-50f14493b148 None None] MFA Rules not processed for user `221e215caae34d08a9b8f36c711b4318`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:22:20.354372 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-9a6e7a0f-cadd-4242-823f-50f14493b148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:22:20.376034 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b44f368-7ed6-4768-bc9a-2cbaf298e518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:22:20.376925 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b44f368-7ed6-4768-bc9a-2cbaf298e518 admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:22:20.377386 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b44f368-7ed6-4768-bc9a-2cbaf298e518 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:22:20.378234 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b44f368-7ed6-4768-bc9a-2cbaf298e518 admin admin] PATH_INFO: `/v3/projects` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:22:20.379104 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b44f368-7ed6-4768-bc9a-2cbaf298e518 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:22:20.387174 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b44f368-7ed6-4768-bc9a-2cbaf298e518 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:22:20.422643 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1037/2057] 10.222.0.70 () {60 vars in 1152 bytes} [Tue May 10 19:22:20 2022] POST /identity/v3/projects => generated 373 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 19:22:20.426396 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b44f368-7ed6-4768-bc9a-2cbaf298e518 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:22:20.452647 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1021/2058] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:22:20 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:22:20.461686 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6e7a0f-cadd-4242-823f-50f14493b148 None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:22:20.463412 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-9a6e7a0f-cadd-4242-823f-50f14493b148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:22:20.498519 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b44f368-7ed6-4768-bc9a-2cbaf298e518 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:22:20.503308 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4695238e-a28f-405b-8768-590143502d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:22:20.504076 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4695238e-a28f-405b-8768-590143502d96 admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:22:20.504377 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4695238e-a28f-405b-8768-590143502d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:22:20.504672 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4695238e-a28f-405b-8768-590143502d96 admin admin] PATH_INFO: `/v3/users` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:22:20.505377 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4695238e-a28f-405b-8768-590143502d96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:22:20.507612 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4695238e-a28f-405b-8768-590143502d96 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:22:20.522517 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6e7a0f-cadd-4242-823f-50f14493b148 None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:22:20.532013 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1038/2059] 10.222.0.70 () {60 vars in 1143 bytes} [Tue May 10 19:22:20 2022] POST /identity/v3/users => generated 287 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 19:22:20.533085 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4695238e-a28f-405b-8768-590143502d96 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:22:20.543095 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4695238e-a28f-405b-8768-590143502d96 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:22:20.547747 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0c95a8-04aa-4cc8-965a-566c69302674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:22:20.548391 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0c95a8-04aa-4cc8-965a-566c69302674 admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:22:20.548743 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0c95a8-04aa-4cc8-965a-566c69302674 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:22:20.549018 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0c95a8-04aa-4cc8-965a-566c69302674 admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:22:20.549734 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0c95a8-04aa-4cc8-965a-566c69302674 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:22:20.551314 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0c95a8-04aa-4cc8-965a-566c69302674 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:22:20.564931 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1039/2060] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:22:20 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 19:22:20.566033 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0c95a8-04aa-4cc8-965a-566c69302674 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:22:20.572530 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc256e50-cdb2-411d-8801-e1816b466d29 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15df2a8967aa43299c10e365f4200d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:22:20.573181 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc256e50-cdb2-411d-8801-e1816b466d29 service cinder] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:22:20.573465 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc256e50-cdb2-411d-8801-e1816b466d29 service cinder] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:22:20.573745 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc256e50-cdb2-411d-8801-e1816b466d29 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:22:20.575868 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0c95a8-04aa-4cc8-965a-566c69302674 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:22:20.580390 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dbfed9-8717-409d-920e-64276b210214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:22:20.581055 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dbfed9-8717-409d-920e-64276b210214 admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:22:20.581360 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dbfed9-8717-409d-920e-64276b210214 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:22:20.581631 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dbfed9-8717-409d-920e-64276b210214 admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:22:20.582337 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dbfed9-8717-409d-920e-64276b210214 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:22:20.583902 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dbfed9-8717-409d-920e-64276b210214 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:22:20.594133 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1040/2061] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:22:20 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 19:22:20.598309 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dbfed9-8717-409d-920e-64276b210214 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:22:20.608689 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dbfed9-8717-409d-920e-64276b210214 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:22:20.613262 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69007904-722a-492f-8cdd-1520797f9afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:22:20.614138 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69007904-722a-492f-8cdd-1520797f9afa admin admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:22:20.614419 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69007904-722a-492f-8cdd-1520797f9afa admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:22:20.614695 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69007904-722a-492f-8cdd-1520797f9afa admin admin] PATH_INFO: `/v3/projects/31d3c3f14a394802baf976794b1639be/users/1bb1a2ed7459422eb83cb2b7996ac0a5/roles/5c07cf5bfbd3427db18428aa50420962` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:22:20.631093 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69007904-722a-492f-8cdd-1520797f9afa admin admin] RBAC: Authorizing `identity:create_grant(project_id=31d3c3f14a394802baf976794b1639be, user_id=1bb1a2ed7459422eb83cb2b7996ac0a5, role_id=5c07cf5bfbd3427db18428aa50420962)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:22:20.631320 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc256e50-cdb2-411d-8801-e1816b466d29 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:22:20.632743 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc256e50-cdb2-411d-8801-e1816b466d29 service cinder] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:22:20.634061 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69007904-722a-492f-8cdd-1520797f9afa admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:22:20.643406 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1022/2062] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:22:20 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 19:22:20.648842 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1041/2063] 10.222.0.70 () {60 vars in 1482 bytes} [Tue May 10 19:22:20 2022] PUT /identity/v3/projects/31d3c3f14a394802baf976794b1639be/users/1bb1a2ed7459422eb83cb2b7996ac0a5/roles/5c07cf5bfbd3427db18428aa50420962 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 19:22:20.660906 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffb7635-5945-4d48-bc99-690a6773be48 None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:22:20.661264 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffb7635-5945-4d48-bc99-690a6773be48 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:22:20.661717 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffb7635-5945-4d48-bc99-690a6773be48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:22:20.688777 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-4ffb7635-5945-4d48-bc99-690a6773be48 None None] MFA Rules not processed for user `1bb1a2ed7459422eb83cb2b7996ac0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:22:20.689962 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-4ffb7635-5945-4d48-bc99-690a6773be48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:22:20.752274 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1023/2064] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:22:20 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:22:20.763341 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69007904-722a-492f-8cdd-1520797f9afa admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:22:20.765069 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-69007904-722a-492f-8cdd-1520797f9afa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:22:20.822413 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69007904-722a-492f-8cdd-1520797f9afa admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:22:20.826294 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeeed00-0e3a-4201-a8b7-929e6242479d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15df2a8967aa43299c10e365f4200d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:22:20.826935 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeeed00-0e3a-4201-a8b7-929e6242479d service cinder] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:22:20.827212 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeeed00-0e3a-4201-a8b7-929e6242479d service cinder] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:22:20.827483 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeeed00-0e3a-4201-a8b7-929e6242479d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:22:20.835822 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebeeed00-0e3a-4201-a8b7-929e6242479d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:22:20.837889 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebeeed00-0e3a-4201-a8b7-929e6242479d service cinder] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:22:20.847328 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1042/2065] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:22:20 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:22:20.875847 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffb7635-5945-4d48-bc99-690a6773be48 None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:22:20.972078 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffb7635-5945-4d48-bc99-690a6773be48 None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:22:20.977560 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497bc8e4-fded-4a5f-84ab-c999f9913674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:22:20.978444 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497bc8e4-fded-4a5f-84ab-c999f9913674 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:22:20.978723 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497bc8e4-fded-4a5f-84ab-c999f9913674 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:22:20.978992 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497bc8e4-fded-4a5f-84ab-c999f9913674 admin admin] PATH_INFO: `/v3/users/1bb1a2ed7459422eb83cb2b7996ac0a5` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:22:20.980199 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497bc8e4-fded-4a5f-84ab-c999f9913674 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1bb1a2ed7459422eb83cb2b7996ac0a5)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:22:20.982803 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497bc8e4-fded-4a5f-84ab-c999f9913674 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:22:21.027476 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-497bc8e4-fded-4a5f-84ab-c999f9913674 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1bb1a2ed7459422eb83cb2b7996ac0a5'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:22:21.038654 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-497bc8e4-fded-4a5f-84ab-c999f9913674 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1bb1a2ed7459422eb83cb2b7996ac0a5'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:22:21.045194 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-497bc8e4-fded-4a5f-84ab-c999f9913674 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1bb1a2ed7459422eb83cb2b7996ac0a5'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:22:21.045868 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-497bc8e4-fded-4a5f-84ab-c999f9913674 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1bb1a2ed7459422eb83cb2b7996ac0a5'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:22:21.053163 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-497bc8e4-fded-4a5f-84ab-c999f9913674 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1bb1a2ed7459422eb83cb2b7996ac0a5'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:22:21.059672 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1024/2066] 10.222.0.70 () {58 vars in 1223 bytes} [Tue May 10 19:22:20 2022] DELETE /identity/v3/users/1bb1a2ed7459422eb83cb2b7996ac0a5 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:22:21.064260 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e690e6-22b6-43af-b3e3-4bd335fbcd0f None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:22:21.064605 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e690e6-22b6-43af-b3e3-4bd335fbcd0f None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:22:21.064888 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e690e6-22b6-43af-b3e3-4bd335fbcd0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:22:21.082077 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-45e690e6-22b6-43af-b3e3-4bd335fbcd0f None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:22:21.083256 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-45e690e6-22b6-43af-b3e3-4bd335fbcd0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:22:21.138341 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1043/2067] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:22:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:22:21.148041 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497bc8e4-fded-4a5f-84ab-c999f9913674 admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:22:21.149632 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-497bc8e4-fded-4a5f-84ab-c999f9913674 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:22:21.204741 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497bc8e4-fded-4a5f-84ab-c999f9913674 admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:22:21.208320 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8002fa-43f6-455b-b638-254a1dc4bc27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f1dc79540b48c0866478cc48cd8205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:22:21.208978 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8002fa-43f6-455b-b638-254a1dc4bc27 service neutron] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:22:21.209261 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8002fa-43f6-455b-b638-254a1dc4bc27 service neutron] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:22:21.209538 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8002fa-43f6-455b-b638-254a1dc4bc27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:22:21.218843 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8002fa-43f6-455b-b638-254a1dc4bc27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:22:21.220268 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8002fa-43f6-455b-b638-254a1dc4bc27 service neutron] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:22:21.229993 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1025/2068] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:22:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:22:21.493081 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e690e6-22b6-43af-b3e3-4bd335fbcd0f None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:22:21.494507 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-45e690e6-22b6-43af-b3e3-4bd335fbcd0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:22:21.511794 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e690e6-22b6-43af-b3e3-4bd335fbcd0f None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:22:21.518287 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9270f0b3-15f1-4bac-9490-d78c0e725255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:22:21.519675 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9270f0b3-15f1-4bac-9490-d78c0e725255 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:22:21.519871 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9270f0b3-15f1-4bac-9490-d78c0e725255 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:22:21.520126 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9270f0b3-15f1-4bac-9490-d78c0e725255 admin admin] PATH_INFO: `/v3/projects/31d3c3f14a394802baf976794b1639be` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:22:21.521356 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9270f0b3-15f1-4bac-9490-d78c0e725255 admin admin] RBAC: Authorizing `identity:delete_project(project_id=31d3c3f14a394802baf976794b1639be)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:22:21.523357 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9270f0b3-15f1-4bac-9490-d78c0e725255 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:22:21.571385 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-9270f0b3-15f1-4bac-9490-d78c0e725255 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31d3c3f14a394802baf976794b1639be', 'request_id': 'req-9270f0b3-15f1-4bac-9490-d78c0e725255'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:22:21.579932 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-9270f0b3-15f1-4bac-9490-d78c0e725255 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31d3c3f14a394802baf976794b1639be', 'request_id': 'req-9270f0b3-15f1-4bac-9490-d78c0e725255'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:22:21.588544 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-9270f0b3-15f1-4bac-9490-d78c0e725255 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31d3c3f14a394802baf976794b1639be', 'request_id': 'req-9270f0b3-15f1-4bac-9490-d78c0e725255'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:22:21.601499 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-9270f0b3-15f1-4bac-9490-d78c0e725255 admin admin] The token cache is being invalidate because project 31d3c3f14a394802baf976794b1639be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79994) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:22:21.601784 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-9270f0b3-15f1-4bac-9490-d78c0e725255 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:22:21.603001 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-9270f0b3-15f1-4bac-9490-d78c0e725255 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:22:21.604851 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1044/2069] 10.222.0.70 () {58 vars in 1232 bytes} [Tue May 10 19:22:21 2022] DELETE /identity/v3/projects/31d3c3f14a394802baf976794b1639be => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:22:21.611393 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fef22e4-6a5f-447b-88ca-e9cadc82dccd None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:22:21.611701 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fef22e4-6a5f-447b-88ca-e9cadc82dccd None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:22:21.611981 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fef22e4-6a5f-447b-88ca-e9cadc82dccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:22:21.630239 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-5fef22e4-6a5f-447b-88ca-e9cadc82dccd None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:22:21.631407 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-5fef22e4-6a5f-447b-88ca-e9cadc82dccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:22:21.688824 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1026/2070] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:22:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:22:21.696561 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c98697-4cb2-4412-8e27-a66ac13ca9ce None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:22:21.696849 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c98697-4cb2-4412-8e27-a66ac13ca9ce None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:22:21.697123 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c98697-4cb2-4412-8e27-a66ac13ca9ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:22:21.715723 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-d6c98697-4cb2-4412-8e27-a66ac13ca9ce None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:22:21.716973 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-d6c98697-4cb2-4412-8e27-a66ac13ca9ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:22:21.724820 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1045/2071] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:22:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:22:21.729720 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fef22e4-6a5f-447b-88ca-e9cadc82dccd None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:22:21.740406 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fef22e4-6a5f-447b-88ca-e9cadc82dccd None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:22:21.745568 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3386540e-1dbb-4dd8-a8a0-b48d81599da3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:22:21.746231 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3386540e-1dbb-4dd8-a8a0-b48d81599da3 admin admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:22:21.746633 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3386540e-1dbb-4dd8-a8a0-b48d81599da3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:22:21.747002 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3386540e-1dbb-4dd8-a8a0-b48d81599da3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:22:21.747757 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3386540e-1dbb-4dd8-a8a0-b48d81599da3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:22:21.748070 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3386540e-1dbb-4dd8-a8a0-b48d81599da3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:22:21.749834 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3386540e-1dbb-4dd8-a8a0-b48d81599da3 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:22:21.761553 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1027/2072] 10.222.0.70 () {58 vars in 1152 bytes} [Tue May 10 19:22:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:22:21.766024 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c98697-4cb2-4412-8e27-a66ac13ca9ce None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:22:21.775530 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c98697-4cb2-4412-8e27-a66ac13ca9ce None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:22:21.780484 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeae15d7-684d-4c2d-8fc6-68e3a3ca1abd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:22:21.781143 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeae15d7-684d-4c2d-8fc6-68e3a3ca1abd admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:22:21.781423 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeae15d7-684d-4c2d-8fc6-68e3a3ca1abd admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:22:21.781697 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeae15d7-684d-4c2d-8fc6-68e3a3ca1abd admin admin] PATH_INFO: `/v3/projects` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:22:21.782515 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeae15d7-684d-4c2d-8fc6-68e3a3ca1abd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:22:21.784471 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeae15d7-684d-4c2d-8fc6-68e3a3ca1abd admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:22:21.811761 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1046/2073] 10.222.0.70 () {60 vars in 1152 bytes} [Tue May 10 19:22:21 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:22:21.816062 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3386540e-1dbb-4dd8-a8a0-b48d81599da3 admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:22:21.827026 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3386540e-1dbb-4dd8-a8a0-b48d81599da3 admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:22:21.884835 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae3f983-afff-4a5a-98a5-3fb2b58bb7df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:22:21.885503 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae3f983-afff-4a5a-98a5-3fb2b58bb7df admin admin] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:22:21.885825 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae3f983-afff-4a5a-98a5-3fb2b58bb7df admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:22:21.886067 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae3f983-afff-4a5a-98a5-3fb2b58bb7df admin admin] PATH_INFO: `/v3/users` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:22:21.886795 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae3f983-afff-4a5a-98a5-3fb2b58bb7df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:22:21.888734 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae3f983-afff-4a5a-98a5-3fb2b58bb7df admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:22:21.907626 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1028/2074] 10.222.0.70 () {60 vars in 1143 bytes} [Tue May 10 19:22:21 2022] POST /identity/v3/users => generated 287 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:22:21.911571 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeae15d7-684d-4c2d-8fc6-68e3a3ca1abd admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:22:21.922057 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeae15d7-684d-4c2d-8fc6-68e3a3ca1abd admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:22:21.926573 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8f6f9a-5858-46e5-9c78-c5a5a5f4e853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:22:21.927217 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8f6f9a-5858-46e5-9c78-c5a5a5f4e853 admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:22:21.927494 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8f6f9a-5858-46e5-9c78-c5a5a5f4e853 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:22:21.927761 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8f6f9a-5858-46e5-9c78-c5a5a5f4e853 admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:22:21.928498 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8f6f9a-5858-46e5-9c78-c5a5a5f4e853 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:22:21.930064 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8f6f9a-5858-46e5-9c78-c5a5a5f4e853 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:22:21.940814 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1047/2075] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:22:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:22:21.949062 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae3f983-afff-4a5a-98a5-3fb2b58bb7df admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:22:21.960587 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae3f983-afff-4a5a-98a5-3fb2b58bb7df admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:22:21.967954 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776e6dcc-a3f5-4e7d-91e3-541d110d97eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:22:21.967954 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776e6dcc-a3f5-4e7d-91e3-541d110d97eb admin admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:22:21.967954 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776e6dcc-a3f5-4e7d-91e3-541d110d97eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:22:21.967954 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776e6dcc-a3f5-4e7d-91e3-541d110d97eb admin admin] PATH_INFO: `/v3/roles` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:22:21.968470 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776e6dcc-a3f5-4e7d-91e3-541d110d97eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:22:21.976466 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776e6dcc-a3f5-4e7d-91e3-541d110d97eb admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:22:21.988464 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1029/2076] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:22:21 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:22:21.993282 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8f6f9a-5858-46e5-9c78-c5a5a5f4e853 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:22:22.003860 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8f6f9a-5858-46e5-9c78-c5a5a5f4e853 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:22:22.009150 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce7fe42-dd3e-48bd-bb53-b9e93764304b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:22:22.009390 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4326d41c-a82b-478d-85d8-6f216717c131 None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:22:22.009689 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4326d41c-a82b-478d-85d8-6f216717c131 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:22:22.009976 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4326d41c-a82b-478d-85d8-6f216717c131 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:22:22.010315 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce7fe42-dd3e-48bd-bb53-b9e93764304b admin admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:22:22.010660 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce7fe42-dd3e-48bd-bb53-b9e93764304b admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:22:22.010999 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce7fe42-dd3e-48bd-bb53-b9e93764304b admin admin] PATH_INFO: `/v3/projects/7423397f1a9546bbb64a843b37d62213/users/0c773c840a8445e9bda1fd365a485e2e/roles/5c07cf5bfbd3427db18428aa50420962` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:22:22.026754 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce7fe42-dd3e-48bd-bb53-b9e93764304b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7423397f1a9546bbb64a843b37d62213, user_id=0c773c840a8445e9bda1fd365a485e2e, role_id=5c07cf5bfbd3427db18428aa50420962)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:22:22.029491 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce7fe42-dd3e-48bd-bb53-b9e93764304b admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:22:22.031099 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-4326d41c-a82b-478d-85d8-6f216717c131 None None] MFA Rules not processed for user `221e215caae34d08a9b8f36c711b4318`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:22:22.032376 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-4326d41c-a82b-478d-85d8-6f216717c131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:22:22.044092 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1048/2077] 10.222.0.70 () {60 vars in 1482 bytes} [Tue May 10 19:22:21 2022] PUT /identity/v3/projects/7423397f1a9546bbb64a843b37d62213/users/0c773c840a8445e9bda1fd365a485e2e/roles/5c07cf5bfbd3427db18428aa50420962 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:22:22.054215 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d02e63-d864-4b94-9cd2-2b0f82a95b03 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:22:22.054502 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d02e63-d864-4b94-9cd2-2b0f82a95b03 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:22:22.054882 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d02e63-d864-4b94-9cd2-2b0f82a95b03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:22:22.083315 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-68d02e63-d864-4b94-9cd2-2b0f82a95b03 None None] MFA Rules not processed for user `0c773c840a8445e9bda1fd365a485e2e`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:22:22.084479 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-68d02e63-d864-4b94-9cd2-2b0f82a95b03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:22:22.095319 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1030/2078] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:22:22 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:22:22.096221 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4326d41c-a82b-478d-85d8-6f216717c131 None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:22:22.100581 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-4326d41c-a82b-478d-85d8-6f216717c131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:22:22.117485 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4326d41c-a82b-478d-85d8-6f216717c131 None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:22:22.149891 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1049/2079] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:22:22 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:22:22.160400 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d02e63-d864-4b94-9cd2-2b0f82a95b03 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:22:22.161792 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-68d02e63-d864-4b94-9cd2-2b0f82a95b03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:22:22.174915 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5ceb98-2a7e-4a21-8745-e4e09f7733db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:22:22.175800 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5ceb98-2a7e-4a21-8745-e4e09f7733db admin admin] REQUEST_METHOD: `DELETE` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:22:22.176085 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5ceb98-2a7e-4a21-8745-e4e09f7733db admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:22:22.176507 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5ceb98-2a7e-4a21-8745-e4e09f7733db admin admin] PATH_INFO: `/v3/users/cd895abbbf4f48939f658be1a1d369b5` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:22:22.177602 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5ceb98-2a7e-4a21-8745-e4e09f7733db admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd895abbbf4f48939f658be1a1d369b5)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:22:22.179594 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5ceb98-2a7e-4a21-8745-e4e09f7733db admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:22:22.228904 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d02e63-d864-4b94-9cd2-2b0f82a95b03 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:22:22.233644 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5a6747-5393-4bc6-ab8a-faec93175762 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15df2a8967aa43299c10e365f4200d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:22:22.234301 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5a6747-5393-4bc6-ab8a-faec93175762 service cinder] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:22:22.234584 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5a6747-5393-4bc6-ab8a-faec93175762 service cinder] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:22:22.234884 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5a6747-5393-4bc6-ab8a-faec93175762 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:22:22.238168 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-8b5ceb98-2a7e-4a21-8745-e4e09f7733db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd895abbbf4f48939f658be1a1d369b5'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:22:22.246580 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5a6747-5393-4bc6-ab8a-faec93175762 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:22:22.248039 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5a6747-5393-4bc6-ab8a-faec93175762 service cinder] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:22:22.251072 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-8b5ceb98-2a7e-4a21-8745-e4e09f7733db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd895abbbf4f48939f658be1a1d369b5'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:22:22.257800 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1050/2080] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:22:22 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 19:22:22.257943 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-8b5ceb98-2a7e-4a21-8745-e4e09f7733db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd895abbbf4f48939f658be1a1d369b5'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:22:22.258569 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-8b5ceb98-2a7e-4a21-8745-e4e09f7733db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd895abbbf4f48939f658be1a1d369b5'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:22:22.267801 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-8b5ceb98-2a7e-4a21-8745-e4e09f7733db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd895abbbf4f48939f658be1a1d369b5'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:22:22.274850 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1031/2081] 10.222.0.70 () {58 vars in 1223 bytes} [Tue May 10 19:22:22 2022] DELETE /identity/v3/users/cd895abbbf4f48939f658be1a1d369b5 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:22:22.279325 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8a78f9-f280-4442-9db8-9a5aa8f8257e None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:22:22.279609 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8a78f9-f280-4442-9db8-9a5aa8f8257e None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:22:22.279883 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8a78f9-f280-4442-9db8-9a5aa8f8257e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:22:22.298402 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-6a8a78f9-f280-4442-9db8-9a5aa8f8257e None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:22:22.299592 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-6a8a78f9-f280-4442-9db8-9a5aa8f8257e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:22:22.361246 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1051/2082] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:22:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:22:22.371290 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5ceb98-2a7e-4a21-8745-e4e09f7733db admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:22:22.372869 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-8b5ceb98-2a7e-4a21-8745-e4e09f7733db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:22:22.444859 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5ceb98-2a7e-4a21-8745-e4e09f7733db admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:22:22.449235 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb34105-c8a8-4024-b4ea-c2c1338bee4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f1dc79540b48c0866478cc48cd8205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:22:22.450529 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb34105-c8a8-4024-b4ea-c2c1338bee4f service neutron] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:22:22.450884 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb34105-c8a8-4024-b4ea-c2c1338bee4f service neutron] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:22:22.452493 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb34105-c8a8-4024-b4ea-c2c1338bee4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:22:22.466217 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb34105-c8a8-4024-b4ea-c2c1338bee4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:22:22.467799 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb34105-c8a8-4024-b4ea-c2c1338bee4f service neutron] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:22:22.478404 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1032/2083] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:22:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:22:22.905100 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8a78f9-f280-4442-9db8-9a5aa8f8257e None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:22:22.906901 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-6a8a78f9-f280-4442-9db8-9a5aa8f8257e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:22:22.924879 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8a78f9-f280-4442-9db8-9a5aa8f8257e None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:22:22.931942 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe0b450-a67d-43e0-833f-5f86bb7cf6f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:22:22.933372 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe0b450-a67d-43e0-833f-5f86bb7cf6f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:22:22.933655 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe0b450-a67d-43e0-833f-5f86bb7cf6f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:22:22.933927 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe0b450-a67d-43e0-833f-5f86bb7cf6f5 admin admin] PATH_INFO: `/v3/projects/e7b15023f7ac4a6d99462a9fe6101c70` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:22:22.935143 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe0b450-a67d-43e0-833f-5f86bb7cf6f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7b15023f7ac4a6d99462a9fe6101c70)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:22:22.937782 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe0b450-a67d-43e0-833f-5f86bb7cf6f5 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:22:22.990970 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-dfe0b450-a67d-43e0-833f-5f86bb7cf6f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7b15023f7ac4a6d99462a9fe6101c70', 'request_id': 'req-dfe0b450-a67d-43e0-833f-5f86bb7cf6f5'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:22:22.997496 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-dfe0b450-a67d-43e0-833f-5f86bb7cf6f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7b15023f7ac4a6d99462a9fe6101c70', 'request_id': 'req-dfe0b450-a67d-43e0-833f-5f86bb7cf6f5'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:22:23.004856 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-dfe0b450-a67d-43e0-833f-5f86bb7cf6f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7b15023f7ac4a6d99462a9fe6101c70', 'request_id': 'req-dfe0b450-a67d-43e0-833f-5f86bb7cf6f5'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:22:23.018120 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-dfe0b450-a67d-43e0-833f-5f86bb7cf6f5 admin admin] The token cache is being invalidate because project e7b15023f7ac4a6d99462a9fe6101c70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79994) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:22:23.018393 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-dfe0b450-a67d-43e0-833f-5f86bb7cf6f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:22:23.019034 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-dfe0b450-a67d-43e0-833f-5f86bb7cf6f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:22:23.020594 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1052/2084] 10.222.0.70 () {58 vars in 1232 bytes} [Tue May 10 19:22:22 2022] DELETE /identity/v3/projects/e7b15023f7ac4a6d99462a9fe6101c70 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:22:23.025563 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacb4cd4-c25b-477f-9658-16e357076396 None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:22:23.026030 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacb4cd4-c25b-477f-9658-16e357076396 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:22:23.026110 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacb4cd4-c25b-477f-9658-16e357076396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:22:23.043495 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-dacb4cd4-c25b-477f-9658-16e357076396 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:22:23.044783 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-dacb4cd4-c25b-477f-9658-16e357076396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:22:23.106480 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1033/2085] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:22:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:22:23.114874 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a198128e-bfd2-4e4f-a994-ce5116bc25b4 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:22:23.115158 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a198128e-bfd2-4e4f-a994-ce5116bc25b4 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:22:23.115432 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a198128e-bfd2-4e4f-a994-ce5116bc25b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:22:23.134936 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-a198128e-bfd2-4e4f-a994-ce5116bc25b4 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:22:23.136077 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-a198128e-bfd2-4e4f-a994-ce5116bc25b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:22:23.144534 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1053/2086] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:22:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:22:23.148687 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacb4cd4-c25b-477f-9658-16e357076396 None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:22:23.158553 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacb4cd4-c25b-477f-9658-16e357076396 None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:22:23.163192 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a6ade7-6f0a-43d5-b3d1-75faf5ce4fe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:22:23.163843 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a6ade7-6f0a-43d5-b3d1-75faf5ce4fe9 admin admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:22:23.164127 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a6ade7-6f0a-43d5-b3d1-75faf5ce4fe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:22:23.164471 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a6ade7-6f0a-43d5-b3d1-75faf5ce4fe9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:22:23.165148 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a6ade7-6f0a-43d5-b3d1-75faf5ce4fe9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:22:23.165529 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a6ade7-6f0a-43d5-b3d1-75faf5ce4fe9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:22:23.167075 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a6ade7-6f0a-43d5-b3d1-75faf5ce4fe9 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:22:23.182501 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1034/2087] 10.222.0.70 () {58 vars in 1152 bytes} [Tue May 10 19:22:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:22:23.183702 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a198128e-bfd2-4e4f-a994-ce5116bc25b4 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:22:23.192798 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a198128e-bfd2-4e4f-a994-ce5116bc25b4 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:22:23.198533 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0d72a7-8922-484c-8c99-685b09b29e44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:22:23.199191 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0d72a7-8922-484c-8c99-685b09b29e44 admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:22:23.199722 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0d72a7-8922-484c-8c99-685b09b29e44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:22:23.199994 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0d72a7-8922-484c-8c99-685b09b29e44 admin admin] PATH_INFO: `/v3/projects` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:22:23.201147 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0d72a7-8922-484c-8c99-685b09b29e44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:22:23.203080 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0d72a7-8922-484c-8c99-685b09b29e44 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:22:23.230618 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1054/2088] 10.222.0.70 () {60 vars in 1152 bytes} [Tue May 10 19:22:23 2022] POST /identity/v3/projects => generated 389 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:22:23.234623 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a6ade7-6f0a-43d5-b3d1-75faf5ce4fe9 admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:22:23.245259 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a6ade7-6f0a-43d5-b3d1-75faf5ce4fe9 admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:22:23.300776 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a42cae8-3c47-4242-8874-f9d8a98bf71b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:22:23.301461 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a42cae8-3c47-4242-8874-f9d8a98bf71b admin admin] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:22:23.301748 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a42cae8-3c47-4242-8874-f9d8a98bf71b admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:22:23.302028 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a42cae8-3c47-4242-8874-f9d8a98bf71b admin admin] PATH_INFO: `/v3/users` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:22:23.303274 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a42cae8-3c47-4242-8874-f9d8a98bf71b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:22:23.304674 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a42cae8-3c47-4242-8874-f9d8a98bf71b admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:22:23.324894 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1035/2089] 10.222.0.70 () {60 vars in 1143 bytes} [Tue May 10 19:22:23 2022] POST /identity/v3/users => generated 295 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 19:22:23.328856 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0d72a7-8922-484c-8c99-685b09b29e44 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:22:23.339751 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0d72a7-8922-484c-8c99-685b09b29e44 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:22:23.345266 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9970853-ee71-4411-9620-ca0704831801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:22:23.345954 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9970853-ee71-4411-9620-ca0704831801 admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:22:23.346248 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9970853-ee71-4411-9620-ca0704831801 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:22:23.346531 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9970853-ee71-4411-9620-ca0704831801 admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:22:23.347280 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9970853-ee71-4411-9620-ca0704831801 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:22:23.348946 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9970853-ee71-4411-9620-ca0704831801 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:22:23.360155 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1055/2090] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:22:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:22:23.364056 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a42cae8-3c47-4242-8874-f9d8a98bf71b admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:22:23.374343 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a42cae8-3c47-4242-8874-f9d8a98bf71b admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:22:23.378915 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9439ae08-d830-4c89-ab23-4d35103ee0bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:22:23.379570 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9439ae08-d830-4c89-ab23-4d35103ee0bb admin admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:22:23.379855 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9439ae08-d830-4c89-ab23-4d35103ee0bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:22:23.380133 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9439ae08-d830-4c89-ab23-4d35103ee0bb admin admin] PATH_INFO: `/v3/roles` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:22:23.380893 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9439ae08-d830-4c89-ab23-4d35103ee0bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:22:23.382490 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9439ae08-d830-4c89-ab23-4d35103ee0bb admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:22:23.394321 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1036/2091] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:22:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:22:23.397974 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9970853-ee71-4411-9620-ca0704831801 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:22:23.407532 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9970853-ee71-4411-9620-ca0704831801 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:22:23.411977 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a576bd-8cd0-4c72-a15a-dcbd3d70b26d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:22:23.412881 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a576bd-8cd0-4c72-a15a-dcbd3d70b26d admin admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:22:23.413162 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a576bd-8cd0-4c72-a15a-dcbd3d70b26d admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:22:23.413433 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a576bd-8cd0-4c72-a15a-dcbd3d70b26d admin admin] PATH_INFO: `/v3/projects/f88cdfa3e6e54e0c9d4fe9bc173db57f/users/deb80ecbef784e2584a3a575e9ad852e/roles/5c07cf5bfbd3427db18428aa50420962` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:22:23.428049 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a576bd-8cd0-4c72-a15a-dcbd3d70b26d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f88cdfa3e6e54e0c9d4fe9bc173db57f, user_id=deb80ecbef784e2584a3a575e9ad852e, role_id=5c07cf5bfbd3427db18428aa50420962)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:22:23.431357 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a576bd-8cd0-4c72-a15a-dcbd3d70b26d admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:22:23.443777 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1056/2092] 10.222.0.70 () {60 vars in 1482 bytes} [Tue May 10 19:22:23 2022] PUT /identity/v3/projects/f88cdfa3e6e54e0c9d4fe9bc173db57f/users/deb80ecbef784e2584a3a575e9ad852e/roles/5c07cf5bfbd3427db18428aa50420962 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:22:23.454161 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edf4f6f-05a4-4b4e-993e-9333cf815bf5 None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:22:23.454454 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edf4f6f-05a4-4b4e-993e-9333cf815bf5 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:22:23.454721 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edf4f6f-05a4-4b4e-993e-9333cf815bf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:22:23.480359 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-4edf4f6f-05a4-4b4e-993e-9333cf815bf5 None None] MFA Rules not processed for user `deb80ecbef784e2584a3a575e9ad852e`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:22:23.481579 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-4edf4f6f-05a4-4b4e-993e-9333cf815bf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:22:23.541814 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1037/2093] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:22:23 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:22:23.552277 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a576bd-8cd0-4c72-a15a-dcbd3d70b26d admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:22:23.554082 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-d6a576bd-8cd0-4c72-a15a-dcbd3d70b26d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:22:23.612067 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a576bd-8cd0-4c72-a15a-dcbd3d70b26d admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:22:23.616061 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1d3d0f-58a3-4c04-9395-a5805612d2f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15df2a8967aa43299c10e365f4200d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:22:23.616746 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1d3d0f-58a3-4c04-9395-a5805612d2f7 service cinder] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:22:23.617028 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1d3d0f-58a3-4c04-9395-a5805612d2f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:22:23.617738 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1d3d0f-58a3-4c04-9395-a5805612d2f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:22:23.626422 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1d3d0f-58a3-4c04-9395-a5805612d2f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:22:23.627955 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1d3d0f-58a3-4c04-9395-a5805612d2f7 service cinder] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:22:23.642621 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1057/2094] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:22:23 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:22:23.649652 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6a667a-0537-42f9-8ac5-aef1eeb4e436 None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:22:23.649916 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6a667a-0537-42f9-8ac5-aef1eeb4e436 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:22:23.650276 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6a667a-0537-42f9-8ac5-aef1eeb4e436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:22:23.672780 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-8d6a667a-0537-42f9-8ac5-aef1eeb4e436 None None] MFA Rules not processed for user `0c773c840a8445e9bda1fd365a485e2e`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:22:23.674099 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-8d6a667a-0537-42f9-8ac5-aef1eeb4e436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:22:23.751753 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1038/2095] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:22:23 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:22:33.014624 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1d3d0f-58a3-4c04-9395-a5805612d2f7 service cinder] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:22:33.016062 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-2b1d3d0f-58a3-4c04-9395-a5805612d2f7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:22:33.091147 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1d3d0f-58a3-4c04-9395-a5805612d2f7 service cinder] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:22:33.097575 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab5c7f1-cb05-4844-a211-dcd6cf76b8f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:22:33.098468 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab5c7f1-cb05-4844-a211-dcd6cf76b8f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:22:33.098748 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab5c7f1-cb05-4844-a211-dcd6cf76b8f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:22:33.099018 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab5c7f1-cb05-4844-a211-dcd6cf76b8f7 admin admin] PATH_INFO: `/v3/users/f35f25af2fdc4369be2cd93d1cebc7f0` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:22:33.100246 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab5c7f1-cb05-4844-a211-dcd6cf76b8f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f35f25af2fdc4369be2cd93d1cebc7f0)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:22:33.102914 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab5c7f1-cb05-4844-a211-dcd6cf76b8f7 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:22:33.158082 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-fab5c7f1-cb05-4844-a211-dcd6cf76b8f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f35f25af2fdc4369be2cd93d1cebc7f0'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:22:33.172337 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-fab5c7f1-cb05-4844-a211-dcd6cf76b8f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f35f25af2fdc4369be2cd93d1cebc7f0'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:22:33.173189 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-fab5c7f1-cb05-4844-a211-dcd6cf76b8f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f35f25af2fdc4369be2cd93d1cebc7f0'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:22:33.181953 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-fab5c7f1-cb05-4844-a211-dcd6cf76b8f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f35f25af2fdc4369be2cd93d1cebc7f0'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:22:33.189636 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-fab5c7f1-cb05-4844-a211-dcd6cf76b8f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f35f25af2fdc4369be2cd93d1cebc7f0'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:22:33.196630 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1058/2096] 10.222.0.70 () {58 vars in 1223 bytes} [Tue May 10 19:22:33 2022] DELETE /identity/v3/users/f35f25af2fdc4369be2cd93d1cebc7f0 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:22:33.201336 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb248f7-4f46-441e-9303-9d6d1e39292c None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:22:33.202147 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb248f7-4f46-441e-9303-9d6d1e39292c None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:22:33.202428 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb248f7-4f46-441e-9303-9d6d1e39292c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:22:33.227876 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-0bb248f7-4f46-441e-9303-9d6d1e39292c None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:22:33.229130 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-0bb248f7-4f46-441e-9303-9d6d1e39292c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:22:33.291208 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1039/2097] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:22:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:22:33.300393 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab5c7f1-cb05-4844-a211-dcd6cf76b8f7 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:22:33.301920 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-fab5c7f1-cb05-4844-a211-dcd6cf76b8f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:22:33.358851 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab5c7f1-cb05-4844-a211-dcd6cf76b8f7 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:22:33.362509 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4896ed23-6421-44d4-99b4-ee460b6343f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f1dc79540b48c0866478cc48cd8205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:22:33.363148 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4896ed23-6421-44d4-99b4-ee460b6343f6 service neutron] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:22:33.363429 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4896ed23-6421-44d4-99b4-ee460b6343f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:22:33.363701 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4896ed23-6421-44d4-99b4-ee460b6343f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:22:33.372966 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4896ed23-6421-44d4-99b4-ee460b6343f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:22:33.374382 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4896ed23-6421-44d4-99b4-ee460b6343f6 service neutron] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:22:33.383554 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1059/2098] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:22:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:22:33.638728 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb248f7-4f46-441e-9303-9d6d1e39292c None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:22:33.640236 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-0bb248f7-4f46-441e-9303-9d6d1e39292c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:22:33.655082 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb248f7-4f46-441e-9303-9d6d1e39292c None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:22:33.661096 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc43fcb-f76a-4160-93ad-fb20b1a34f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:22:33.661973 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc43fcb-f76a-4160-93ad-fb20b1a34f8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:22:33.662274 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc43fcb-f76a-4160-93ad-fb20b1a34f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:22:33.662522 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc43fcb-f76a-4160-93ad-fb20b1a34f8a admin admin] PATH_INFO: `/v3/projects/266993d889f44f4bad8c69cba0f97279` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:22:33.663732 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc43fcb-f76a-4160-93ad-fb20b1a34f8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=266993d889f44f4bad8c69cba0f97279)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:22:33.666497 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc43fcb-f76a-4160-93ad-fb20b1a34f8a admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:22:33.717533 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-cdc43fcb-f76a-4160-93ad-fb20b1a34f8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '266993d889f44f4bad8c69cba0f97279', 'request_id': 'req-cdc43fcb-f76a-4160-93ad-fb20b1a34f8a'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:22:33.723245 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-cdc43fcb-f76a-4160-93ad-fb20b1a34f8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '266993d889f44f4bad8c69cba0f97279', 'request_id': 'req-cdc43fcb-f76a-4160-93ad-fb20b1a34f8a'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:22:33.730717 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-cdc43fcb-f76a-4160-93ad-fb20b1a34f8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '266993d889f44f4bad8c69cba0f97279', 'request_id': 'req-cdc43fcb-f76a-4160-93ad-fb20b1a34f8a'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:22:33.741635 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-cdc43fcb-f76a-4160-93ad-fb20b1a34f8a admin admin] The token cache is being invalidate because project 266993d889f44f4bad8c69cba0f97279 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79993) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:22:33.741919 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-cdc43fcb-f76a-4160-93ad-fb20b1a34f8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:22:33.743277 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-cdc43fcb-f76a-4160-93ad-fb20b1a34f8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:22:33.747729 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1040/2099] 10.222.0.70 () {58 vars in 1232 bytes} [Tue May 10 19:22:33 2022] DELETE /identity/v3/projects/266993d889f44f4bad8c69cba0f97279 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:22:33.748837 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4896ed23-6421-44d4-99b4-ee460b6343f6 service neutron] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:22:33.760129 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4896ed23-6421-44d4-99b4-ee460b6343f6 service neutron] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:22:33.815966 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df1687c-a9ad-4fcd-adfb-2bb17e6767d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:22:33.816885 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df1687c-a9ad-4fcd-adfb-2bb17e6767d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:22:33.817168 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df1687c-a9ad-4fcd-adfb-2bb17e6767d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:22:33.817444 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df1687c-a9ad-4fcd-adfb-2bb17e6767d4 admin admin] PATH_INFO: `/v3/users/f1ae8243ba2f47bda36226bb0c8fd9b3` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:22:33.818720 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df1687c-a9ad-4fcd-adfb-2bb17e6767d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1ae8243ba2f47bda36226bb0c8fd9b3)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:22:33.821883 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df1687c-a9ad-4fcd-adfb-2bb17e6767d4 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:22:33.873999 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-6df1687c-a9ad-4fcd-adfb-2bb17e6767d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1ae8243ba2f47bda36226bb0c8fd9b3'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:22:33.886375 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-6df1687c-a9ad-4fcd-adfb-2bb17e6767d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1ae8243ba2f47bda36226bb0c8fd9b3'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:22:33.886895 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-6df1687c-a9ad-4fcd-adfb-2bb17e6767d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1ae8243ba2f47bda36226bb0c8fd9b3'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:22:33.894374 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-6df1687c-a9ad-4fcd-adfb-2bb17e6767d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1ae8243ba2f47bda36226bb0c8fd9b3'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:22:33.901348 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-6df1687c-a9ad-4fcd-adfb-2bb17e6767d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1ae8243ba2f47bda36226bb0c8fd9b3'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:22:33.907132 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1060/2100] 10.222.0.70 () {58 vars in 1223 bytes} [Tue May 10 19:22:33 2022] DELETE /identity/v3/users/f1ae8243ba2f47bda36226bb0c8fd9b3 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:22:34.181780 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc43fcb-f76a-4160-93ad-fb20b1a34f8a admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:22:34.183276 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-cdc43fcb-f76a-4160-93ad-fb20b1a34f8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:22:34.197303 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc43fcb-f76a-4160-93ad-fb20b1a34f8a admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:22:34.256730 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2b75dd-6d44-4815-aadf-869d9ac5a62c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:22:34.257636 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2b75dd-6d44-4815-aadf-869d9ac5a62c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:22:34.257904 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2b75dd-6d44-4815-aadf-869d9ac5a62c admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:22:34.258315 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2b75dd-6d44-4815-aadf-869d9ac5a62c admin admin] PATH_INFO: `/v3/projects/fb449e52f9044880a60e3d6f2bf28c8e` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:22:34.259662 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2b75dd-6d44-4815-aadf-869d9ac5a62c admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb449e52f9044880a60e3d6f2bf28c8e)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:22:34.261918 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2b75dd-6d44-4815-aadf-869d9ac5a62c admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:22:34.318333 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-4c2b75dd-6d44-4815-aadf-869d9ac5a62c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb449e52f9044880a60e3d6f2bf28c8e', 'request_id': 'req-4c2b75dd-6d44-4815-aadf-869d9ac5a62c'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:22:34.325164 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-4c2b75dd-6d44-4815-aadf-869d9ac5a62c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb449e52f9044880a60e3d6f2bf28c8e', 'request_id': 'req-4c2b75dd-6d44-4815-aadf-869d9ac5a62c'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:22:34.336439 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-4c2b75dd-6d44-4815-aadf-869d9ac5a62c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb449e52f9044880a60e3d6f2bf28c8e', 'request_id': 'req-4c2b75dd-6d44-4815-aadf-869d9ac5a62c'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:22:34.352469 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-4c2b75dd-6d44-4815-aadf-869d9ac5a62c admin admin] The token cache is being invalidate because project fb449e52f9044880a60e3d6f2bf28c8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79993) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:22:34.352764 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-4c2b75dd-6d44-4815-aadf-869d9ac5a62c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:22:34.353609 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-4c2b75dd-6d44-4815-aadf-869d9ac5a62c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:22:34.355260 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1041/2101] 10.222.0.70 () {58 vars in 1232 bytes} [Tue May 10 19:22:34 2022] DELETE /identity/v3/projects/fb449e52f9044880a60e3d6f2bf28c8e => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:22:34.359900 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe92bce-69c1-4b32-aecb-99dc583c8be3 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:22:34.360811 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe92bce-69c1-4b32-aecb-99dc583c8be3 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:22:34.361310 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe92bce-69c1-4b32-aecb-99dc583c8be3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:22:34.379546 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-5fe92bce-69c1-4b32-aecb-99dc583c8be3 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:22:34.381022 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-5fe92bce-69c1-4b32-aecb-99dc583c8be3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:22:34.445656 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1061/2102] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:22:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:22:34.453659 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd74a4cf-b0bf-4da8-8370-baec971b6949 None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:22:34.453951 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd74a4cf-b0bf-4da8-8370-baec971b6949 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:22:34.454227 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd74a4cf-b0bf-4da8-8370-baec971b6949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:22:34.473173 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-dd74a4cf-b0bf-4da8-8370-baec971b6949 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:22:34.474369 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-dd74a4cf-b0bf-4da8-8370-baec971b6949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:22:34.483633 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1042/2103] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:22:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:22:34.487702 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe92bce-69c1-4b32-aecb-99dc583c8be3 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:22:34.497601 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe92bce-69c1-4b32-aecb-99dc583c8be3 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:22:34.502056 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6762f381-f815-4fcd-a0c7-5a25d121b83d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:22:34.502701 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6762f381-f815-4fcd-a0c7-5a25d121b83d admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:22:34.502983 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6762f381-f815-4fcd-a0c7-5a25d121b83d admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:22:34.503257 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6762f381-f815-4fcd-a0c7-5a25d121b83d admin admin] PATH_INFO: `/v3/domains` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:22:34.504067 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6762f381-f815-4fcd-a0c7-5a25d121b83d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:22:34.504386 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6762f381-f815-4fcd-a0c7-5a25d121b83d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:22:34.505997 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6762f381-f815-4fcd-a0c7-5a25d121b83d admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:22:34.516926 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1062/2104] 10.222.0.70 () {58 vars in 1152 bytes} [Tue May 10 19:22:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:22:34.521090 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd74a4cf-b0bf-4da8-8370-baec971b6949 None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:22:34.530572 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd74a4cf-b0bf-4da8-8370-baec971b6949 None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:22:34.535242 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8f71c6-42bd-4611-a193-e0b8b0af80fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:22:34.535880 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8f71c6-42bd-4611-a193-e0b8b0af80fb admin admin] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:22:34.536166 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8f71c6-42bd-4611-a193-e0b8b0af80fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:22:34.536465 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8f71c6-42bd-4611-a193-e0b8b0af80fb admin admin] PATH_INFO: `/v3/projects` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:22:34.537152 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8f71c6-42bd-4611-a193-e0b8b0af80fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:22:34.539098 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8f71c6-42bd-4611-a193-e0b8b0af80fb admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:22:34.563891 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1043/2105] 10.222.0.70 () {60 vars in 1152 bytes} [Tue May 10 19:22:34 2022] POST /identity/v3/projects => generated 381 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:22:34.568064 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6762f381-f815-4fcd-a0c7-5a25d121b83d admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:22:34.578811 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6762f381-f815-4fcd-a0c7-5a25d121b83d admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:22:34.632410 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bae486-e963-4804-8470-1db4a2b16c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:22:34.633589 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bae486-e963-4804-8470-1db4a2b16c8e admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:22:34.633867 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bae486-e963-4804-8470-1db4a2b16c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:22:34.634135 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bae486-e963-4804-8470-1db4a2b16c8e admin admin] PATH_INFO: `/v3/users` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:22:34.634823 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bae486-e963-4804-8470-1db4a2b16c8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:22:34.636744 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bae486-e963-4804-8470-1db4a2b16c8e admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:22:34.656774 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1063/2106] 10.222.0.70 () {60 vars in 1143 bytes} [Tue May 10 19:22:34 2022] POST /identity/v3/users => generated 291 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 19:22:34.661049 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8f71c6-42bd-4611-a193-e0b8b0af80fb admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:22:34.671202 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8f71c6-42bd-4611-a193-e0b8b0af80fb admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:22:34.675939 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd07feae-3e2f-4a62-b6fa-b7b72bb33f15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:22:34.676627 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd07feae-3e2f-4a62-b6fa-b7b72bb33f15 admin admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:22:34.676913 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd07feae-3e2f-4a62-b6fa-b7b72bb33f15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:22:34.677207 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd07feae-3e2f-4a62-b6fa-b7b72bb33f15 admin admin] PATH_INFO: `/v3/roles` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:22:34.677933 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd07feae-3e2f-4a62-b6fa-b7b72bb33f15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:22:34.679534 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd07feae-3e2f-4a62-b6fa-b7b72bb33f15 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:22:34.689643 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1044/2107] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:22:34 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:22:34.693445 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bae486-e963-4804-8470-1db4a2b16c8e admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:22:34.703789 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bae486-e963-4804-8470-1db4a2b16c8e admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:22:34.708660 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8783b2-4bf1-4872-bca5-018ae0cf939a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:22:34.709308 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8783b2-4bf1-4872-bca5-018ae0cf939a admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:22:34.709587 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8783b2-4bf1-4872-bca5-018ae0cf939a admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:22:34.709856 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8783b2-4bf1-4872-bca5-018ae0cf939a admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:22:34.710593 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8783b2-4bf1-4872-bca5-018ae0cf939a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:22:34.712363 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8783b2-4bf1-4872-bca5-018ae0cf939a admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:22:34.722200 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1064/2108] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:22:34 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:22:34.726118 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd07feae-3e2f-4a62-b6fa-b7b72bb33f15 admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:22:34.736496 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd07feae-3e2f-4a62-b6fa-b7b72bb33f15 admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:22:34.741742 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd36f4aa-996a-42a2-9973-e197353a7d76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:22:34.743197 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd36f4aa-996a-42a2-9973-e197353a7d76 admin admin] REQUEST_METHOD: `PUT` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:22:34.743469 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd36f4aa-996a-42a2-9973-e197353a7d76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:22:34.743744 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd36f4aa-996a-42a2-9973-e197353a7d76 admin admin] PATH_INFO: `/v3/projects/22b9be650f294b5a87f6efef13ffbbb2/users/f4aa484c7e32432c9bad7b2d10eb5687/roles/5c07cf5bfbd3427db18428aa50420962` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:22:34.759000 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd36f4aa-996a-42a2-9973-e197353a7d76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22b9be650f294b5a87f6efef13ffbbb2, user_id=f4aa484c7e32432c9bad7b2d10eb5687, role_id=5c07cf5bfbd3427db18428aa50420962)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:22:34.761833 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd36f4aa-996a-42a2-9973-e197353a7d76 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:22:34.775163 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1045/2109] 10.222.0.70 () {60 vars in 1482 bytes} [Tue May 10 19:22:34 2022] PUT /identity/v3/projects/22b9be650f294b5a87f6efef13ffbbb2/users/f4aa484c7e32432c9bad7b2d10eb5687/roles/5c07cf5bfbd3427db18428aa50420962 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:22:34.786508 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bb651d-5ced-4cb8-bc0b-7c340fbc9dca None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:22:34.786799 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bb651d-5ced-4cb8-bc0b-7c340fbc9dca None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:22:34.787080 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bb651d-5ced-4cb8-bc0b-7c340fbc9dca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:22:34.813246 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-c2bb651d-5ced-4cb8-bc0b-7c340fbc9dca None None] MFA Rules not processed for user `f4aa484c7e32432c9bad7b2d10eb5687`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:22:34.814436 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-c2bb651d-5ced-4cb8-bc0b-7c340fbc9dca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:22:34.876972 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1065/2110] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:22:34 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:22:34.881260 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd36f4aa-996a-42a2-9973-e197353a7d76 admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:22:34.941254 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd36f4aa-996a-42a2-9973-e197353a7d76 admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:22:34.946214 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9f86cb-4142-4bb2-9e71-68ce3c15a5a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:22:34.947050 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9f86cb-4142-4bb2-9e71-68ce3c15a5a8 admin admin] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:22:34.947498 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9f86cb-4142-4bb2-9e71-68ce3c15a5a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:22:34.947934 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9f86cb-4142-4bb2-9e71-68ce3c15a5a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:22:34.949530 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9f86cb-4142-4bb2-9e71-68ce3c15a5a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:22:34.951681 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9f86cb-4142-4bb2-9e71-68ce3c15a5a8 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:22:34.978224 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1046/2111] 10.222.0.70 () {60 vars in 1152 bytes} [Tue May 10 19:22:34 2022] POST /identity/v3/projects => generated 381 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:22:34.982327 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bb651d-5ced-4cb8-bc0b-7c340fbc9dca None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:22:34.992874 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bb651d-5ced-4cb8-bc0b-7c340fbc9dca None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:22:35.047966 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ca528a-3ea8-4ea1-9bc6-1470f646f723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:22:35.048674 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ca528a-3ea8-4ea1-9bc6-1470f646f723 admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:22:35.048961 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ca528a-3ea8-4ea1-9bc6-1470f646f723 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:22:35.049236 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ca528a-3ea8-4ea1-9bc6-1470f646f723 admin admin] PATH_INFO: `/v3/users` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:22:35.049941 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ca528a-3ea8-4ea1-9bc6-1470f646f723 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:22:35.051845 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ca528a-3ea8-4ea1-9bc6-1470f646f723 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:22:35.073709 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1066/2112] 10.222.0.70 () {60 vars in 1143 bytes} [Tue May 10 19:22:34 2022] POST /identity/v3/users => generated 297 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 19:22:35.075088 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9f86cb-4142-4bb2-9e71-68ce3c15a5a8 admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:22:35.085185 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9f86cb-4142-4bb2-9e71-68ce3c15a5a8 admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:22:35.090348 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca62820-98e1-40ff-94ae-a186ac2857e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:22:35.091003 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca62820-98e1-40ff-94ae-a186ac2857e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:22:35.091286 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca62820-98e1-40ff-94ae-a186ac2857e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:22:35.091562 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca62820-98e1-40ff-94ae-a186ac2857e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:22:35.092279 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca62820-98e1-40ff-94ae-a186ac2857e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:22:35.093916 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca62820-98e1-40ff-94ae-a186ac2857e0 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:22:35.104638 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1047/2113] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:22:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:22:35.108679 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ca528a-3ea8-4ea1-9bc6-1470f646f723 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:22:35.118415 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ca528a-3ea8-4ea1-9bc6-1470f646f723 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:22:35.122908 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293950b1-a5d6-47c1-8aff-86793c041569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:22:35.123766 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293950b1-a5d6-47c1-8aff-86793c041569 admin admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:22:35.124063 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293950b1-a5d6-47c1-8aff-86793c041569 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:22:35.124333 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293950b1-a5d6-47c1-8aff-86793c041569 admin admin] PATH_INFO: `/v3/projects/b14ff610f27542fbb0daa5149014d887/users/69f45cd9290c4deeaee6ee92fa5d068b/roles/634ba284303b4626b5a0402772c68f5c` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:22:35.138177 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293950b1-a5d6-47c1-8aff-86793c041569 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b14ff610f27542fbb0daa5149014d887, user_id=69f45cd9290c4deeaee6ee92fa5d068b, role_id=634ba284303b4626b5a0402772c68f5c)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:22:35.144239 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293950b1-a5d6-47c1-8aff-86793c041569 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:22:35.155633 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1067/2114] 10.222.0.70 () {60 vars in 1482 bytes} [Tue May 10 19:22:35 2022] PUT /identity/v3/projects/b14ff610f27542fbb0daa5149014d887/users/69f45cd9290c4deeaee6ee92fa5d068b/roles/634ba284303b4626b5a0402772c68f5c => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:22:35.159897 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca62820-98e1-40ff-94ae-a186ac2857e0 admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:22:35.170460 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca62820-98e1-40ff-94ae-a186ac2857e0 admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:22:35.223817 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761adeb7-270e-472f-b81f-bc3b93b4fe85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:22:35.224500 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761adeb7-270e-472f-b81f-bc3b93b4fe85 admin admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:22:35.224796 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761adeb7-270e-472f-b81f-bc3b93b4fe85 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:22:35.225074 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761adeb7-270e-472f-b81f-bc3b93b4fe85 admin admin] PATH_INFO: `/v3/roles` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:22:35.226087 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761adeb7-270e-472f-b81f-bc3b93b4fe85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:22:35.227941 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761adeb7-270e-472f-b81f-bc3b93b4fe85 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:22:35.237292 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1048/2115] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:22:35 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:22:35.241417 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293950b1-a5d6-47c1-8aff-86793c041569 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:22:35.251365 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293950b1-a5d6-47c1-8aff-86793c041569 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:22:35.255933 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c47b59-67ed-43c1-a8dc-06f2bbf94e37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:22:35.256822 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c47b59-67ed-43c1-a8dc-06f2bbf94e37 admin admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:22:35.257101 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c47b59-67ed-43c1-a8dc-06f2bbf94e37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:22:35.257376 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c47b59-67ed-43c1-a8dc-06f2bbf94e37 admin admin] PATH_INFO: `/v3/projects/b14ff610f27542fbb0daa5149014d887/users/69f45cd9290c4deeaee6ee92fa5d068b/roles/634ba284303b4626b5a0402772c68f5c` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:22:35.259320 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c47b59-67ed-43c1-a8dc-06f2bbf94e37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b14ff610f27542fbb0daa5149014d887, user_id=69f45cd9290c4deeaee6ee92fa5d068b, role_id=634ba284303b4626b5a0402772c68f5c)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:22:35.261941 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c47b59-67ed-43c1-a8dc-06f2bbf94e37 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:22:35.271623 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1068/2116] 10.222.0.70 () {60 vars in 1482 bytes} [Tue May 10 19:22:35 2022] PUT /identity/v3/projects/b14ff610f27542fbb0daa5149014d887/users/69f45cd9290c4deeaee6ee92fa5d068b/roles/634ba284303b4626b5a0402772c68f5c => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:22:35.282233 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9d39c0-bf14-47f3-934c-0650e70c8442 None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:22:35.282691 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9d39c0-bf14-47f3-934c-0650e70c8442 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:22:35.282784 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9d39c0-bf14-47f3-934c-0650e70c8442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:22:35.308519 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-5a9d39c0-bf14-47f3-934c-0650e70c8442 None None] MFA Rules not processed for user `69f45cd9290c4deeaee6ee92fa5d068b`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:22:35.309744 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-5a9d39c0-bf14-47f3-934c-0650e70c8442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:22:35.374658 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1049/2117] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:22:35 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:22:35.386129 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c47b59-67ed-43c1-a8dc-06f2bbf94e37 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:22:35.388296 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-69c47b59-67ed-43c1-a8dc-06f2bbf94e37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:22:35.443430 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c47b59-67ed-43c1-a8dc-06f2bbf94e37 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:22:35.447630 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1137f8ad-4da7-4518-a042-1551c950818c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15df2a8967aa43299c10e365f4200d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:22:35.448266 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1137f8ad-4da7-4518-a042-1551c950818c service cinder] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:22:35.448577 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1137f8ad-4da7-4518-a042-1551c950818c service cinder] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:22:35.448852 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1137f8ad-4da7-4518-a042-1551c950818c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:22:35.458042 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1137f8ad-4da7-4518-a042-1551c950818c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:22:35.459454 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1137f8ad-4da7-4518-a042-1551c950818c service cinder] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:22:35.469292 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1069/2118] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:22:35 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:22:35.828115 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9d39c0-bf14-47f3-934c-0650e70c8442 None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:22:35.887416 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9d39c0-bf14-47f3-934c-0650e70c8442 None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:22:35.892076 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0799373-b718-4e5a-ad25-f63243620877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:22:35.892978 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0799373-b718-4e5a-ad25-f63243620877 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:22:35.893265 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0799373-b718-4e5a-ad25-f63243620877 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:22:35.893543 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0799373-b718-4e5a-ad25-f63243620877 admin admin] PATH_INFO: `/v3/users/f4aa484c7e32432c9bad7b2d10eb5687` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:22:35.894728 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0799373-b718-4e5a-ad25-f63243620877 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4aa484c7e32432c9bad7b2d10eb5687)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:22:35.896671 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0799373-b718-4e5a-ad25-f63243620877 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:22:35.941478 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-f0799373-b718-4e5a-ad25-f63243620877 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4aa484c7e32432c9bad7b2d10eb5687'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:22:35.953339 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-f0799373-b718-4e5a-ad25-f63243620877 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4aa484c7e32432c9bad7b2d10eb5687'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:22:35.959913 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-f0799373-b718-4e5a-ad25-f63243620877 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4aa484c7e32432c9bad7b2d10eb5687'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:22:35.961199 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-f0799373-b718-4e5a-ad25-f63243620877 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4aa484c7e32432c9bad7b2d10eb5687'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:22:35.968197 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-f0799373-b718-4e5a-ad25-f63243620877 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4aa484c7e32432c9bad7b2d10eb5687'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:22:35.974011 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1050/2119] 10.222.0.70 () {58 vars in 1223 bytes} [Tue May 10 19:22:35 2022] DELETE /identity/v3/users/f4aa484c7e32432c9bad7b2d10eb5687 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:22:35.979054 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee9ad6f-e778-4c82-8f47-2593aaef72bc None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:22:35.979348 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee9ad6f-e778-4c82-8f47-2593aaef72bc None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:22:35.979628 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee9ad6f-e778-4c82-8f47-2593aaef72bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:22:35.996952 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-eee9ad6f-e778-4c82-8f47-2593aaef72bc None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:22:35.998126 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-eee9ad6f-e778-4c82-8f47-2593aaef72bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:22:36.056288 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1070/2120] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:22:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:22:36.066686 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0799373-b718-4e5a-ad25-f63243620877 admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:22:36.068143 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-f0799373-b718-4e5a-ad25-f63243620877 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:22:36.125427 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0799373-b718-4e5a-ad25-f63243620877 admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:22:36.129216 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f2d0c2-2b88-46bd-95c6-6cd68ba19fda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f1dc79540b48c0866478cc48cd8205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:22:36.129868 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f2d0c2-2b88-46bd-95c6-6cd68ba19fda service neutron] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:22:36.130155 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f2d0c2-2b88-46bd-95c6-6cd68ba19fda service neutron] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:22:36.130431 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f2d0c2-2b88-46bd-95c6-6cd68ba19fda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:22:36.140310 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f2d0c2-2b88-46bd-95c6-6cd68ba19fda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:22:36.141782 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f2d0c2-2b88-46bd-95c6-6cd68ba19fda service neutron] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:22:36.151593 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1051/2121] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:22:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:22:36.419872 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee9ad6f-e778-4c82-8f47-2593aaef72bc None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:22:36.421606 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-eee9ad6f-e778-4c82-8f47-2593aaef72bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:22:36.444403 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee9ad6f-e778-4c82-8f47-2593aaef72bc None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:22:36.456702 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27a20ab-70fa-45fc-b6a9-b396b31bfb0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:22:36.457651 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27a20ab-70fa-45fc-b6a9-b396b31bfb0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:22:36.458056 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27a20ab-70fa-45fc-b6a9-b396b31bfb0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:22:36.458338 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27a20ab-70fa-45fc-b6a9-b396b31bfb0b admin admin] PATH_INFO: `/v3/projects/22b9be650f294b5a87f6efef13ffbbb2` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:22:36.459581 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27a20ab-70fa-45fc-b6a9-b396b31bfb0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=22b9be650f294b5a87f6efef13ffbbb2)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:22:36.462822 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27a20ab-70fa-45fc-b6a9-b396b31bfb0b admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:22:36.507963 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-c27a20ab-70fa-45fc-b6a9-b396b31bfb0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22b9be650f294b5a87f6efef13ffbbb2', 'request_id': 'req-c27a20ab-70fa-45fc-b6a9-b396b31bfb0b'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:22:36.513309 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-c27a20ab-70fa-45fc-b6a9-b396b31bfb0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22b9be650f294b5a87f6efef13ffbbb2', 'request_id': 'req-c27a20ab-70fa-45fc-b6a9-b396b31bfb0b'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:22:36.521143 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-c27a20ab-70fa-45fc-b6a9-b396b31bfb0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22b9be650f294b5a87f6efef13ffbbb2', 'request_id': 'req-c27a20ab-70fa-45fc-b6a9-b396b31bfb0b'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:22:36.532540 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-c27a20ab-70fa-45fc-b6a9-b396b31bfb0b admin admin] The token cache is being invalidate because project 22b9be650f294b5a87f6efef13ffbbb2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79994) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:22:36.532825 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-c27a20ab-70fa-45fc-b6a9-b396b31bfb0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:22:36.533471 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-c27a20ab-70fa-45fc-b6a9-b396b31bfb0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:22:36.535006 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1071/2122] 10.222.0.70 () {58 vars in 1232 bytes} [Tue May 10 19:22:36 2022] DELETE /identity/v3/projects/22b9be650f294b5a87f6efef13ffbbb2 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:22:36.539018 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f2d0c2-2b88-46bd-95c6-6cd68ba19fda service neutron] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:22:36.548705 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f2d0c2-2b88-46bd-95c6-6cd68ba19fda service neutron] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:22:36.606397 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7481e4cf-cf23-4df1-8f2c-24fc027694e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:22:36.607201 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7481e4cf-cf23-4df1-8f2c-24fc027694e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:22:36.607482 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7481e4cf-cf23-4df1-8f2c-24fc027694e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:22:36.607756 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7481e4cf-cf23-4df1-8f2c-24fc027694e5 admin admin] PATH_INFO: `/v3/users/69f45cd9290c4deeaee6ee92fa5d068b` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:22:36.608961 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7481e4cf-cf23-4df1-8f2c-24fc027694e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=69f45cd9290c4deeaee6ee92fa5d068b)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:22:36.610871 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7481e4cf-cf23-4df1-8f2c-24fc027694e5 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:22:36.660523 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-7481e4cf-cf23-4df1-8f2c-24fc027694e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69f45cd9290c4deeaee6ee92fa5d068b'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:22:36.675264 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-7481e4cf-cf23-4df1-8f2c-24fc027694e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69f45cd9290c4deeaee6ee92fa5d068b'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:22:36.685439 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-7481e4cf-cf23-4df1-8f2c-24fc027694e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69f45cd9290c4deeaee6ee92fa5d068b'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:22:36.685817 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-7481e4cf-cf23-4df1-8f2c-24fc027694e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69f45cd9290c4deeaee6ee92fa5d068b'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:22:36.694413 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-7481e4cf-cf23-4df1-8f2c-24fc027694e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69f45cd9290c4deeaee6ee92fa5d068b'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:22:36.703020 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1052/2123] 10.222.0.70 () {58 vars in 1223 bytes} [Tue May 10 19:22:36 2022] DELETE /identity/v3/users/69f45cd9290c4deeaee6ee92fa5d068b => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:22:36.987315 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27a20ab-70fa-45fc-b6a9-b396b31bfb0b admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:22:36.988786 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-c27a20ab-70fa-45fc-b6a9-b396b31bfb0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:22:37.004264 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27a20ab-70fa-45fc-b6a9-b396b31bfb0b admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:22:37.065017 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108ba373-2ad8-46b9-85c7-f97fea6256b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:22:37.066002 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108ba373-2ad8-46b9-85c7-f97fea6256b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:22:37.066284 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108ba373-2ad8-46b9-85c7-f97fea6256b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:22:37.066582 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108ba373-2ad8-46b9-85c7-f97fea6256b3 admin admin] PATH_INFO: `/v3/projects/b14ff610f27542fbb0daa5149014d887` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:22:37.067875 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108ba373-2ad8-46b9-85c7-f97fea6256b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b14ff610f27542fbb0daa5149014d887)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:22:37.070222 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108ba373-2ad8-46b9-85c7-f97fea6256b3 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:22:37.118982 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-108ba373-2ad8-46b9-85c7-f97fea6256b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b14ff610f27542fbb0daa5149014d887', 'request_id': 'req-108ba373-2ad8-46b9-85c7-f97fea6256b3'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:22:37.124069 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-108ba373-2ad8-46b9-85c7-f97fea6256b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b14ff610f27542fbb0daa5149014d887', 'request_id': 'req-108ba373-2ad8-46b9-85c7-f97fea6256b3'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:22:37.131031 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-108ba373-2ad8-46b9-85c7-f97fea6256b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b14ff610f27542fbb0daa5149014d887', 'request_id': 'req-108ba373-2ad8-46b9-85c7-f97fea6256b3'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:22:37.141613 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-108ba373-2ad8-46b9-85c7-f97fea6256b3 admin admin] The token cache is being invalidate because project b14ff610f27542fbb0daa5149014d887 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79994) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:22:37.141896 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-108ba373-2ad8-46b9-85c7-f97fea6256b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:22:37.142513 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-108ba373-2ad8-46b9-85c7-f97fea6256b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:22:37.144035 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1072/2124] 10.222.0.70 () {58 vars in 1232 bytes} [Tue May 10 19:22:36 2022] DELETE /identity/v3/projects/b14ff610f27542fbb0daa5149014d887 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:22:37.149159 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225e0796-4951-4c01-8c6b-db9319ce1681 None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:22:37.149499 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225e0796-4951-4c01-8c6b-db9319ce1681 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:22:37.149781 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225e0796-4951-4c01-8c6b-db9319ce1681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:22:37.167431 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-225e0796-4951-4c01-8c6b-db9319ce1681 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:22:37.168669 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-225e0796-4951-4c01-8c6b-db9319ce1681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:22:37.227613 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1053/2125] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:22:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:22:37.237153 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d605ae5f-2281-45e6-b87c-e795da6cdecb None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:22:37.237399 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d605ae5f-2281-45e6-b87c-e795da6cdecb None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:22:37.237670 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d605ae5f-2281-45e6-b87c-e795da6cdecb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:22:37.256762 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-d605ae5f-2281-45e6-b87c-e795da6cdecb None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:22:37.257430 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-d605ae5f-2281-45e6-b87c-e795da6cdecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:22:37.267480 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1073/2126] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:22:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:22:37.272078 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225e0796-4951-4c01-8c6b-db9319ce1681 None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:22:37.282667 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225e0796-4951-4c01-8c6b-db9319ce1681 None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:22:37.287928 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4a6435-46b8-47b0-84a0-13e99fd9ca67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:22:37.288644 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4a6435-46b8-47b0-84a0-13e99fd9ca67 admin admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:22:37.290165 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4a6435-46b8-47b0-84a0-13e99fd9ca67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:22:37.290165 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4a6435-46b8-47b0-84a0-13e99fd9ca67 admin admin] PATH_INFO: `/v3/domains` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:22:37.290780 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4a6435-46b8-47b0-84a0-13e99fd9ca67 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:22:37.291227 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4a6435-46b8-47b0-84a0-13e99fd9ca67 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:22:37.292903 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4a6435-46b8-47b0-84a0-13e99fd9ca67 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:22:37.305785 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1054/2127] 10.222.0.70 () {58 vars in 1152 bytes} [Tue May 10 19:22:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:22:37.310107 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d605ae5f-2281-45e6-b87c-e795da6cdecb None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:22:37.319485 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d605ae5f-2281-45e6-b87c-e795da6cdecb None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:22:37.325270 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c583cd1e-7ac9-4715-b6aa-88a5be0eb2c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:22:37.326233 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c583cd1e-7ac9-4715-b6aa-88a5be0eb2c5 admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:22:37.326703 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c583cd1e-7ac9-4715-b6aa-88a5be0eb2c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:22:37.327219 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c583cd1e-7ac9-4715-b6aa-88a5be0eb2c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:22:37.328089 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c583cd1e-7ac9-4715-b6aa-88a5be0eb2c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:22:37.330569 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c583cd1e-7ac9-4715-b6aa-88a5be0eb2c5 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:22:37.368978 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1074/2128] 10.222.0.70 () {60 vars in 1152 bytes} [Tue May 10 19:22:37 2022] POST /identity/v3/projects => generated 371 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:22:37.373684 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4a6435-46b8-47b0-84a0-13e99fd9ca67 admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:22:37.384565 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4a6435-46b8-47b0-84a0-13e99fd9ca67 admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:22:37.445714 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91568686-a02a-4330-b47b-d0431faa0ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:22:37.446772 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91568686-a02a-4330-b47b-d0431faa0ec9 admin admin] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:22:37.447064 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91568686-a02a-4330-b47b-d0431faa0ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:22:37.447341 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91568686-a02a-4330-b47b-d0431faa0ec9 admin admin] PATH_INFO: `/v3/users` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:22:37.448043 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91568686-a02a-4330-b47b-d0431faa0ec9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:22:37.450330 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91568686-a02a-4330-b47b-d0431faa0ec9 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:22:37.471186 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1055/2129] 10.222.0.70 () {60 vars in 1143 bytes} [Tue May 10 19:22:37 2022] POST /identity/v3/users => generated 286 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:22:37.475288 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c583cd1e-7ac9-4715-b6aa-88a5be0eb2c5 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:22:37.486230 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c583cd1e-7ac9-4715-b6aa-88a5be0eb2c5 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:22:37.491364 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ec0f26-3dd5-4ee4-9fff-86f0c0f57776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:22:37.492685 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ec0f26-3dd5-4ee4-9fff-86f0c0f57776 admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:22:37.493033 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ec0f26-3dd5-4ee4-9fff-86f0c0f57776 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:22:37.493396 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ec0f26-3dd5-4ee4-9fff-86f0c0f57776 admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:22:37.494218 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ec0f26-3dd5-4ee4-9fff-86f0c0f57776 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:22:37.495868 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ec0f26-3dd5-4ee4-9fff-86f0c0f57776 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:22:37.506454 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1075/2130] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:22:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:22:37.512778 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91568686-a02a-4330-b47b-d0431faa0ec9 admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:22:37.526563 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91568686-a02a-4330-b47b-d0431faa0ec9 admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:22:37.531213 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34aed19-6023-44d1-ba60-41f0ddecfbe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:22:37.531882 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34aed19-6023-44d1-ba60-41f0ddecfbe9 admin admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:22:37.532167 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34aed19-6023-44d1-ba60-41f0ddecfbe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:22:37.532467 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34aed19-6023-44d1-ba60-41f0ddecfbe9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:22:37.533197 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34aed19-6023-44d1-ba60-41f0ddecfbe9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:22:37.535066 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34aed19-6023-44d1-ba60-41f0ddecfbe9 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:22:37.546937 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1056/2131] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:22:37 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:22:37.551363 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ec0f26-3dd5-4ee4-9fff-86f0c0f57776 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:22:37.562589 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ec0f26-3dd5-4ee4-9fff-86f0c0f57776 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:22:37.567800 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62983f2-8d0b-41ab-88b4-e1896ebd10f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:22:37.568811 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62983f2-8d0b-41ab-88b4-e1896ebd10f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:22:37.569114 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62983f2-8d0b-41ab-88b4-e1896ebd10f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:22:37.569381 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62983f2-8d0b-41ab-88b4-e1896ebd10f9 admin admin] PATH_INFO: `/v3/projects/055ce91938ab45018f4e259e45b3fac5/users/f05fe3e228ce4650acdfc041aa89e030/roles/5c07cf5bfbd3427db18428aa50420962` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:22:37.590006 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62983f2-8d0b-41ab-88b4-e1896ebd10f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=055ce91938ab45018f4e259e45b3fac5, user_id=f05fe3e228ce4650acdfc041aa89e030, role_id=5c07cf5bfbd3427db18428aa50420962)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:22:37.591895 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62983f2-8d0b-41ab-88b4-e1896ebd10f9 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:22:37.606843 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1076/2132] 10.222.0.70 () {60 vars in 1482 bytes} [Tue May 10 19:22:37 2022] PUT /identity/v3/projects/055ce91938ab45018f4e259e45b3fac5/users/f05fe3e228ce4650acdfc041aa89e030/roles/5c07cf5bfbd3427db18428aa50420962 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 19:22:37.611653 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105572b0-7daf-4c83-af39-331c81c0f57f None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:22:37.611945 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105572b0-7daf-4c83-af39-331c81c0f57f None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:22:37.612223 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105572b0-7daf-4c83-af39-331c81c0f57f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:22:37.629579 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-105572b0-7daf-4c83-af39-331c81c0f57f None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:22:37.630691 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-105572b0-7daf-4c83-af39-331c81c0f57f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:22:37.690695 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1057/2133] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:22:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:22:37.700792 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62983f2-8d0b-41ab-88b4-e1896ebd10f9 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:22:37.702537 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-a62983f2-8d0b-41ab-88b4-e1896ebd10f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:22:37.765682 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62983f2-8d0b-41ab-88b4-e1896ebd10f9 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:22:37.772291 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358d756d-6f56-46a9-8d9d-3ac9afcc0965 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f1dc79540b48c0866478cc48cd8205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:22:37.773100 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358d756d-6f56-46a9-8d9d-3ac9afcc0965 service neutron] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:22:37.773993 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358d756d-6f56-46a9-8d9d-3ac9afcc0965 service neutron] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:22:37.774274 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358d756d-6f56-46a9-8d9d-3ac9afcc0965 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:22:37.785402 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358d756d-6f56-46a9-8d9d-3ac9afcc0965 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:22:37.786930 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358d756d-6f56-46a9-8d9d-3ac9afcc0965 service neutron] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:22:37.802528 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1077/2134] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:22:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:22:38.651406 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92f0464-abe4-44fc-a953-ee4c645b3ea7 None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:22:38.651936 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92f0464-abe4-44fc-a953-ee4c645b3ea7 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:22:38.651936 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92f0464-abe4-44fc-a953-ee4c645b3ea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:22:38.679801 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-b92f0464-abe4-44fc-a953-ee4c645b3ea7 None None] MFA Rules not processed for user `f05fe3e228ce4650acdfc041aa89e030`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:22:38.681091 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-b92f0464-abe4-44fc-a953-ee4c645b3ea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:22:38.743760 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1058/2135] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:22:38 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:22:38.754435 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358d756d-6f56-46a9-8d9d-3ac9afcc0965 service neutron] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:22:38.755846 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-358d756d-6f56-46a9-8d9d-3ac9afcc0965 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:22:38.810920 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358d756d-6f56-46a9-8d9d-3ac9afcc0965 service neutron] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:22:38.814633 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60f6b51-a8b4-4d2a-adcf-0b2d2ebe2058 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15df2a8967aa43299c10e365f4200d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:22:38.815308 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60f6b51-a8b4-4d2a-adcf-0b2d2ebe2058 service cinder] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:22:38.815592 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60f6b51-a8b4-4d2a-adcf-0b2d2ebe2058 service cinder] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:22:38.815865 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60f6b51-a8b4-4d2a-adcf-0b2d2ebe2058 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:22:38.826458 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60f6b51-a8b4-4d2a-adcf-0b2d2ebe2058 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:22:38.827889 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60f6b51-a8b4-4d2a-adcf-0b2d2ebe2058 service cinder] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:22:38.836486 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1078/2136] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:22:38 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:22:41.229971 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aec8571-e9b3-4662-aef9-b66f04eb45cf None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:22:41.230483 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aec8571-e9b3-4662-aef9-b66f04eb45cf None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:22:41.230577 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aec8571-e9b3-4662-aef9-b66f04eb45cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:22:41.248234 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-5aec8571-e9b3-4662-aef9-b66f04eb45cf None None] MFA Rules not processed for user `f05fe3e228ce4650acdfc041aa89e030`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:22:41.249446 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-5aec8571-e9b3-4662-aef9-b66f04eb45cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:22:41.256364 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1059/2137] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:22:41 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:22:45.432918 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60f6b51-a8b4-4d2a-adcf-0b2d2ebe2058 service cinder] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:22:45.434877 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-b60f6b51-a8b4-4d2a-adcf-0b2d2ebe2058 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:22:45.457688 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60f6b51-a8b4-4d2a-adcf-0b2d2ebe2058 service cinder] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:22:45.462862 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb776ae-0837-4d88-92fb-95711fc98f1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:22:45.463738 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb776ae-0837-4d88-92fb-95711fc98f1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:22:45.464297 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb776ae-0837-4d88-92fb-95711fc98f1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:22:45.464801 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb776ae-0837-4d88-92fb-95711fc98f1b admin admin] PATH_INFO: `/v3/users/deb80ecbef784e2584a3a575e9ad852e` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:22:45.466189 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb776ae-0837-4d88-92fb-95711fc98f1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=deb80ecbef784e2584a3a575e9ad852e)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:22:45.469235 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb776ae-0837-4d88-92fb-95711fc98f1b admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:22:45.531894 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-bcb776ae-0837-4d88-92fb-95711fc98f1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'deb80ecbef784e2584a3a575e9ad852e'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:22:45.548241 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-bcb776ae-0837-4d88-92fb-95711fc98f1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'deb80ecbef784e2584a3a575e9ad852e'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:22:45.549661 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-bcb776ae-0837-4d88-92fb-95711fc98f1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'deb80ecbef784e2584a3a575e9ad852e'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:22:45.557801 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-bcb776ae-0837-4d88-92fb-95711fc98f1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'deb80ecbef784e2584a3a575e9ad852e'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:22:45.565147 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-bcb776ae-0837-4d88-92fb-95711fc98f1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'deb80ecbef784e2584a3a575e9ad852e'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:22:45.572775 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1079/2138] 10.222.0.70 () {58 vars in 1223 bytes} [Tue May 10 19:22:45 2022] DELETE /identity/v3/users/deb80ecbef784e2584a3a575e9ad852e => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:22:45.581245 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431eeb27-90d3-4021-b7db-abafb1d1df7b None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:22:45.581245 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431eeb27-90d3-4021-b7db-abafb1d1df7b None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:22:45.581245 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431eeb27-90d3-4021-b7db-abafb1d1df7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:22:45.598265 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-431eeb27-90d3-4021-b7db-abafb1d1df7b None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:22:45.599465 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-431eeb27-90d3-4021-b7db-abafb1d1df7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:22:45.662384 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1060/2139] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:22:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:22:45.672686 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb776ae-0837-4d88-92fb-95711fc98f1b admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:22:45.675113 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-bcb776ae-0837-4d88-92fb-95711fc98f1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:22:45.736700 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb776ae-0837-4d88-92fb-95711fc98f1b admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:22:45.741105 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c590c98-f2c8-4940-8337-4cfd33187dbe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f1dc79540b48c0866478cc48cd8205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:22:45.742310 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c590c98-f2c8-4940-8337-4cfd33187dbe service neutron] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:22:45.742895 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c590c98-f2c8-4940-8337-4cfd33187dbe service neutron] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:22:45.743182 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c590c98-f2c8-4940-8337-4cfd33187dbe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:22:45.753047 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c590c98-f2c8-4940-8337-4cfd33187dbe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:22:45.754582 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c590c98-f2c8-4940-8337-4cfd33187dbe service neutron] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:22:45.764944 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1080/2140] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:22:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:22:46.143448 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431eeb27-90d3-4021-b7db-abafb1d1df7b None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:22:46.145311 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-431eeb27-90d3-4021-b7db-abafb1d1df7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:22:46.160678 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431eeb27-90d3-4021-b7db-abafb1d1df7b None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:22:46.169064 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab78c61-dd6c-46a7-bd52-7538a720e2c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:22:46.170251 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab78c61-dd6c-46a7-bd52-7538a720e2c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:22:46.170539 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab78c61-dd6c-46a7-bd52-7538a720e2c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:22:46.170897 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab78c61-dd6c-46a7-bd52-7538a720e2c7 admin admin] PATH_INFO: `/v3/projects/f88cdfa3e6e54e0c9d4fe9bc173db57f` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:22:46.172117 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab78c61-dd6c-46a7-bd52-7538a720e2c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f88cdfa3e6e54e0c9d4fe9bc173db57f)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:22:46.175847 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab78c61-dd6c-46a7-bd52-7538a720e2c7 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:22:46.246073 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-4ab78c61-dd6c-46a7-bd52-7538a720e2c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f88cdfa3e6e54e0c9d4fe9bc173db57f', 'request_id': 'req-4ab78c61-dd6c-46a7-bd52-7538a720e2c7'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:22:46.254896 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-4ab78c61-dd6c-46a7-bd52-7538a720e2c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f88cdfa3e6e54e0c9d4fe9bc173db57f', 'request_id': 'req-4ab78c61-dd6c-46a7-bd52-7538a720e2c7'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:22:46.266749 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-4ab78c61-dd6c-46a7-bd52-7538a720e2c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f88cdfa3e6e54e0c9d4fe9bc173db57f', 'request_id': 'req-4ab78c61-dd6c-46a7-bd52-7538a720e2c7'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:22:46.279974 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-4ab78c61-dd6c-46a7-bd52-7538a720e2c7 admin admin] The token cache is being invalidate because project f88cdfa3e6e54e0c9d4fe9bc173db57f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79993) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:22:46.280281 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-4ab78c61-dd6c-46a7-bd52-7538a720e2c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:22:46.280940 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-4ab78c61-dd6c-46a7-bd52-7538a720e2c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:22:46.282521 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1061/2141] 10.222.0.70 () {58 vars in 1232 bytes} [Tue May 10 19:22:46 2022] DELETE /identity/v3/projects/f88cdfa3e6e54e0c9d4fe9bc173db57f => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:22:56.352058 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561151f0-e829-4beb-a2bf-fa844136c0d2 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:22:56.352557 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561151f0-e829-4beb-a2bf-fa844136c0d2 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:22:56.352647 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561151f0-e829-4beb-a2bf-fa844136c0d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:22:56.380516 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-561151f0-e829-4beb-a2bf-fa844136c0d2 None None] MFA Rules not processed for user `058e52f1bf0b4aba965d945815d4acb3`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:22:56.381700 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-561151f0-e829-4beb-a2bf-fa844136c0d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:22:56.463590 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1081/2142] 10.222.0.70 () {58 vars in 1009 bytes} [Tue May 10 19:22:56 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:22:56.509389 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab78c61-dd6c-46a7-bd52-7538a720e2c7 admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:22:56.510891 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-4ab78c61-dd6c-46a7-bd52-7538a720e2c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:22:56.602543 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab78c61-dd6c-46a7-bd52-7538a720e2c7 admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:22:56.608653 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2488e396-a372-4bf7-8d13-7a7de207ed19 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0454aa03fa31487ea1464b9d0008212c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:22:56.609335 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2488e396-a372-4bf7-8d13-7a7de207ed19 service swift] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:22:56.609614 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2488e396-a372-4bf7-8d13-7a7de207ed19 service swift] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:22:56.609886 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2488e396-a372-4bf7-8d13-7a7de207ed19 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:22:56.618791 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2488e396-a372-4bf7-8d13-7a7de207ed19 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:22:56.620646 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2488e396-a372-4bf7-8d13-7a7de207ed19 service swift] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:22:56.628937 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1062/2143] 10.222.0.70 () {60 vars in 1384 bytes} [Tue May 10 19:22:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 10 19:22:57.170779 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1204b4d5-952d-45ab-84c9-c7859e1f3170 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:22:57.171071 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1204b4d5-952d-45ab-84c9-c7859e1f3170 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:22:57.171348 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1204b4d5-952d-45ab-84c9-c7859e1f3170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:22:57.189121 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-1204b4d5-952d-45ab-84c9-c7859e1f3170 None None] MFA Rules not processed for user `058e52f1bf0b4aba965d945815d4acb3`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:22:57.190316 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-1204b4d5-952d-45ab-84c9-c7859e1f3170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:22:57.199179 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1082/2144] 10.222.0.70 () {58 vars in 967 bytes} [Tue May 10 19:22:57 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:22:57.211875 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2488e396-a372-4bf7-8d13-7a7de207ed19 service swift] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:22:57.222186 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2488e396-a372-4bf7-8d13-7a7de207ed19 service swift] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:22:57.227196 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6371f7-2857-408a-b49e-7f993e9f4ce5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0454aa03fa31487ea1464b9d0008212c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:22:57.227824 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6371f7-2857-408a-b49e-7f993e9f4ce5 service swift] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:22:57.228108 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6371f7-2857-408a-b49e-7f993e9f4ce5 service swift] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:22:57.228384 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6371f7-2857-408a-b49e-7f993e9f4ce5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:22:57.236238 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6371f7-2857-408a-b49e-7f993e9f4ce5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:22:57.237930 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6371f7-2857-408a-b49e-7f993e9f4ce5 service swift] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:22:57.247363 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1063/2145] 10.222.0.70 () {60 vars in 1384 bytes} [Tue May 10 19:22:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 19:22:57.443573 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bf6e8d-7f27-42d0-9e8e-5b4898e7b32b None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:22:57.444064 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bf6e8d-7f27-42d0-9e8e-5b4898e7b32b None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:22:57.444823 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bf6e8d-7f27-42d0-9e8e-5b4898e7b32b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:22:57.464120 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-e2bf6e8d-7f27-42d0-9e8e-5b4898e7b32b None None] MFA Rules not processed for user `058e52f1bf0b4aba965d945815d4acb3`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:22:57.465344 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-e2bf6e8d-7f27-42d0-9e8e-5b4898e7b32b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:22:57.476813 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1083/2146] 10.222.0.70 () {58 vars in 1009 bytes} [Tue May 10 19:22:57 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:22:57.488720 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6371f7-2857-408a-b49e-7f993e9f4ce5 service swift] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:22:57.499237 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6371f7-2857-408a-b49e-7f993e9f4ce5 service swift] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:22:57.504901 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e7cfe9-551e-403c-859d-472b46338645 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0454aa03fa31487ea1464b9d0008212c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:22:57.505551 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e7cfe9-551e-403c-859d-472b46338645 service swift] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:22:57.505836 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e7cfe9-551e-403c-859d-472b46338645 service swift] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:22:57.506111 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e7cfe9-551e-403c-859d-472b46338645 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:22:57.515056 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e7cfe9-551e-403c-859d-472b46338645 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:22:57.516701 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e7cfe9-551e-403c-859d-472b46338645 service swift] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:22:57.525155 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1064/2147] 10.222.0.70 () {60 vars in 1384 bytes} [Tue May 10 19:22:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 19:22:57.862044 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7f2198-b853-4e0b-914c-6fe9e54c9625 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:22:57.862369 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7f2198-b853-4e0b-914c-6fe9e54c9625 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:22:57.862650 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7f2198-b853-4e0b-914c-6fe9e54c9625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:22:57.880368 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-cc7f2198-b853-4e0b-914c-6fe9e54c9625 None None] MFA Rules not processed for user `058e52f1bf0b4aba965d945815d4acb3`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:22:57.881596 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-cc7f2198-b853-4e0b-914c-6fe9e54c9625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:22:57.888781 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1084/2148] 10.222.0.70 () {58 vars in 967 bytes} [Tue May 10 19:22:57 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:22:57.901609 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e7cfe9-551e-403c-859d-472b46338645 service swift] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:22:57.911945 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e7cfe9-551e-403c-859d-472b46338645 service swift] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:22:57.917154 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cc2a78-8195-4a1e-8587-2343069f4be9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0454aa03fa31487ea1464b9d0008212c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:22:57.917792 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cc2a78-8195-4a1e-8587-2343069f4be9 service swift] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:22:57.918106 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cc2a78-8195-4a1e-8587-2343069f4be9 service swift] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:22:57.918380 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cc2a78-8195-4a1e-8587-2343069f4be9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:22:57.926343 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cc2a78-8195-4a1e-8587-2343069f4be9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:22:57.927918 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cc2a78-8195-4a1e-8587-2343069f4be9 service swift] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:22:57.936149 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1065/2149] 10.222.0.70 () {60 vars in 1384 bytes} [Tue May 10 19:22:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 19:23:00.003814 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7f2198-b853-4e0b-914c-6fe9e54c9625 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:23:00.005279 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-cc7f2198-b853-4e0b-914c-6fe9e54c9625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:23:00.099392 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7f2198-b853-4e0b-914c-6fe9e54c9625 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:23:00.103916 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612f3ed2-80e2-43ac-9e14-8cd128f0abe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:23:00.104835 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612f3ed2-80e2-43ac-9e14-8cd128f0abe0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:23:00.105111 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612f3ed2-80e2-43ac-9e14-8cd128f0abe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:23:00.105384 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612f3ed2-80e2-43ac-9e14-8cd128f0abe0 admin admin] PATH_INFO: `/v3/users/0c773c840a8445e9bda1fd365a485e2e` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:23:00.106601 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612f3ed2-80e2-43ac-9e14-8cd128f0abe0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c773c840a8445e9bda1fd365a485e2e)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:23:00.108611 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612f3ed2-80e2-43ac-9e14-8cd128f0abe0 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:23:00.154988 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-612f3ed2-80e2-43ac-9e14-8cd128f0abe0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c773c840a8445e9bda1fd365a485e2e'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:23:00.167723 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-612f3ed2-80e2-43ac-9e14-8cd128f0abe0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c773c840a8445e9bda1fd365a485e2e'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:23:00.168384 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-612f3ed2-80e2-43ac-9e14-8cd128f0abe0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c773c840a8445e9bda1fd365a485e2e'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:23:00.175351 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-612f3ed2-80e2-43ac-9e14-8cd128f0abe0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c773c840a8445e9bda1fd365a485e2e'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:23:00.181906 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-612f3ed2-80e2-43ac-9e14-8cd128f0abe0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c773c840a8445e9bda1fd365a485e2e'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:23:00.187515 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1085/2150] 10.222.0.70 () {58 vars in 1223 bytes} [Tue May 10 19:23:00 2022] DELETE /identity/v3/users/0c773c840a8445e9bda1fd365a485e2e => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 19:23:00.192127 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56230189-3d47-43d0-8872-38974b7a4022 None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:23:00.192824 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56230189-3d47-43d0-8872-38974b7a4022 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:23:00.192824 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56230189-3d47-43d0-8872-38974b7a4022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:23:00.227056 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-56230189-3d47-43d0-8872-38974b7a4022 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:23:00.228170 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-56230189-3d47-43d0-8872-38974b7a4022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:23:00.285817 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1066/2151] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:23:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:23:00.295800 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612f3ed2-80e2-43ac-9e14-8cd128f0abe0 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:23:00.297641 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-612f3ed2-80e2-43ac-9e14-8cd128f0abe0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:23:00.374312 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612f3ed2-80e2-43ac-9e14-8cd128f0abe0 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:23:00.378004 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1f6563-3c18-4b1b-94ab-44b9fa76e620 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f1dc79540b48c0866478cc48cd8205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:23:00.378641 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1f6563-3c18-4b1b-94ab-44b9fa76e620 service neutron] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:23:00.378926 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1f6563-3c18-4b1b-94ab-44b9fa76e620 service neutron] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:23:00.379204 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1f6563-3c18-4b1b-94ab-44b9fa76e620 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:23:00.387960 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1f6563-3c18-4b1b-94ab-44b9fa76e620 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:23:00.389417 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1f6563-3c18-4b1b-94ab-44b9fa76e620 service neutron] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:23:00.399800 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1086/2152] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:23:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:23:00.579760 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56230189-3d47-43d0-8872-38974b7a4022 None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:23:00.581738 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-56230189-3d47-43d0-8872-38974b7a4022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:23:00.596497 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56230189-3d47-43d0-8872-38974b7a4022 None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:23:00.617324 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc213973-61b0-4e3a-9b7d-686bdb632862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:23:00.618224 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc213973-61b0-4e3a-9b7d-686bdb632862 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:23:00.618576 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc213973-61b0-4e3a-9b7d-686bdb632862 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:23:00.618716 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc213973-61b0-4e3a-9b7d-686bdb632862 admin admin] PATH_INFO: `/v3/projects/7423397f1a9546bbb64a843b37d62213` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:23:00.620367 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc213973-61b0-4e3a-9b7d-686bdb632862 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7423397f1a9546bbb64a843b37d62213)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:23:00.622622 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc213973-61b0-4e3a-9b7d-686bdb632862 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:23:00.676975 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-dc213973-61b0-4e3a-9b7d-686bdb632862 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7423397f1a9546bbb64a843b37d62213', 'request_id': 'req-dc213973-61b0-4e3a-9b7d-686bdb632862'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:23:00.683661 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-dc213973-61b0-4e3a-9b7d-686bdb632862 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7423397f1a9546bbb64a843b37d62213', 'request_id': 'req-dc213973-61b0-4e3a-9b7d-686bdb632862'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:23:00.693060 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-dc213973-61b0-4e3a-9b7d-686bdb632862 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7423397f1a9546bbb64a843b37d62213', 'request_id': 'req-dc213973-61b0-4e3a-9b7d-686bdb632862'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:23:00.706298 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-dc213973-61b0-4e3a-9b7d-686bdb632862 admin admin] The token cache is being invalidate because project 7423397f1a9546bbb64a843b37d62213 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79993) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:23:00.706612 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-dc213973-61b0-4e3a-9b7d-686bdb632862 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:23:00.707256 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-dc213973-61b0-4e3a-9b7d-686bdb632862 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:23:00.708894 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1067/2153] 10.222.0.70 () {58 vars in 1232 bytes} [Tue May 10 19:23:00 2022] DELETE /identity/v3/projects/7423397f1a9546bbb64a843b37d62213 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:23:00.714253 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf350dc-0e7b-4f55-a058-890fe84fc323 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:23:00.714542 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf350dc-0e7b-4f55-a058-890fe84fc323 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:23:00.714816 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf350dc-0e7b-4f55-a058-890fe84fc323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:23:00.751135 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-3bf350dc-0e7b-4f55-a058-890fe84fc323 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:23:00.752244 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-3bf350dc-0e7b-4f55-a058-890fe84fc323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:23:00.807361 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1087/2154] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:23:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:23:00.815008 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa3c53e-26c5-4e3b-95a9-a6718ba45749 None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:23:00.815311 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa3c53e-26c5-4e3b-95a9-a6718ba45749 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:23:00.815592 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa3c53e-26c5-4e3b-95a9-a6718ba45749 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:23:00.834316 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-7aa3c53e-26c5-4e3b-95a9-a6718ba45749 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:23:00.836156 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-7aa3c53e-26c5-4e3b-95a9-a6718ba45749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:23:00.844396 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1068/2155] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:23:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:23:00.848631 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf350dc-0e7b-4f55-a058-890fe84fc323 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:23:00.857894 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf350dc-0e7b-4f55-a058-890fe84fc323 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:23:00.862441 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeafccc8-df2b-4c8a-965e-58574634dc38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:23:00.863088 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeafccc8-df2b-4c8a-965e-58574634dc38 admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:23:00.863364 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeafccc8-df2b-4c8a-965e-58574634dc38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:23:00.863634 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeafccc8-df2b-4c8a-965e-58574634dc38 admin admin] PATH_INFO: `/v3/domains` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:23:00.864346 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeafccc8-df2b-4c8a-965e-58574634dc38 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:23:00.864713 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeafccc8-df2b-4c8a-965e-58574634dc38 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:23:00.866774 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeafccc8-df2b-4c8a-965e-58574634dc38 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:23:00.878113 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1088/2156] 10.222.0.70 () {58 vars in 1152 bytes} [Tue May 10 19:23:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:23:00.883125 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa3c53e-26c5-4e3b-95a9-a6718ba45749 None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:23:00.892213 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa3c53e-26c5-4e3b-95a9-a6718ba45749 None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:23:00.896929 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55052f6-baf9-48da-b40f-5dc4151be19d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:23:00.897582 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55052f6-baf9-48da-b40f-5dc4151be19d admin admin] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:23:00.898034 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55052f6-baf9-48da-b40f-5dc4151be19d admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:23:00.898314 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55052f6-baf9-48da-b40f-5dc4151be19d admin admin] PATH_INFO: `/v3/projects` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:23:00.899015 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55052f6-baf9-48da-b40f-5dc4151be19d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:23:00.900957 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55052f6-baf9-48da-b40f-5dc4151be19d admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:23:00.930554 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1069/2157] 10.222.0.70 () {60 vars in 1152 bytes} [Tue May 10 19:23:00 2022] POST /identity/v3/projects => generated 399 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 19:23:00.931958 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeafccc8-df2b-4c8a-965e-58574634dc38 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:23:00.941927 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeafccc8-df2b-4c8a-965e-58574634dc38 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:23:01.020097 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c96593-5a45-4aa3-a5c7-ad991f418087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:23:01.020783 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c96593-5a45-4aa3-a5c7-ad991f418087 admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:23:01.021339 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c96593-5a45-4aa3-a5c7-ad991f418087 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:23:01.021434 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c96593-5a45-4aa3-a5c7-ad991f418087 admin admin] PATH_INFO: `/v3/users` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:23:01.022580 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c96593-5a45-4aa3-a5c7-ad991f418087 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:23:01.024568 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c96593-5a45-4aa3-a5c7-ad991f418087 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:23:01.050576 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1089/2158] 10.222.0.70 () {60 vars in 1143 bytes} [Tue May 10 19:23:00 2022] POST /identity/v3/users => generated 300 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:23:01.054538 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55052f6-baf9-48da-b40f-5dc4151be19d admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:23:01.064619 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55052f6-baf9-48da-b40f-5dc4151be19d admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:23:01.069362 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee978499-ef3c-4687-8584-060b7680dbca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:23:01.070009 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee978499-ef3c-4687-8584-060b7680dbca admin admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:23:01.070289 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee978499-ef3c-4687-8584-060b7680dbca admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:23:01.070558 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee978499-ef3c-4687-8584-060b7680dbca admin admin] PATH_INFO: `/v3/roles` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:23:01.071266 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee978499-ef3c-4687-8584-060b7680dbca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:23:01.072905 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee978499-ef3c-4687-8584-060b7680dbca admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:23:01.083098 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1070/2159] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:23:01 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:23:01.087500 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c96593-5a45-4aa3-a5c7-ad991f418087 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:23:01.097813 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c96593-5a45-4aa3-a5c7-ad991f418087 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:23:01.103046 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2342ecb5-f2a9-44ff-b91d-bdf352229b99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:23:01.103700 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2342ecb5-f2a9-44ff-b91d-bdf352229b99 admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:23:01.103983 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2342ecb5-f2a9-44ff-b91d-bdf352229b99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:23:01.104256 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2342ecb5-f2a9-44ff-b91d-bdf352229b99 admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:23:01.105016 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2342ecb5-f2a9-44ff-b91d-bdf352229b99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:23:01.106598 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2342ecb5-f2a9-44ff-b91d-bdf352229b99 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:23:01.116677 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1090/2160] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:23:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:23:01.120659 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee978499-ef3c-4687-8584-060b7680dbca admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:23:01.130180 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee978499-ef3c-4687-8584-060b7680dbca admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:23:01.134693 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04f7de3-e7b7-4049-a00e-c6f310771aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:23:01.135553 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04f7de3-e7b7-4049-a00e-c6f310771aab admin admin] REQUEST_METHOD: `PUT` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:23:01.135829 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04f7de3-e7b7-4049-a00e-c6f310771aab admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:23:01.136094 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04f7de3-e7b7-4049-a00e-c6f310771aab admin admin] PATH_INFO: `/v3/projects/44d7678fa64f4708a074c53400e0441b/users/f5ae97d5d6c7499db1c471f15a06baa4/roles/5c07cf5bfbd3427db18428aa50420962` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:23:01.150469 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04f7de3-e7b7-4049-a00e-c6f310771aab admin admin] RBAC: Authorizing `identity:create_grant(project_id=44d7678fa64f4708a074c53400e0441b, user_id=f5ae97d5d6c7499db1c471f15a06baa4, role_id=5c07cf5bfbd3427db18428aa50420962)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:23:01.153139 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04f7de3-e7b7-4049-a00e-c6f310771aab admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:23:01.166239 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1071/2161] 10.222.0.70 () {60 vars in 1482 bytes} [Tue May 10 19:23:01 2022] PUT /identity/v3/projects/44d7678fa64f4708a074c53400e0441b/users/f5ae97d5d6c7499db1c471f15a06baa4/roles/5c07cf5bfbd3427db18428aa50420962 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:23:01.176607 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ac58f1-4386-4324-8567-4c93c8b44619 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:23:01.176898 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ac58f1-4386-4324-8567-4c93c8b44619 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:23:01.177180 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ac58f1-4386-4324-8567-4c93c8b44619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:23:01.203668 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-02ac58f1-4386-4324-8567-4c93c8b44619 None None] MFA Rules not processed for user `f5ae97d5d6c7499db1c471f15a06baa4`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:23:01.204908 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-02ac58f1-4386-4324-8567-4c93c8b44619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:23:01.266422 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1091/2162] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:23:01 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:23:01.278287 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04f7de3-e7b7-4049-a00e-c6f310771aab admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:23:01.280132 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-b04f7de3-e7b7-4049-a00e-c6f310771aab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:23:01.346101 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04f7de3-e7b7-4049-a00e-c6f310771aab admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:23:01.349865 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f14c07-cbf4-4939-a789-382d92984204 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15df2a8967aa43299c10e365f4200d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:23:01.350545 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f14c07-cbf4-4939-a789-382d92984204 service cinder] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:23:01.350830 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f14c07-cbf4-4939-a789-382d92984204 service cinder] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:23:01.351121 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f14c07-cbf4-4939-a789-382d92984204 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:23:01.359931 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f14c07-cbf4-4939-a789-382d92984204 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:23:01.361715 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f14c07-cbf4-4939-a789-382d92984204 service cinder] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:23:01.373674 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1072/2163] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:23:01 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:23:01.560063 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf27943-81e7-4e25-8fa7-271cdaacf323 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:23:01.560413 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf27943-81e7-4e25-8fa7-271cdaacf323 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:23:01.560697 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf27943-81e7-4e25-8fa7-271cdaacf323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:23:01.580399 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-0cf27943-81e7-4e25-8fa7-271cdaacf323 None None] MFA Rules not processed for user `f05fe3e228ce4650acdfc041aa89e030`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:23:01.581691 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-0cf27943-81e7-4e25-8fa7-271cdaacf323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:23:01.640663 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1092/2164] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:23:01 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:23:10.480854 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f14c07-cbf4-4939-a789-382d92984204 service cinder] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:23:10.540738 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f14c07-cbf4-4939-a789-382d92984204 service cinder] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:23:10.545326 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449433de-8933-4641-9c2a-a53377ae472f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:23:10.546194 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449433de-8933-4641-9c2a-a53377ae472f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:23:10.546532 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449433de-8933-4641-9c2a-a53377ae472f admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:23:10.546807 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449433de-8933-4641-9c2a-a53377ae472f admin admin] PATH_INFO: `/v3/users/f5ae97d5d6c7499db1c471f15a06baa4` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:23:10.547989 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449433de-8933-4641-9c2a-a53377ae472f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5ae97d5d6c7499db1c471f15a06baa4)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:23:10.549940 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449433de-8933-4641-9c2a-a53377ae472f admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:23:10.594653 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-449433de-8933-4641-9c2a-a53377ae472f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5ae97d5d6c7499db1c471f15a06baa4'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:23:10.606234 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-449433de-8933-4641-9c2a-a53377ae472f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5ae97d5d6c7499db1c471f15a06baa4'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:23:10.613054 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-449433de-8933-4641-9c2a-a53377ae472f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5ae97d5d6c7499db1c471f15a06baa4'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:23:10.613828 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-449433de-8933-4641-9c2a-a53377ae472f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5ae97d5d6c7499db1c471f15a06baa4'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:23:10.621854 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-449433de-8933-4641-9c2a-a53377ae472f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5ae97d5d6c7499db1c471f15a06baa4'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:23:10.627969 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1073/2165] 10.222.0.70 () {58 vars in 1223 bytes} [Tue May 10 19:23:10 2022] DELETE /identity/v3/users/f5ae97d5d6c7499db1c471f15a06baa4 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:23:10.633077 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b03c8f-ecec-4243-a857-038d0fdd5b28 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:23:10.633564 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b03c8f-ecec-4243-a857-038d0fdd5b28 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:23:10.633874 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b03c8f-ecec-4243-a857-038d0fdd5b28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:23:10.653635 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-c8b03c8f-ecec-4243-a857-038d0fdd5b28 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:23:10.654837 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-c8b03c8f-ecec-4243-a857-038d0fdd5b28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:23:10.718175 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1093/2166] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:23:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:23:10.729213 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449433de-8933-4641-9c2a-a53377ae472f admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:23:10.731290 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-449433de-8933-4641-9c2a-a53377ae472f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:23:10.818413 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449433de-8933-4641-9c2a-a53377ae472f admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:23:10.822219 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d93206f-2a12-4626-b2f1-f4b3247db114 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f1dc79540b48c0866478cc48cd8205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:23:10.822871 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d93206f-2a12-4626-b2f1-f4b3247db114 service neutron] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:23:10.823159 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d93206f-2a12-4626-b2f1-f4b3247db114 service neutron] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:23:10.823442 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d93206f-2a12-4626-b2f1-f4b3247db114 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:23:10.833464 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d93206f-2a12-4626-b2f1-f4b3247db114 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:23:10.835720 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d93206f-2a12-4626-b2f1-f4b3247db114 service neutron] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:23:10.845441 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1074/2167] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:23:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 19:23:11.243644 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b03c8f-ecec-4243-a857-038d0fdd5b28 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:23:11.245442 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-c8b03c8f-ecec-4243-a857-038d0fdd5b28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:23:11.258990 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b03c8f-ecec-4243-a857-038d0fdd5b28 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:23:11.264190 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adb86ad-a202-4af0-8d82-de8116632bd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:23:11.265948 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adb86ad-a202-4af0-8d82-de8116632bd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:23:11.266433 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adb86ad-a202-4af0-8d82-de8116632bd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:23:11.266803 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adb86ad-a202-4af0-8d82-de8116632bd0 admin admin] PATH_INFO: `/v3/projects/44d7678fa64f4708a074c53400e0441b` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:23:11.268052 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adb86ad-a202-4af0-8d82-de8116632bd0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=44d7678fa64f4708a074c53400e0441b)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:23:11.270018 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adb86ad-a202-4af0-8d82-de8116632bd0 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:23:11.317621 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-1adb86ad-a202-4af0-8d82-de8116632bd0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44d7678fa64f4708a074c53400e0441b', 'request_id': 'req-1adb86ad-a202-4af0-8d82-de8116632bd0'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:23:11.324134 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-1adb86ad-a202-4af0-8d82-de8116632bd0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44d7678fa64f4708a074c53400e0441b', 'request_id': 'req-1adb86ad-a202-4af0-8d82-de8116632bd0'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:23:11.332319 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-1adb86ad-a202-4af0-8d82-de8116632bd0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44d7678fa64f4708a074c53400e0441b', 'request_id': 'req-1adb86ad-a202-4af0-8d82-de8116632bd0'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:23:11.344013 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-1adb86ad-a202-4af0-8d82-de8116632bd0 admin admin] The token cache is being invalidate because project 44d7678fa64f4708a074c53400e0441b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79994) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:23:11.344414 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-1adb86ad-a202-4af0-8d82-de8116632bd0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:23:11.345174 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-1adb86ad-a202-4af0-8d82-de8116632bd0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:23:11.346774 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1094/2168] 10.222.0.70 () {58 vars in 1232 bytes} [Tue May 10 19:23:11 2022] DELETE /identity/v3/projects/44d7678fa64f4708a074c53400e0441b => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:23:11.351736 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d702204-7ad7-4067-9ce1-3563a86a8267 None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:23:11.352030 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d702204-7ad7-4067-9ce1-3563a86a8267 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:23:11.352311 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d702204-7ad7-4067-9ce1-3563a86a8267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:23:11.383676 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-1d702204-7ad7-4067-9ce1-3563a86a8267 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:23:11.385056 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-1d702204-7ad7-4067-9ce1-3563a86a8267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:23:11.453295 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1075/2169] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:23:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:23:11.462024 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e640c637-8dae-4976-8a69-32a80dcd4511 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:23:11.462314 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e640c637-8dae-4976-8a69-32a80dcd4511 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:23:11.462592 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e640c637-8dae-4976-8a69-32a80dcd4511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:23:11.481122 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-e640c637-8dae-4976-8a69-32a80dcd4511 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:23:11.482308 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-e640c637-8dae-4976-8a69-32a80dcd4511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:23:11.490548 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1095/2170] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:23:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:23:11.494869 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d702204-7ad7-4067-9ce1-3563a86a8267 None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:23:11.505157 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d702204-7ad7-4067-9ce1-3563a86a8267 None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:23:11.510609 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ffcf95-43a5-4091-9d7f-63ebdb170d27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:23:11.511268 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ffcf95-43a5-4091-9d7f-63ebdb170d27 admin admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:23:11.511609 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ffcf95-43a5-4091-9d7f-63ebdb170d27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:23:11.511838 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ffcf95-43a5-4091-9d7f-63ebdb170d27 admin admin] PATH_INFO: `/v3/domains` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:23:11.512677 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ffcf95-43a5-4091-9d7f-63ebdb170d27 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:23:11.513002 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ffcf95-43a5-4091-9d7f-63ebdb170d27 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:23:11.514591 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ffcf95-43a5-4091-9d7f-63ebdb170d27 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:23:11.532801 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1076/2171] 10.222.0.70 () {58 vars in 1152 bytes} [Tue May 10 19:23:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:23:11.537396 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e640c637-8dae-4976-8a69-32a80dcd4511 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:23:11.547013 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e640c637-8dae-4976-8a69-32a80dcd4511 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:23:11.551777 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1cd6a2-0559-406c-bbac-d555ae631dc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:23:11.552444 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1cd6a2-0559-406c-bbac-d555ae631dc1 admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:23:11.552721 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1cd6a2-0559-406c-bbac-d555ae631dc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:23:11.553126 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1cd6a2-0559-406c-bbac-d555ae631dc1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:23:11.553813 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1cd6a2-0559-406c-bbac-d555ae631dc1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:23:11.555697 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1cd6a2-0559-406c-bbac-d555ae631dc1 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:23:11.585457 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1096/2172] 10.222.0.70 () {60 vars in 1152 bytes} [Tue May 10 19:23:11 2022] POST /identity/v3/projects => generated 379 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 19:23:11.586690 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ffcf95-43a5-4091-9d7f-63ebdb170d27 admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:23:11.605243 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ffcf95-43a5-4091-9d7f-63ebdb170d27 admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:23:11.668294 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dd7f5e-59a4-4300-af08-41fd44c5feaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:23:11.669011 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dd7f5e-59a4-4300-af08-41fd44c5feaa admin admin] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:23:11.669324 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dd7f5e-59a4-4300-af08-41fd44c5feaa admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:23:11.669598 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dd7f5e-59a4-4300-af08-41fd44c5feaa admin admin] PATH_INFO: `/v3/users` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:23:11.670315 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dd7f5e-59a4-4300-af08-41fd44c5feaa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:23:11.672222 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dd7f5e-59a4-4300-af08-41fd44c5feaa admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:23:11.697353 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1077/2173] 10.222.0.70 () {60 vars in 1143 bytes} [Tue May 10 19:23:11 2022] POST /identity/v3/users => generated 290 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:23:11.698978 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1cd6a2-0559-406c-bbac-d555ae631dc1 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:23:11.709988 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1cd6a2-0559-406c-bbac-d555ae631dc1 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:23:11.715377 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edaec55-f985-45d4-a059-4230ab1c445b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:23:11.716042 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edaec55-f985-45d4-a059-4230ab1c445b admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:23:11.716331 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edaec55-f985-45d4-a059-4230ab1c445b admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:23:11.716668 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edaec55-f985-45d4-a059-4230ab1c445b admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:23:11.717473 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edaec55-f985-45d4-a059-4230ab1c445b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:23:11.719143 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edaec55-f985-45d4-a059-4230ab1c445b admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:23:11.730665 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1097/2174] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:23:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:23:11.734691 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dd7f5e-59a4-4300-af08-41fd44c5feaa admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:23:11.744395 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dd7f5e-59a4-4300-af08-41fd44c5feaa admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:23:11.748940 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302a92eb-92c2-4eaf-8d73-4faac81f8ce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:23:11.749596 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302a92eb-92c2-4eaf-8d73-4faac81f8ce8 admin admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:23:11.749883 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302a92eb-92c2-4eaf-8d73-4faac81f8ce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:23:11.750161 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302a92eb-92c2-4eaf-8d73-4faac81f8ce8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:23:11.750880 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302a92eb-92c2-4eaf-8d73-4faac81f8ce8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:23:11.752493 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302a92eb-92c2-4eaf-8d73-4faac81f8ce8 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:23:11.766794 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1078/2175] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:23:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:23:11.771076 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edaec55-f985-45d4-a059-4230ab1c445b admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:23:11.781633 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edaec55-f985-45d4-a059-4230ab1c445b admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:23:11.786317 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdfabb2-2c8a-4558-b23f-d83bb49ced5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:23:11.787195 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdfabb2-2c8a-4558-b23f-d83bb49ced5b admin admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:23:11.787480 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdfabb2-2c8a-4558-b23f-d83bb49ced5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:23:11.787755 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdfabb2-2c8a-4558-b23f-d83bb49ced5b admin admin] PATH_INFO: `/v3/projects/7bff45e4fe4f43fcbd241831c989710f/users/f2fbc31d945b4a61beb3fd9a28657583/roles/5c07cf5bfbd3427db18428aa50420962` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:23:11.801700 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdfabb2-2c8a-4558-b23f-d83bb49ced5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7bff45e4fe4f43fcbd241831c989710f, user_id=f2fbc31d945b4a61beb3fd9a28657583, role_id=5c07cf5bfbd3427db18428aa50420962)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:23:11.804335 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdfabb2-2c8a-4558-b23f-d83bb49ced5b admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:23:11.817139 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1098/2176] 10.222.0.70 () {60 vars in 1482 bytes} [Tue May 10 19:23:11 2022] PUT /identity/v3/projects/7bff45e4fe4f43fcbd241831c989710f/users/f2fbc31d945b4a61beb3fd9a28657583/roles/5c07cf5bfbd3427db18428aa50420962 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 19:23:11.822666 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0862f48f-3dfb-4eaf-82b0-ffe6c6d865c1 None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:23:11.822955 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0862f48f-3dfb-4eaf-82b0-ffe6c6d865c1 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:23:11.823258 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0862f48f-3dfb-4eaf-82b0-ffe6c6d865c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:23:11.840601 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-0862f48f-3dfb-4eaf-82b0-ffe6c6d865c1 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:23:11.841783 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-0862f48f-3dfb-4eaf-82b0-ffe6c6d865c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:23:11.898123 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1079/2177] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:23:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:23:11.908127 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdfabb2-2c8a-4558-b23f-d83bb49ced5b admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:23:11.909835 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-5cdfabb2-2c8a-4558-b23f-d83bb49ced5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:23:11.967632 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdfabb2-2c8a-4558-b23f-d83bb49ced5b admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:23:11.971300 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909d0612-d99d-48b8-8a85-d8f5c431613b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f1dc79540b48c0866478cc48cd8205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:23:11.971941 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909d0612-d99d-48b8-8a85-d8f5c431613b service neutron] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:23:11.972241 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909d0612-d99d-48b8-8a85-d8f5c431613b service neutron] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:23:11.972541 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909d0612-d99d-48b8-8a85-d8f5c431613b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:23:11.981373 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909d0612-d99d-48b8-8a85-d8f5c431613b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:23:11.982795 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909d0612-d99d-48b8-8a85-d8f5c431613b service neutron] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:23:11.992410 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1099/2178] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:23:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:23:14.355761 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c79228-f19d-40dc-99c4-98a8e7661d5f None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:23:14.357217 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c79228-f19d-40dc-99c4-98a8e7661d5f None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:23:14.357217 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c79228-f19d-40dc-99c4-98a8e7661d5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:23:14.376490 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-30c79228-f19d-40dc-99c4-98a8e7661d5f None None] MFA Rules not processed for user `4c7ce54253764d788ea48b5ff9b43d54`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:23:14.377726 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-30c79228-f19d-40dc-99c4-98a8e7661d5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:23:14.447366 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1080/2179] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:23:14 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:23:17.970656 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427f79ad-e59a-4515-bbe5-f10505ba980c None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:23:17.971780 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427f79ad-e59a-4515-bbe5-f10505ba980c None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:23:17.972213 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427f79ad-e59a-4515-bbe5-f10505ba980c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:23:18.015414 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-427f79ad-e59a-4515-bbe5-f10505ba980c None None] MFA Rules not processed for user `f2fbc31d945b4a61beb3fd9a28657583`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:23:18.016871 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-427f79ad-e59a-4515-bbe5-f10505ba980c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:23:18.102866 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1100/2180] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:23:17 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:23:18.107031 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c79228-f19d-40dc-99c4-98a8e7661d5f None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:23:18.120576 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c79228-f19d-40dc-99c4-98a8e7661d5f None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:23:18.125304 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52524b04-de78-4047-979d-a5de756e2acc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:23:18.125967 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52524b04-de78-4047-979d-a5de756e2acc admin admin] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:23:18.126251 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52524b04-de78-4047-979d-a5de756e2acc admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:23:18.126546 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52524b04-de78-4047-979d-a5de756e2acc admin admin] PATH_INFO: `/v3/projects` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:23:18.127235 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52524b04-de78-4047-979d-a5de756e2acc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:23:18.129237 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52524b04-de78-4047-979d-a5de756e2acc admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:23:18.158858 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1081/2181] 10.222.0.70 () {60 vars in 1152 bytes} [Tue May 10 19:23:18 2022] POST /identity/v3/projects => generated 377 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:23:18.163345 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427f79ad-e59a-4515-bbe5-f10505ba980c None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:23:18.176714 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427f79ad-e59a-4515-bbe5-f10505ba980c None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:23:18.237367 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9ed50d-7833-4d22-9bd9-eb89d1f01b39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:23:18.238354 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9ed50d-7833-4d22-9bd9-eb89d1f01b39 admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:23:18.238881 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9ed50d-7833-4d22-9bd9-eb89d1f01b39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:23:18.239315 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9ed50d-7833-4d22-9bd9-eb89d1f01b39 admin admin] PATH_INFO: `/v3/users` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:23:18.240204 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9ed50d-7833-4d22-9bd9-eb89d1f01b39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:23:18.242774 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9ed50d-7833-4d22-9bd9-eb89d1f01b39 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:23:18.270328 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1101/2182] 10.222.0.70 () {60 vars in 1143 bytes} [Tue May 10 19:23:18 2022] POST /identity/v3/users => generated 295 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:23:18.271117 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52524b04-de78-4047-979d-a5de756e2acc admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:23:18.289086 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52524b04-de78-4047-979d-a5de756e2acc admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:23:18.296987 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416ab9ea-bfbe-4f32-a444-c2ec03b2ba0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:23:18.298663 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416ab9ea-bfbe-4f32-a444-c2ec03b2ba0d admin admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:23:18.299183 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416ab9ea-bfbe-4f32-a444-c2ec03b2ba0d admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:23:18.299787 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416ab9ea-bfbe-4f32-a444-c2ec03b2ba0d admin admin] PATH_INFO: `/v3/roles` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:23:18.300921 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416ab9ea-bfbe-4f32-a444-c2ec03b2ba0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:23:18.305601 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416ab9ea-bfbe-4f32-a444-c2ec03b2ba0d admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:23:18.337931 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1082/2183] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:23:18 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 19:23:18.342079 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9ed50d-7833-4d22-9bd9-eb89d1f01b39 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:23:18.356562 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9ed50d-7833-4d22-9bd9-eb89d1f01b39 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:23:18.365837 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24311f61-018c-45e5-a3f1-62574df057b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:23:18.366814 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24311f61-018c-45e5-a3f1-62574df057b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:23:18.367100 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24311f61-018c-45e5-a3f1-62574df057b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:23:18.367377 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24311f61-018c-45e5-a3f1-62574df057b7 admin admin] PATH_INFO: `/v3/projects/622b819918b2449982484d324d648f5f/users/9334f5411276473883307c63b4c528df/roles/634ba284303b4626b5a0402772c68f5c` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:23:18.385110 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24311f61-018c-45e5-a3f1-62574df057b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=622b819918b2449982484d324d648f5f, user_id=9334f5411276473883307c63b4c528df, role_id=634ba284303b4626b5a0402772c68f5c)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:23:18.388092 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24311f61-018c-45e5-a3f1-62574df057b7 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:23:18.406196 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1102/2184] 10.222.0.70 () {60 vars in 1482 bytes} [Tue May 10 19:23:18 2022] PUT /identity/v3/projects/622b819918b2449982484d324d648f5f/users/9334f5411276473883307c63b4c528df/roles/634ba284303b4626b5a0402772c68f5c => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:23:18.410130 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416ab9ea-bfbe-4f32-a444-c2ec03b2ba0d admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:23:18.421972 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416ab9ea-bfbe-4f32-a444-c2ec03b2ba0d admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:23:18.489916 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40864db2-339d-4ad7-b4e5-573b842ad7e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:23:18.491207 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40864db2-339d-4ad7-b4e5-573b842ad7e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:23:18.491708 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40864db2-339d-4ad7-b4e5-573b842ad7e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:23:18.492171 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40864db2-339d-4ad7-b4e5-573b842ad7e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:23:18.493294 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40864db2-339d-4ad7-b4e5-573b842ad7e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:23:18.495554 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40864db2-339d-4ad7-b4e5-573b842ad7e5 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:23:18.516011 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1083/2185] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:23:18 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 19:23:18.520791 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24311f61-018c-45e5-a3f1-62574df057b7 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:23:18.535607 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24311f61-018c-45e5-a3f1-62574df057b7 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:23:18.550613 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41307fd8-c6f4-4e6e-a4d8-d83f6cf6af35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:23:18.552744 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41307fd8-c6f4-4e6e-a4d8-d83f6cf6af35 admin admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:23:18.553032 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41307fd8-c6f4-4e6e-a4d8-d83f6cf6af35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:23:18.553306 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41307fd8-c6f4-4e6e-a4d8-d83f6cf6af35 admin admin] PATH_INFO: `/v3/projects/622b819918b2449982484d324d648f5f/users/9334f5411276473883307c63b4c528df/roles/634ba284303b4626b5a0402772c68f5c` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:23:18.561475 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41307fd8-c6f4-4e6e-a4d8-d83f6cf6af35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=622b819918b2449982484d324d648f5f, user_id=9334f5411276473883307c63b4c528df, role_id=634ba284303b4626b5a0402772c68f5c)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:23:18.565116 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41307fd8-c6f4-4e6e-a4d8-d83f6cf6af35 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:23:18.586803 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1103/2186] 10.222.0.70 () {60 vars in 1482 bytes} [Tue May 10 19:23:18 2022] PUT /identity/v3/projects/622b819918b2449982484d324d648f5f/users/9334f5411276473883307c63b4c528df/roles/634ba284303b4626b5a0402772c68f5c => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:23:24.990979 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eccaf0-f415-478c-8283-dfb533c1c8ea None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:23:24.991512 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eccaf0-f415-478c-8283-dfb533c1c8ea None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:23:24.991512 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eccaf0-f415-478c-8283-dfb533c1c8ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:23:25.029356 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-b9eccaf0-f415-478c-8283-dfb533c1c8ea None None] MFA Rules not processed for user `9334f5411276473883307c63b4c528df`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:23:25.030928 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-b9eccaf0-f415-478c-8283-dfb533c1c8ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:23:25.119891 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1084/2187] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:23:24 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:23:25.133816 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41307fd8-c6f4-4e6e-a4d8-d83f6cf6af35 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:23:25.135672 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-41307fd8-c6f4-4e6e-a4d8-d83f6cf6af35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:23:25.280071 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41307fd8-c6f4-4e6e-a4d8-d83f6cf6af35 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:23:25.286343 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d12db7-bb76-4837-900b-b501a62e4699 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9f310a468ec4058b3c95356ea60ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:23:25.289444 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d12db7-bb76-4837-900b-b501a62e4699 service nova] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:23:25.289761 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d12db7-bb76-4837-900b-b501a62e4699 service nova] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:23:25.290045 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d12db7-bb76-4837-900b-b501a62e4699 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:23:25.360847 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d12db7-bb76-4837-900b-b501a62e4699 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:23:25.362443 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d12db7-bb76-4837-900b-b501a62e4699 service nova] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:23:25.371457 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1104/2188] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:23:25 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:23:28.792793 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc61a1a-f235-454f-bdf9-d85266dab799 None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:23:28.793298 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc61a1a-f235-454f-bdf9-d85266dab799 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:23:28.793437 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc61a1a-f235-454f-bdf9-d85266dab799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:23:28.814103 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-abc61a1a-f235-454f-bdf9-d85266dab799 None None] MFA Rules not processed for user `db6fd87ab33946808f4153585fc1d07a`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:23:28.815312 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-abc61a1a-f235-454f-bdf9-d85266dab799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:23:28.887161 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280a8fd0-73a0-445e-b103-104222cfc01e None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:23:28.887659 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280a8fd0-73a0-445e-b103-104222cfc01e None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:23:28.888010 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280a8fd0-73a0-445e-b103-104222cfc01e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:23:28.896105 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1085/2189] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:23:28 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:23:28.922572 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-280a8fd0-73a0-445e-b103-104222cfc01e None None] MFA Rules not processed for user `058e52f1bf0b4aba965d945815d4acb3`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:23:28.924594 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-280a8fd0-73a0-445e-b103-104222cfc01e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:23:28.996977 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1105/2190] 10.222.0.70 () {58 vars in 1009 bytes} [Tue May 10 19:23:28 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:23:29.012892 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc61a1a-f235-454f-bdf9-d85266dab799 None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:23:29.014810 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-abc61a1a-f235-454f-bdf9-d85266dab799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:23:29.116893 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc61a1a-f235-454f-bdf9-d85266dab799 None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:23:29.126752 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26fea9e-e5a5-42a7-bacd-a70294af4ba9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0454aa03fa31487ea1464b9d0008212c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:23:29.127513 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26fea9e-e5a5-42a7-bacd-a70294af4ba9 service swift] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:23:29.127866 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26fea9e-e5a5-42a7-bacd-a70294af4ba9 service swift] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:23:29.128213 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26fea9e-e5a5-42a7-bacd-a70294af4ba9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:23:29.138794 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26fea9e-e5a5-42a7-bacd-a70294af4ba9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:23:29.140634 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26fea9e-e5a5-42a7-bacd-a70294af4ba9 service swift] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:23:29.148964 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1086/2191] 10.222.0.70 () {60 vars in 1384 bytes} [Tue May 10 19:23:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 19:23:49.089459 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280a8fd0-73a0-445e-b103-104222cfc01e None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:23:49.091173 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-280a8fd0-73a0-445e-b103-104222cfc01e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:23:49.187883 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280a8fd0-73a0-445e-b103-104222cfc01e None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:23:49.193823 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7ef237-2d9d-48f3-94e4-8a424efaf037 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b95d3824f34cfcada6915ee57a7e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:23:49.194488 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7ef237-2d9d-48f3-94e4-8a424efaf037 service placement] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:23:49.194766 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7ef237-2d9d-48f3-94e4-8a424efaf037 service placement] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:23:49.195179 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7ef237-2d9d-48f3-94e4-8a424efaf037 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:23:49.196989 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-1a7ef237-2d9d-48f3-94e4-8a424efaf037 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:23:49.211073 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7ef237-2d9d-48f3-94e4-8a424efaf037 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:23:49.212784 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7ef237-2d9d-48f3-94e4-8a424efaf037 service placement] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:23:49.223968 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1106/2192] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:23:49 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:23:50.528695 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd85aa8-23ef-46bb-baff-b9bccc60837a None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:23:50.529228 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd85aa8-23ef-46bb-baff-b9bccc60837a None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:23:50.529321 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd85aa8-23ef-46bb-baff-b9bccc60837a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:23:50.579685 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-3fd85aa8-23ef-46bb-baff-b9bccc60837a None None] MFA Rules not processed for user `058e52f1bf0b4aba965d945815d4acb3`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:23:50.580972 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-3fd85aa8-23ef-46bb-baff-b9bccc60837a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:23:50.600376 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1087/2193] 10.222.0.70 () {58 vars in 1009 bytes} [Tue May 10 19:23:50 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:23:50.615312 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7ef237-2d9d-48f3-94e4-8a424efaf037 service placement] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:23:50.642927 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7ef237-2d9d-48f3-94e4-8a424efaf037 service placement] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:23:50.650074 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a33ad3c-62e8-4b56-859b-6147d1570def service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0454aa03fa31487ea1464b9d0008212c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:23:50.650913 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a33ad3c-62e8-4b56-859b-6147d1570def service swift] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:23:50.652919 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a33ad3c-62e8-4b56-859b-6147d1570def service swift] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:23:50.652919 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a33ad3c-62e8-4b56-859b-6147d1570def service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:23:50.661767 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a33ad3c-62e8-4b56-859b-6147d1570def service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:23:50.663541 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a33ad3c-62e8-4b56-859b-6147d1570def service swift] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:23:50.678252 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1107/2194] 10.222.0.70 () {60 vars in 1384 bytes} [Tue May 10 19:23:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 19:23:54.109771 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d1c8ee-d597-47bb-b348-5e1609798501 None None] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:23:54.110331 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d1c8ee-d597-47bb-b348-5e1609798501 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:23:54.110331 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d1c8ee-d597-47bb-b348-5e1609798501 None None] PATH_INFO: `/` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:23:54.111945 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1088/2195] 10.222.0.70 () {54 vars in 921 bytes} [Tue May 10 19:23:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:23:54.121048 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72f844a-9858-4a68-8dbb-4d61db78bfd1 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:23:54.121742 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72f844a-9858-4a68-8dbb-4d61db78bfd1 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:23:54.122360 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72f844a-9858-4a68-8dbb-4d61db78bfd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:23:54.236483 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-c72f844a-9858-4a68-8dbb-4d61db78bfd1 None None] MFA Rules not processed for user `b9f310a468ec4058b3c95356ea60ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:23:54.238060 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-c72f844a-9858-4a68-8dbb-4d61db78bfd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:23:54.257771 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1108/2196] 10.222.0.70 () {58 vars in 1018 bytes} [Tue May 10 19:23:54 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:23:54.274925 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d1c8ee-d597-47bb-b348-5e1609798501 None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:23:54.277711 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-d4d1c8ee-d597-47bb-b348-5e1609798501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:23:54.418368 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d1c8ee-d597-47bb-b348-5e1609798501 None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:23:54.422784 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9218aa-2867-40c8-892b-5c7cd36b29fd service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24ca97ff2a1745e58dedba4cef61b3f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:23:54.423642 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9218aa-2867-40c8-892b-5c7cd36b29fd service glance] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:23:54.424294 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9218aa-2867-40c8-892b-5c7cd36b29fd service glance] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:23:54.424763 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9218aa-2867-40c8-892b-5c7cd36b29fd service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:23:54.438150 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9218aa-2867-40c8-892b-5c7cd36b29fd service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:23:54.439936 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9218aa-2867-40c8-892b-5c7cd36b29fd service glance] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:23:54.452061 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1089/2197] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:23:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:23:54.539229 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ae1db9-d21a-4f70-98e1-ba4b95e38abd None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:23:54.539892 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ae1db9-d21a-4f70-98e1-ba4b95e38abd None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:23:54.540337 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ae1db9-d21a-4f70-98e1-ba4b95e38abd None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:23:54.542051 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1109/2198] 10.222.0.70 () {54 vars in 921 bytes} [Tue May 10 19:23:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:23:54.550086 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9e3ec1-5e8f-468a-a0b8-a97b312506a8 None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:23:54.550671 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9e3ec1-5e8f-468a-a0b8-a97b312506a8 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:23:54.551637 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9e3ec1-5e8f-468a-a0b8-a97b312506a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:23:54.582736 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-3c9e3ec1-5e8f-468a-a0b8-a97b312506a8 None None] MFA Rules not processed for user `91f1dc79540b48c0866478cc48cd8205`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:23:54.584324 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-3c9e3ec1-5e8f-468a-a0b8-a97b312506a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:23:54.653124 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1090/2199] 10.222.0.70 () {58 vars in 1018 bytes} [Tue May 10 19:23:54 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:23:54.661943 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ae1db9-d21a-4f70-98e1-ba4b95e38abd None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:23:54.684287 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ae1db9-d21a-4f70-98e1-ba4b95e38abd None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:23:54.688447 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62dfadc-95d9-486f-8361-2acfd5db431c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f1dc79540b48c0866478cc48cd8205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:23:54.688891 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62dfadc-95d9-486f-8361-2acfd5db431c service neutron] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:23:54.689174 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62dfadc-95d9-486f-8361-2acfd5db431c service neutron] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:23:54.689457 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62dfadc-95d9-486f-8361-2acfd5db431c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:23:54.697667 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62dfadc-95d9-486f-8361-2acfd5db431c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:23:54.699366 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62dfadc-95d9-486f-8361-2acfd5db431c service neutron] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:23:54.707912 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1110/2200] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:23:54 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:23:54.759441 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b005776-3959-4ce7-ac83-ba259e744f3a None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:23:54.760162 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b005776-3959-4ce7-ac83-ba259e744f3a None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:23:54.760633 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b005776-3959-4ce7-ac83-ba259e744f3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:23:54.803478 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-4b005776-3959-4ce7-ac83-ba259e744f3a None None] MFA Rules not processed for user `f2fbc31d945b4a61beb3fd9a28657583`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:23:54.804896 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-4b005776-3959-4ce7-ac83-ba259e744f3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:23:54.840611 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1091/2201] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:23:54 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:23:54.876406 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a58ecb-3f33-4e3c-8b91-4cb5d98d355f None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:23:54.876702 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a58ecb-3f33-4e3c-8b91-4cb5d98d355f None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:23:54.876911 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a58ecb-3f33-4e3c-8b91-4cb5d98d355f None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:23:54.878294 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1111/2202] 10.222.0.70 () {54 vars in 921 bytes} [Tue May 10 19:23:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:23:54.888741 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dae7cb5-a88c-4655-a52e-0dcbbf33187b None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:23:54.889022 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dae7cb5-a88c-4655-a52e-0dcbbf33187b None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:23:54.889302 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dae7cb5-a88c-4655-a52e-0dcbbf33187b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:23:54.927884 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-7dae7cb5-a88c-4655-a52e-0dcbbf33187b None None] MFA Rules not processed for user `b9f310a468ec4058b3c95356ea60ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:23:54.928728 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-7dae7cb5-a88c-4655-a52e-0dcbbf33187b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:23:54.963292 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1092/2203] 10.222.0.70 () {58 vars in 1018 bytes} [Tue May 10 19:23:54 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:23:54.973937 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a58ecb-3f33-4e3c-8b91-4cb5d98d355f None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:23:54.976159 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-19a58ecb-3f33-4e3c-8b91-4cb5d98d355f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:23:55.003376 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a58ecb-3f33-4e3c-8b91-4cb5d98d355f None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:23:55.017373 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddd17fc-5f1f-46c9-a5ff-ef145c27d397 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f1dc79540b48c0866478cc48cd8205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:23:55.018872 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddd17fc-5f1f-46c9-a5ff-ef145c27d397 service neutron] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:23:55.019356 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddd17fc-5f1f-46c9-a5ff-ef145c27d397 service neutron] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:23:55.020125 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddd17fc-5f1f-46c9-a5ff-ef145c27d397 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:23:55.040964 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddd17fc-5f1f-46c9-a5ff-ef145c27d397 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:23:55.042429 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddd17fc-5f1f-46c9-a5ff-ef145c27d397 service neutron] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:23:55.060593 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1112/2204] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:23:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:24:05.819552 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647c0d53-11f7-4707-9c65-1e42086461d6 None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:24:05.820759 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647c0d53-11f7-4707-9c65-1e42086461d6 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:24:05.821586 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647c0d53-11f7-4707-9c65-1e42086461d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:24:05.847648 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-647c0d53-11f7-4707-9c65-1e42086461d6 None None] MFA Rules not processed for user `058e52f1bf0b4aba965d945815d4acb3`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:24:05.849291 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-647c0d53-11f7-4707-9c65-1e42086461d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:24:05.862317 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1093/2205] 10.222.0.70 () {58 vars in 1009 bytes} [Tue May 10 19:24:05 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:24:05.875064 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddd17fc-5f1f-46c9-a5ff-ef145c27d397 service neutron] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:24:05.894883 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddd17fc-5f1f-46c9-a5ff-ef145c27d397 service neutron] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:24:05.902623 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374a5161-baa7-4d72-ad3a-f25125eb0557 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0454aa03fa31487ea1464b9d0008212c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:24:05.903512 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374a5161-baa7-4d72-ad3a-f25125eb0557 service swift] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:24:05.903974 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374a5161-baa7-4d72-ad3a-f25125eb0557 service swift] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:24:05.904811 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374a5161-baa7-4d72-ad3a-f25125eb0557 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:24:05.917953 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374a5161-baa7-4d72-ad3a-f25125eb0557 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:24:05.919985 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374a5161-baa7-4d72-ad3a-f25125eb0557 service swift] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:24:05.936741 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1113/2206] 10.222.0.70 () {60 vars in 1384 bytes} [Tue May 10 19:24:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 10 19:24:12.292151 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27425253-65fa-4982-81c2-5d77ef5c37ba None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:24:12.292786 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27425253-65fa-4982-81c2-5d77ef5c37ba None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:24:12.292786 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27425253-65fa-4982-81c2-5d77ef5c37ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:24:12.311021 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-27425253-65fa-4982-81c2-5d77ef5c37ba None None] MFA Rules not processed for user `221e215caae34d08a9b8f36c711b4318`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:24:12.312474 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-27425253-65fa-4982-81c2-5d77ef5c37ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:24:12.367541 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1094/2207] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:24:12 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:24:13.061029 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8a7fd4-7c71-445f-946c-f85949996f74 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:24:13.062074 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8a7fd4-7c71-445f-946c-f85949996f74 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:24:13.062571 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8a7fd4-7c71-445f-946c-f85949996f74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:24:13.088843 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-0a8a7fd4-7c71-445f-946c-f85949996f74 None None] MFA Rules not processed for user `058e52f1bf0b4aba965d945815d4acb3`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:24:13.092022 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-0a8a7fd4-7c71-445f-946c-f85949996f74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:24:13.110826 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1114/2208] 10.222.0.70 () {58 vars in 967 bytes} [Tue May 10 19:24:13 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:24:13.133819 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27425253-65fa-4982-81c2-5d77ef5c37ba None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:24:13.147960 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27425253-65fa-4982-81c2-5d77ef5c37ba None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:24:13.167457 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa9d72b-622b-44c2-8985-c1ece08cde5b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0454aa03fa31487ea1464b9d0008212c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:24:13.168054 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa9d72b-622b-44c2-8985-c1ece08cde5b service swift] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:24:13.173889 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa9d72b-622b-44c2-8985-c1ece08cde5b service swift] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:24:13.174178 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa9d72b-622b-44c2-8985-c1ece08cde5b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:24:13.203423 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa9d72b-622b-44c2-8985-c1ece08cde5b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:24:13.205386 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa9d72b-622b-44c2-8985-c1ece08cde5b service swift] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:24:13.220207 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1095/2209] 10.222.0.70 () {60 vars in 1384 bytes} [Tue May 10 19:24:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 19:24:15.726590 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8a7fd4-7c71-445f-946c-f85949996f74 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:24:15.730188 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-0a8a7fd4-7c71-445f-946c-f85949996f74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:24:15.805755 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8a7fd4-7c71-445f-946c-f85949996f74 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:24:15.810316 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8147f77f-4f03-4eec-9eb9-0e30368cd574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:24:15.811181 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8147f77f-4f03-4eec-9eb9-0e30368cd574 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:24:15.811464 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8147f77f-4f03-4eec-9eb9-0e30368cd574 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:24:15.811737 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8147f77f-4f03-4eec-9eb9-0e30368cd574 admin admin] PATH_INFO: `/v3/users/f05fe3e228ce4650acdfc041aa89e030` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:24:15.813035 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8147f77f-4f03-4eec-9eb9-0e30368cd574 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f05fe3e228ce4650acdfc041aa89e030)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:24:15.814948 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8147f77f-4f03-4eec-9eb9-0e30368cd574 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:24:15.873408 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-8147f77f-4f03-4eec-9eb9-0e30368cd574 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f05fe3e228ce4650acdfc041aa89e030'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:24:15.886616 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-8147f77f-4f03-4eec-9eb9-0e30368cd574 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f05fe3e228ce4650acdfc041aa89e030'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:24:15.887344 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-8147f77f-4f03-4eec-9eb9-0e30368cd574 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f05fe3e228ce4650acdfc041aa89e030'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:24:15.894876 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-8147f77f-4f03-4eec-9eb9-0e30368cd574 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f05fe3e228ce4650acdfc041aa89e030'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:24:15.902793 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-8147f77f-4f03-4eec-9eb9-0e30368cd574 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f05fe3e228ce4650acdfc041aa89e030'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:24:15.909605 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1115/2210] 10.222.0.70 () {58 vars in 1223 bytes} [Tue May 10 19:24:15 2022] DELETE /identity/v3/users/f05fe3e228ce4650acdfc041aa89e030 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:24:16.098619 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa9d72b-622b-44c2-8985-c1ece08cde5b service swift] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:24:16.109644 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa9d72b-622b-44c2-8985-c1ece08cde5b service swift] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:24:16.173334 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baafc1bb-6944-47d9-aed1-69bac9f45ca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:24:16.174232 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baafc1bb-6944-47d9-aed1-69bac9f45ca3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:24:16.174519 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baafc1bb-6944-47d9-aed1-69bac9f45ca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:24:16.174798 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baafc1bb-6944-47d9-aed1-69bac9f45ca3 admin admin] PATH_INFO: `/v3/projects/055ce91938ab45018f4e259e45b3fac5` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:24:16.175971 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baafc1bb-6944-47d9-aed1-69bac9f45ca3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=055ce91938ab45018f4e259e45b3fac5)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:24:16.178543 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baafc1bb-6944-47d9-aed1-69bac9f45ca3 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:24:16.225817 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-baafc1bb-6944-47d9-aed1-69bac9f45ca3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '055ce91938ab45018f4e259e45b3fac5', 'request_id': 'req-baafc1bb-6944-47d9-aed1-69bac9f45ca3'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:24:16.231137 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-baafc1bb-6944-47d9-aed1-69bac9f45ca3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '055ce91938ab45018f4e259e45b3fac5', 'request_id': 'req-baafc1bb-6944-47d9-aed1-69bac9f45ca3'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:24:16.238657 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-baafc1bb-6944-47d9-aed1-69bac9f45ca3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '055ce91938ab45018f4e259e45b3fac5', 'request_id': 'req-baafc1bb-6944-47d9-aed1-69bac9f45ca3'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:24:16.250108 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-baafc1bb-6944-47d9-aed1-69bac9f45ca3 admin admin] The token cache is being invalidate because project 055ce91938ab45018f4e259e45b3fac5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79993) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:24:16.250390 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-baafc1bb-6944-47d9-aed1-69bac9f45ca3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:24:16.251037 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-baafc1bb-6944-47d9-aed1-69bac9f45ca3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:24:16.252594 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1096/2211] 10.222.0.70 () {58 vars in 1232 bytes} [Tue May 10 19:24:16 2022] DELETE /identity/v3/projects/055ce91938ab45018f4e259e45b3fac5 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:24:16.258171 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53893e7-d620-427c-9d6d-be2ff2d9aaae None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:24:16.258460 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53893e7-d620-427c-9d6d-be2ff2d9aaae None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:24:16.258735 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53893e7-d620-427c-9d6d-be2ff2d9aaae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:24:16.277437 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-b53893e7-d620-427c-9d6d-be2ff2d9aaae None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:24:16.278636 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-b53893e7-d620-427c-9d6d-be2ff2d9aaae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:24:16.336239 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1116/2212] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:24:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:24:16.343873 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e99f54a-46b8-4773-9d5f-8d05461ab719 None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:24:16.344162 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e99f54a-46b8-4773-9d5f-8d05461ab719 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:24:16.344466 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e99f54a-46b8-4773-9d5f-8d05461ab719 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:24:16.363509 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-9e99f54a-46b8-4773-9d5f-8d05461ab719 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:24:16.365360 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-9e99f54a-46b8-4773-9d5f-8d05461ab719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:24:16.373063 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1097/2213] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:24:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:24:16.377199 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53893e7-d620-427c-9d6d-be2ff2d9aaae None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:24:16.387069 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53893e7-d620-427c-9d6d-be2ff2d9aaae None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:24:16.392063 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218eb2db-e5f6-4812-9eaf-94aee04c21cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:24:16.392795 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218eb2db-e5f6-4812-9eaf-94aee04c21cc admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:24:16.393101 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218eb2db-e5f6-4812-9eaf-94aee04c21cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:24:16.393379 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218eb2db-e5f6-4812-9eaf-94aee04c21cc admin admin] PATH_INFO: `/v3/domains` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:24:16.394792 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218eb2db-e5f6-4812-9eaf-94aee04c21cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:24:16.395159 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218eb2db-e5f6-4812-9eaf-94aee04c21cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:24:16.396770 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218eb2db-e5f6-4812-9eaf-94aee04c21cc admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:24:16.411369 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1117/2214] 10.222.0.70 () {58 vars in 1152 bytes} [Tue May 10 19:24:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:24:16.412502 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e99f54a-46b8-4773-9d5f-8d05461ab719 None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:24:16.421592 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e99f54a-46b8-4773-9d5f-8d05461ab719 None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:24:16.426706 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b83bbc-0f3d-41b6-8b30-e5e8f9d674ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:24:16.427361 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b83bbc-0f3d-41b6-8b30-e5e8f9d674ac admin admin] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:24:16.427645 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b83bbc-0f3d-41b6-8b30-e5e8f9d674ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:24:16.427918 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b83bbc-0f3d-41b6-8b30-e5e8f9d674ac admin admin] PATH_INFO: `/v3/projects` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:24:16.428918 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b83bbc-0f3d-41b6-8b30-e5e8f9d674ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:24:16.430839 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b83bbc-0f3d-41b6-8b30-e5e8f9d674ac admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:24:16.460739 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1098/2215] 10.222.0.70 () {60 vars in 1152 bytes} [Tue May 10 19:24:16 2022] POST /identity/v3/projects => generated 367 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:24:16.465129 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218eb2db-e5f6-4812-9eaf-94aee04c21cc admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:24:16.476303 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218eb2db-e5f6-4812-9eaf-94aee04c21cc admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:24:16.551857 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b19f64-d14a-40ba-bbc1-9234f0f945d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:24:16.552583 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b19f64-d14a-40ba-bbc1-9234f0f945d8 admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:24:16.552855 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b19f64-d14a-40ba-bbc1-9234f0f945d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:24:16.553135 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b19f64-d14a-40ba-bbc1-9234f0f945d8 admin admin] PATH_INFO: `/v3/users` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:24:16.553829 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b19f64-d14a-40ba-bbc1-9234f0f945d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:24:16.555745 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b19f64-d14a-40ba-bbc1-9234f0f945d8 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:24:16.585595 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1118/2216] 10.222.0.70 () {60 vars in 1143 bytes} [Tue May 10 19:24:16 2022] POST /identity/v3/users => generated 284 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:24:16.589682 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b83bbc-0f3d-41b6-8b30-e5e8f9d674ac admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:24:16.602743 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b83bbc-0f3d-41b6-8b30-e5e8f9d674ac admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:24:16.607755 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8e61b0-d9c8-4156-8fe7-e8fe97256bba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:24:16.608461 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8e61b0-d9c8-4156-8fe7-e8fe97256bba admin admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:24:16.608741 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8e61b0-d9c8-4156-8fe7-e8fe97256bba admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:24:16.609025 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8e61b0-d9c8-4156-8fe7-e8fe97256bba admin admin] PATH_INFO: `/v3/roles` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:24:16.609745 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8e61b0-d9c8-4156-8fe7-e8fe97256bba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:24:16.611340 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8e61b0-d9c8-4156-8fe7-e8fe97256bba admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:24:16.624133 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1099/2217] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:24:16 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 19:24:16.628330 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b19f64-d14a-40ba-bbc1-9234f0f945d8 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:24:16.638839 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b19f64-d14a-40ba-bbc1-9234f0f945d8 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:24:16.643598 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f326a9-db2e-404c-8611-c7db12339f6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:24:16.644285 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f326a9-db2e-404c-8611-c7db12339f6f admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:24:16.644632 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f326a9-db2e-404c-8611-c7db12339f6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:24:16.645101 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f326a9-db2e-404c-8611-c7db12339f6f admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:24:16.645856 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f326a9-db2e-404c-8611-c7db12339f6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:24:16.647459 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f326a9-db2e-404c-8611-c7db12339f6f admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:24:16.666085 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1119/2218] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:24:16 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:24:16.668829 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8e61b0-d9c8-4156-8fe7-e8fe97256bba admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:24:16.681140 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8e61b0-d9c8-4156-8fe7-e8fe97256bba admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:24:16.700276 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d19a1a-8ab2-4ecc-b3ba-a233bdf5cd33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:24:16.703605 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d19a1a-8ab2-4ecc-b3ba-a233bdf5cd33 admin admin] REQUEST_METHOD: `PUT` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:24:16.704123 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d19a1a-8ab2-4ecc-b3ba-a233bdf5cd33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:24:16.705293 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d19a1a-8ab2-4ecc-b3ba-a233bdf5cd33 admin admin] PATH_INFO: `/v3/projects/0861bcf6de704e0aa60ec680dab923c8/users/fc8ddc9149fa4ed9850e8adfbca3d2a1/roles/5c07cf5bfbd3427db18428aa50420962` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:24:16.728049 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d19a1a-8ab2-4ecc-b3ba-a233bdf5cd33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0861bcf6de704e0aa60ec680dab923c8, user_id=fc8ddc9149fa4ed9850e8adfbca3d2a1, role_id=5c07cf5bfbd3427db18428aa50420962)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:24:16.730941 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d19a1a-8ab2-4ecc-b3ba-a233bdf5cd33 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:24:16.746566 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1100/2219] 10.222.0.70 () {60 vars in 1482 bytes} [Tue May 10 19:24:16 2022] PUT /identity/v3/projects/0861bcf6de704e0aa60ec680dab923c8/users/fc8ddc9149fa4ed9850e8adfbca3d2a1/roles/5c07cf5bfbd3427db18428aa50420962 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:24:16.757609 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c00b745-d465-491d-a8b1-ea306c5fbf28 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:24:16.758133 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c00b745-d465-491d-a8b1-ea306c5fbf28 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:24:16.758362 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c00b745-d465-491d-a8b1-ea306c5fbf28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:24:16.787721 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-3c00b745-d465-491d-a8b1-ea306c5fbf28 None None] MFA Rules not processed for user `fc8ddc9149fa4ed9850e8adfbca3d2a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:24:16.789005 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-3c00b745-d465-491d-a8b1-ea306c5fbf28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:24:16.859781 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1120/2220] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:24:16 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:24:16.871365 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d19a1a-8ab2-4ecc-b3ba-a233bdf5cd33 admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:24:16.873044 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-41d19a1a-8ab2-4ecc-b3ba-a233bdf5cd33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:24:16.928368 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d19a1a-8ab2-4ecc-b3ba-a233bdf5cd33 admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:24:16.931878 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd89000f-e69b-4147-9b2d-2a3b9bc365e0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24ca97ff2a1745e58dedba4cef61b3f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:24:16.932542 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd89000f-e69b-4147-9b2d-2a3b9bc365e0 service glance] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:24:16.932823 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd89000f-e69b-4147-9b2d-2a3b9bc365e0 service glance] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:24:16.933092 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd89000f-e69b-4147-9b2d-2a3b9bc365e0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:24:16.941242 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd89000f-e69b-4147-9b2d-2a3b9bc365e0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:24:16.942723 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd89000f-e69b-4147-9b2d-2a3b9bc365e0 service glance] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:24:16.951893 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1101/2221] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:24:16 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:24:31.841739 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40614d47-3ebe-4787-a75b-6bf1d74af859 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:24:31.842298 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40614d47-3ebe-4787-a75b-6bf1d74af859 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:24:31.842298 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40614d47-3ebe-4787-a75b-6bf1d74af859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:24:31.860491 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-40614d47-3ebe-4787-a75b-6bf1d74af859 None None] MFA Rules not processed for user `058e52f1bf0b4aba965d945815d4acb3`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:24:31.861702 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-40614d47-3ebe-4787-a75b-6bf1d74af859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:24:31.916526 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1121/2222] 10.222.0.70 () {58 vars in 967 bytes} [Tue May 10 19:24:31 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:24:31.928726 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd89000f-e69b-4147-9b2d-2a3b9bc365e0 service glance] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:24:31.930131 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-fd89000f-e69b-4147-9b2d-2a3b9bc365e0 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:24:32.012143 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd89000f-e69b-4147-9b2d-2a3b9bc365e0 service glance] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:24:32.017126 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed3ee78-5baa-4b82-a5bd-8d633a73c367 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0454aa03fa31487ea1464b9d0008212c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:24:32.017774 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed3ee78-5baa-4b82-a5bd-8d633a73c367 service swift] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:24:32.018096 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed3ee78-5baa-4b82-a5bd-8d633a73c367 service swift] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:24:32.018364 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed3ee78-5baa-4b82-a5bd-8d633a73c367 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:24:32.027246 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed3ee78-5baa-4b82-a5bd-8d633a73c367 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:24:32.028874 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed3ee78-5baa-4b82-a5bd-8d633a73c367 service swift] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:24:32.036703 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1102/2223] 10.222.0.70 () {60 vars in 1384 bytes} [Tue May 10 19:24:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 19:24:36.367373 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40614d47-3ebe-4787-a75b-6bf1d74af859 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:24:36.369925 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-40614d47-3ebe-4787-a75b-6bf1d74af859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:24:36.431000 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40614d47-3ebe-4787-a75b-6bf1d74af859 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:24:36.434920 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ebe02f-30f6-469b-868f-6a036a2fa6ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f1dc79540b48c0866478cc48cd8205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:24:36.435576 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ebe02f-30f6-469b-868f-6a036a2fa6ce service neutron] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:24:36.435858 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ebe02f-30f6-469b-868f-6a036a2fa6ce service neutron] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:24:36.436129 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ebe02f-30f6-469b-868f-6a036a2fa6ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:24:36.438594 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-64ebe02f-30f6-469b-868f-6a036a2fa6ce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:24:36.514996 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ebe02f-30f6-469b-868f-6a036a2fa6ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:24:36.516779 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ebe02f-30f6-469b-868f-6a036a2fa6ce service neutron] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:24:36.538383 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1122/2224] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:24:36 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:24:59.781600 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed3ee78-5baa-4b82-a5bd-8d633a73c367 service swift] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:24:59.844111 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed3ee78-5baa-4b82-a5bd-8d633a73c367 service swift] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:24:59.848721 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ad3e79-2a5b-4618-8b17-550071ba49e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:24:59.849594 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ad3e79-2a5b-4618-8b17-550071ba49e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:24:59.849879 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ad3e79-2a5b-4618-8b17-550071ba49e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:24:59.850154 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ad3e79-2a5b-4618-8b17-550071ba49e9 admin admin] PATH_INFO: `/v3/users/fc8ddc9149fa4ed9850e8adfbca3d2a1` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:24:59.851348 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ad3e79-2a5b-4618-8b17-550071ba49e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc8ddc9149fa4ed9850e8adfbca3d2a1)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:24:59.853825 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ad3e79-2a5b-4618-8b17-550071ba49e9 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:24:59.899093 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-d6ad3e79-2a5b-4618-8b17-550071ba49e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc8ddc9149fa4ed9850e8adfbca3d2a1'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:24:59.910708 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-d6ad3e79-2a5b-4618-8b17-550071ba49e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc8ddc9149fa4ed9850e8adfbca3d2a1'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:24:59.917801 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-d6ad3e79-2a5b-4618-8b17-550071ba49e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc8ddc9149fa4ed9850e8adfbca3d2a1'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:24:59.918501 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-d6ad3e79-2a5b-4618-8b17-550071ba49e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc8ddc9149fa4ed9850e8adfbca3d2a1'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:24:59.925375 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-d6ad3e79-2a5b-4618-8b17-550071ba49e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc8ddc9149fa4ed9850e8adfbca3d2a1'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:24:59.932741 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1103/2225] 10.222.0.70 () {58 vars in 1223 bytes} [Tue May 10 19:24:59 2022] DELETE /identity/v3/users/fc8ddc9149fa4ed9850e8adfbca3d2a1 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:24:59.937128 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eb60a1-09e4-472d-bdbc-53e34137dcd4 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:24:59.937653 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eb60a1-09e4-472d-bdbc-53e34137dcd4 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:24:59.937786 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eb60a1-09e4-472d-bdbc-53e34137dcd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:24:59.955524 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-e8eb60a1-09e4-472d-bdbc-53e34137dcd4 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:24:59.956841 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-e8eb60a1-09e4-472d-bdbc-53e34137dcd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:25:00.016348 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1123/2226] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:24:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:25:00.026509 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ad3e79-2a5b-4618-8b17-550071ba49e9 admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:25:00.027895 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-d6ad3e79-2a5b-4618-8b17-550071ba49e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:25:00.083622 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ad3e79-2a5b-4618-8b17-550071ba49e9 admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:25:00.087905 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e42fc1-451f-4f55-a7e8-916be66bb1df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f1dc79540b48c0866478cc48cd8205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:25:00.088612 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e42fc1-451f-4f55-a7e8-916be66bb1df service neutron] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:25:00.088898 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e42fc1-451f-4f55-a7e8-916be66bb1df service neutron] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:25:00.089171 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e42fc1-451f-4f55-a7e8-916be66bb1df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:25:00.099105 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e42fc1-451f-4f55-a7e8-916be66bb1df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:25:00.100692 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e42fc1-451f-4f55-a7e8-916be66bb1df service neutron] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:25:00.111844 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1104/2227] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:25:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:25:00.392578 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8eb60a1-09e4-472d-bdbc-53e34137dcd4 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:25:00.394224 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-e8eb60a1-09e4-472d-bdbc-53e34137dcd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:25:00.411091 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8eb60a1-09e4-472d-bdbc-53e34137dcd4 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:25:00.415988 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582c3ac4-9826-4851-a83c-d44f791589ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:25:00.416915 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582c3ac4-9826-4851-a83c-d44f791589ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:25:00.417236 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582c3ac4-9826-4851-a83c-d44f791589ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:25:00.417453 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582c3ac4-9826-4851-a83c-d44f791589ff admin admin] PATH_INFO: `/v3/projects/0861bcf6de704e0aa60ec680dab923c8` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:25:00.419040 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582c3ac4-9826-4851-a83c-d44f791589ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=0861bcf6de704e0aa60ec680dab923c8)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:25:00.420994 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582c3ac4-9826-4851-a83c-d44f791589ff admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:25:00.468696 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-582c3ac4-9826-4851-a83c-d44f791589ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0861bcf6de704e0aa60ec680dab923c8', 'request_id': 'req-582c3ac4-9826-4851-a83c-d44f791589ff'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:25:00.474010 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-582c3ac4-9826-4851-a83c-d44f791589ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0861bcf6de704e0aa60ec680dab923c8', 'request_id': 'req-582c3ac4-9826-4851-a83c-d44f791589ff'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:25:00.481792 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-582c3ac4-9826-4851-a83c-d44f791589ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0861bcf6de704e0aa60ec680dab923c8', 'request_id': 'req-582c3ac4-9826-4851-a83c-d44f791589ff'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:25:00.493202 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-582c3ac4-9826-4851-a83c-d44f791589ff admin admin] The token cache is being invalidate because project 0861bcf6de704e0aa60ec680dab923c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79994) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:25:00.493498 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-582c3ac4-9826-4851-a83c-d44f791589ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:25:00.494120 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-582c3ac4-9826-4851-a83c-d44f791589ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:25:00.495664 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1124/2228] 10.222.0.70 () {58 vars in 1232 bytes} [Tue May 10 19:25:00 2022] DELETE /identity/v3/projects/0861bcf6de704e0aa60ec680dab923c8 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:25:00.500533 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dce5fa-e4ff-43b3-aa53-5be4995a6b1b None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:25:00.500830 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dce5fa-e4ff-43b3-aa53-5be4995a6b1b None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:25:00.501109 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dce5fa-e4ff-43b3-aa53-5be4995a6b1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:25:00.518418 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-05dce5fa-e4ff-43b3-aa53-5be4995a6b1b None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:25:00.519535 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-05dce5fa-e4ff-43b3-aa53-5be4995a6b1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:25:00.583055 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1105/2229] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:25:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:25:00.584721 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7573c38a-c183-4222-833f-94af6f3da0ba None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:25:00.585008 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7573c38a-c183-4222-833f-94af6f3da0ba None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:25:00.585325 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7573c38a-c183-4222-833f-94af6f3da0ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:25:00.604647 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-7573c38a-c183-4222-833f-94af6f3da0ba None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:25:00.605838 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-7573c38a-c183-4222-833f-94af6f3da0ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:25:00.613632 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1125/2230] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:25:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:25:00.618575 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dce5fa-e4ff-43b3-aa53-5be4995a6b1b None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:25:00.628246 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dce5fa-e4ff-43b3-aa53-5be4995a6b1b None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:25:00.633704 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6d5cba-6ed4-4321-ba16-222ace010af4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:25:00.634373 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6d5cba-6ed4-4321-ba16-222ace010af4 admin admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:25:00.634659 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6d5cba-6ed4-4321-ba16-222ace010af4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:25:00.634937 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6d5cba-6ed4-4321-ba16-222ace010af4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:25:00.635667 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6d5cba-6ed4-4321-ba16-222ace010af4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:25:00.635974 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6d5cba-6ed4-4321-ba16-222ace010af4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:25:00.637612 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6d5cba-6ed4-4321-ba16-222ace010af4 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:25:00.649488 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1106/2231] 10.222.0.70 () {58 vars in 1152 bytes} [Tue May 10 19:25:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:25:00.653808 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7573c38a-c183-4222-833f-94af6f3da0ba None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:25:00.663693 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7573c38a-c183-4222-833f-94af6f3da0ba None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:25:00.669270 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124d3975-e15b-4f54-811d-0f7391c8c186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:25:00.670071 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124d3975-e15b-4f54-811d-0f7391c8c186 admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:25:00.670425 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124d3975-e15b-4f54-811d-0f7391c8c186 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:25:00.670772 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124d3975-e15b-4f54-811d-0f7391c8c186 admin admin] PATH_INFO: `/v3/projects` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:25:00.671530 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124d3975-e15b-4f54-811d-0f7391c8c186 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:25:00.673565 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124d3975-e15b-4f54-811d-0f7391c8c186 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:25:00.701002 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1126/2232] 10.222.0.70 () {60 vars in 1152 bytes} [Tue May 10 19:25:00 2022] POST /identity/v3/projects => generated 369 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:25:00.705111 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6d5cba-6ed4-4321-ba16-222ace010af4 admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:25:00.716487 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6d5cba-6ed4-4321-ba16-222ace010af4 admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:25:00.771086 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a610a96d-b91b-43bc-9ec0-df02754c50ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:25:00.771688 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a610a96d-b91b-43bc-9ec0-df02754c50ba admin admin] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:25:00.771974 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a610a96d-b91b-43bc-9ec0-df02754c50ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:25:00.772254 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a610a96d-b91b-43bc-9ec0-df02754c50ba admin admin] PATH_INFO: `/v3/users` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:25:00.773059 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a610a96d-b91b-43bc-9ec0-df02754c50ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:25:00.775494 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a610a96d-b91b-43bc-9ec0-df02754c50ba admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:25:00.794982 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1107/2233] 10.222.0.70 () {60 vars in 1143 bytes} [Tue May 10 19:25:00 2022] POST /identity/v3/users => generated 285 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:25:00.799086 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124d3975-e15b-4f54-811d-0f7391c8c186 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:25:00.809840 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124d3975-e15b-4f54-811d-0f7391c8c186 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:25:00.814366 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193b024e-fa63-44b4-a312-3de87f53b9b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:25:00.815030 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193b024e-fa63-44b4-a312-3de87f53b9b7 admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:25:00.815290 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193b024e-fa63-44b4-a312-3de87f53b9b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:25:00.815580 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193b024e-fa63-44b4-a312-3de87f53b9b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:25:00.816276 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193b024e-fa63-44b4-a312-3de87f53b9b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:25:00.818353 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193b024e-fa63-44b4-a312-3de87f53b9b7 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:25:00.829485 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1127/2234] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:25:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:25:00.833426 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a610a96d-b91b-43bc-9ec0-df02754c50ba admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:25:00.843192 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a610a96d-b91b-43bc-9ec0-df02754c50ba admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:25:00.847730 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f606de07-ef37-459f-8494-d61958523925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:25:00.848374 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f606de07-ef37-459f-8494-d61958523925 admin admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:25:00.848693 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f606de07-ef37-459f-8494-d61958523925 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:25:00.848968 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f606de07-ef37-459f-8494-d61958523925 admin admin] PATH_INFO: `/v3/roles` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:25:00.849679 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f606de07-ef37-459f-8494-d61958523925 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:25:00.851281 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f606de07-ef37-459f-8494-d61958523925 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:25:00.860830 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1108/2235] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:25:00 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 19:25:00.864721 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193b024e-fa63-44b4-a312-3de87f53b9b7 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:25:00.874933 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193b024e-fa63-44b4-a312-3de87f53b9b7 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:25:00.879448 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889e841b-c18a-4f81-aa0c-60ff5c2b4b3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:25:00.880308 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889e841b-c18a-4f81-aa0c-60ff5c2b4b3a admin admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:25:00.880624 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889e841b-c18a-4f81-aa0c-60ff5c2b4b3a admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:25:00.880894 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889e841b-c18a-4f81-aa0c-60ff5c2b4b3a admin admin] PATH_INFO: `/v3/projects/789da060576a494baec0442dee7cf80b/users/febf0819a3c54730a500344ad4b05940/roles/5c07cf5bfbd3427db18428aa50420962` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:25:00.895683 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889e841b-c18a-4f81-aa0c-60ff5c2b4b3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=789da060576a494baec0442dee7cf80b, user_id=febf0819a3c54730a500344ad4b05940, role_id=5c07cf5bfbd3427db18428aa50420962)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:25:00.898358 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889e841b-c18a-4f81-aa0c-60ff5c2b4b3a admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:25:00.910449 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1128/2236] 10.222.0.70 () {60 vars in 1482 bytes} [Tue May 10 19:25:00 2022] PUT /identity/v3/projects/789da060576a494baec0442dee7cf80b/users/febf0819a3c54730a500344ad4b05940/roles/5c07cf5bfbd3427db18428aa50420962 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 19:25:00.921792 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fec4911-07e0-41c1-84c7-ebef7a72dc8d None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:25:00.922085 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fec4911-07e0-41c1-84c7-ebef7a72dc8d None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:25:00.922362 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fec4911-07e0-41c1-84c7-ebef7a72dc8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:25:00.950476 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-7fec4911-07e0-41c1-84c7-ebef7a72dc8d None None] MFA Rules not processed for user `febf0819a3c54730a500344ad4b05940`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:25:00.951701 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-7fec4911-07e0-41c1-84c7-ebef7a72dc8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:25:01.019211 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1109/2237] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:25:00 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:25:01.032643 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889e841b-c18a-4f81-aa0c-60ff5c2b4b3a admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:25:01.034477 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-889e841b-c18a-4f81-aa0c-60ff5c2b4b3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:25:01.099451 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889e841b-c18a-4f81-aa0c-60ff5c2b4b3a admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:25:01.104300 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4aa662a-ef49-4405-8eaa-f4d76ab740da service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24ca97ff2a1745e58dedba4cef61b3f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:25:01.104997 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aa662a-ef49-4405-8eaa-f4d76ab740da service glance] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:25:01.105414 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aa662a-ef49-4405-8eaa-f4d76ab740da service glance] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:25:01.105699 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aa662a-ef49-4405-8eaa-f4d76ab740da service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:25:01.115731 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4aa662a-ef49-4405-8eaa-f4d76ab740da service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:25:01.118212 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4aa662a-ef49-4405-8eaa-f4d76ab740da service glance] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:25:01.128287 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1129/2238] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:25:01 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:25:28.510295 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fec4911-07e0-41c1-84c7-ebef7a72dc8d None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:25:28.510295 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-7fec4911-07e0-41c1-84c7-ebef7a72dc8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:25:28.578331 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fec4911-07e0-41c1-84c7-ebef7a72dc8d None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:25:28.582866 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf92eaeb-937f-438b-8dbf-3984bda3aa46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:25:28.583735 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf92eaeb-937f-438b-8dbf-3984bda3aa46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:25:28.584014 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf92eaeb-937f-438b-8dbf-3984bda3aa46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:25:28.584286 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf92eaeb-937f-438b-8dbf-3984bda3aa46 admin admin] PATH_INFO: `/v3/users/221e215caae34d08a9b8f36c711b4318` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:25:28.585505 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf92eaeb-937f-438b-8dbf-3984bda3aa46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=221e215caae34d08a9b8f36c711b4318)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:25:28.587485 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf92eaeb-937f-438b-8dbf-3984bda3aa46 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:25:28.635337 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-bf92eaeb-937f-438b-8dbf-3984bda3aa46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '221e215caae34d08a9b8f36c711b4318'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:25:28.646680 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-bf92eaeb-937f-438b-8dbf-3984bda3aa46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '221e215caae34d08a9b8f36c711b4318'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:25:28.653688 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-bf92eaeb-937f-438b-8dbf-3984bda3aa46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '221e215caae34d08a9b8f36c711b4318'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:25:28.654347 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-bf92eaeb-937f-438b-8dbf-3984bda3aa46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '221e215caae34d08a9b8f36c711b4318'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:25:28.661661 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-bf92eaeb-937f-438b-8dbf-3984bda3aa46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '221e215caae34d08a9b8f36c711b4318'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:25:28.668750 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1110/2239] 10.222.0.70 () {58 vars in 1223 bytes} [Tue May 10 19:25:28 2022] DELETE /identity/v3/users/221e215caae34d08a9b8f36c711b4318 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:25:28.842172 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4aa662a-ef49-4405-8eaa-f4d76ab740da service glance] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:25:28.853395 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4aa662a-ef49-4405-8eaa-f4d76ab740da service glance] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:25:28.921958 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af23da72-210f-4c23-8df1-7af7a2d74014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:25:28.922810 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af23da72-210f-4c23-8df1-7af7a2d74014 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:25:28.923089 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af23da72-210f-4c23-8df1-7af7a2d74014 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:25:28.923361 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af23da72-210f-4c23-8df1-7af7a2d74014 admin admin] PATH_INFO: `/v3/projects/5f9cf73cfc1043eb95dd842193435253` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:25:28.924558 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af23da72-210f-4c23-8df1-7af7a2d74014 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f9cf73cfc1043eb95dd842193435253)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:25:28.926455 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af23da72-210f-4c23-8df1-7af7a2d74014 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:25:28.974973 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-af23da72-210f-4c23-8df1-7af7a2d74014 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f9cf73cfc1043eb95dd842193435253', 'request_id': 'req-af23da72-210f-4c23-8df1-7af7a2d74014'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:25:28.980692 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-af23da72-210f-4c23-8df1-7af7a2d74014 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f9cf73cfc1043eb95dd842193435253', 'request_id': 'req-af23da72-210f-4c23-8df1-7af7a2d74014'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:25:28.990863 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-af23da72-210f-4c23-8df1-7af7a2d74014 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f9cf73cfc1043eb95dd842193435253', 'request_id': 'req-af23da72-210f-4c23-8df1-7af7a2d74014'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:25:29.002760 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-af23da72-210f-4c23-8df1-7af7a2d74014 admin admin] The token cache is being invalidate because project 5f9cf73cfc1043eb95dd842193435253 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79994) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:25:29.003046 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-af23da72-210f-4c23-8df1-7af7a2d74014 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:25:29.004821 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-af23da72-210f-4c23-8df1-7af7a2d74014 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:25:29.006832 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1130/2240] 10.222.0.70 () {58 vars in 1232 bytes} [Tue May 10 19:25:28 2022] DELETE /identity/v3/projects/5f9cf73cfc1043eb95dd842193435253 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:25:29.012429 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85368ac6-5010-4ee6-ab3a-91fb05687905 None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:25:29.012765 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85368ac6-5010-4ee6-ab3a-91fb05687905 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:25:29.013044 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85368ac6-5010-4ee6-ab3a-91fb05687905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:25:29.032725 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-85368ac6-5010-4ee6-ab3a-91fb05687905 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:25:29.034053 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-85368ac6-5010-4ee6-ab3a-91fb05687905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:25:29.094672 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1111/2241] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:25:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:25:29.102312 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d089f2-943a-425b-af61-a07d7875932a None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:25:29.102599 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d089f2-943a-425b-af61-a07d7875932a None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:25:29.102877 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d089f2-943a-425b-af61-a07d7875932a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:25:29.121384 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-e2d089f2-943a-425b-af61-a07d7875932a None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:25:29.122644 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-e2d089f2-943a-425b-af61-a07d7875932a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:25:29.132102 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1131/2242] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:25:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:25:29.136715 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85368ac6-5010-4ee6-ab3a-91fb05687905 None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:25:29.146161 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85368ac6-5010-4ee6-ab3a-91fb05687905 None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:25:29.150659 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764d9622-dbdc-4b69-a697-16f234b0caad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:25:29.151305 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764d9622-dbdc-4b69-a697-16f234b0caad admin admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:25:29.151590 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764d9622-dbdc-4b69-a697-16f234b0caad admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:25:29.151863 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764d9622-dbdc-4b69-a697-16f234b0caad admin admin] PATH_INFO: `/v3/domains` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:25:29.152613 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764d9622-dbdc-4b69-a697-16f234b0caad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:25:29.152917 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764d9622-dbdc-4b69-a697-16f234b0caad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:25:29.154490 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764d9622-dbdc-4b69-a697-16f234b0caad admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:25:29.165520 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1112/2243] 10.222.0.70 () {58 vars in 1152 bytes} [Tue May 10 19:25:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:25:29.169569 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d089f2-943a-425b-af61-a07d7875932a None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:25:29.178467 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d089f2-943a-425b-af61-a07d7875932a None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:25:29.183725 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c1f81d-8f9e-4fb7-95fa-83f5ba19dbfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:25:29.184370 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c1f81d-8f9e-4fb7-95fa-83f5ba19dbfe admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:25:29.184686 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c1f81d-8f9e-4fb7-95fa-83f5ba19dbfe admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:25:29.184960 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c1f81d-8f9e-4fb7-95fa-83f5ba19dbfe admin admin] PATH_INFO: `/v3/projects` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:25:29.185641 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c1f81d-8f9e-4fb7-95fa-83f5ba19dbfe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:25:29.187528 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c1f81d-8f9e-4fb7-95fa-83f5ba19dbfe admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:25:29.212065 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1132/2244] 10.222.0.70 () {60 vars in 1152 bytes} [Tue May 10 19:25:29 2022] POST /identity/v3/projects => generated 371 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:25:29.216225 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764d9622-dbdc-4b69-a697-16f234b0caad admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:25:29.225974 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764d9622-dbdc-4b69-a697-16f234b0caad admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:25:29.279465 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e6cf7f-e882-4652-a0eb-50bd7619bd1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:25:29.280162 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e6cf7f-e882-4652-a0eb-50bd7619bd1c admin admin] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:25:29.280480 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e6cf7f-e882-4652-a0eb-50bd7619bd1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:25:29.280765 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e6cf7f-e882-4652-a0eb-50bd7619bd1c admin admin] PATH_INFO: `/v3/users` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:25:29.281448 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e6cf7f-e882-4652-a0eb-50bd7619bd1c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:25:29.283387 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e6cf7f-e882-4652-a0eb-50bd7619bd1c admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:25:29.302156 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1113/2245] 10.222.0.70 () {60 vars in 1143 bytes} [Tue May 10 19:25:29 2022] POST /identity/v3/users => generated 286 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:25:29.306130 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c1f81d-8f9e-4fb7-95fa-83f5ba19dbfe admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:25:29.316476 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c1f81d-8f9e-4fb7-95fa-83f5ba19dbfe admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:25:29.321028 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84d2ff7-48d4-404b-8dc3-fb1317665601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:25:29.321935 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84d2ff7-48d4-404b-8dc3-fb1317665601 admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:25:29.322217 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84d2ff7-48d4-404b-8dc3-fb1317665601 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:25:29.322495 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84d2ff7-48d4-404b-8dc3-fb1317665601 admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:25:29.323876 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84d2ff7-48d4-404b-8dc3-fb1317665601 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:25:29.325500 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84d2ff7-48d4-404b-8dc3-fb1317665601 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:25:29.335493 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1133/2246] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:25:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:25:29.339022 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e6cf7f-e882-4652-a0eb-50bd7619bd1c admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:25:29.348921 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e6cf7f-e882-4652-a0eb-50bd7619bd1c admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:25:29.353337 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa5232a-fcec-4703-850a-591e532d132c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:25:29.353968 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa5232a-fcec-4703-850a-591e532d132c admin admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:25:29.354248 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa5232a-fcec-4703-850a-591e532d132c admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:25:29.354525 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa5232a-fcec-4703-850a-591e532d132c admin admin] PATH_INFO: `/v3/roles` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:25:29.355225 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa5232a-fcec-4703-850a-591e532d132c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:25:29.356823 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa5232a-fcec-4703-850a-591e532d132c admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:25:29.366431 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1114/2247] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:25:29 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 19:25:29.371044 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84d2ff7-48d4-404b-8dc3-fb1317665601 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:25:29.380860 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84d2ff7-48d4-404b-8dc3-fb1317665601 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:25:29.386090 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73385df7-c0f3-40c3-beb9-1f02e4f6e0a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:25:29.386893 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73385df7-c0f3-40c3-beb9-1f02e4f6e0a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:25:29.387173 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73385df7-c0f3-40c3-beb9-1f02e4f6e0a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:25:29.387446 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73385df7-c0f3-40c3-beb9-1f02e4f6e0a1 admin admin] PATH_INFO: `/v3/projects/5c6ebef4c7f34f3dac195244855d9292/users/cdb08a49fd924e4c9f9cae5e7a6e44b0/roles/5c07cf5bfbd3427db18428aa50420962` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:25:29.401548 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73385df7-c0f3-40c3-beb9-1f02e4f6e0a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c6ebef4c7f34f3dac195244855d9292, user_id=cdb08a49fd924e4c9f9cae5e7a6e44b0, role_id=5c07cf5bfbd3427db18428aa50420962)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:25:29.404170 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73385df7-c0f3-40c3-beb9-1f02e4f6e0a1 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:25:29.417831 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1134/2248] 10.222.0.70 () {60 vars in 1482 bytes} [Tue May 10 19:25:29 2022] PUT /identity/v3/projects/5c6ebef4c7f34f3dac195244855d9292/users/cdb08a49fd924e4c9f9cae5e7a6e44b0/roles/5c07cf5bfbd3427db18428aa50420962 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:25:29.422806 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080e3520-6aae-4aec-8e12-b9080cf2801d None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:25:29.423096 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080e3520-6aae-4aec-8e12-b9080cf2801d None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:25:29.423401 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080e3520-6aae-4aec-8e12-b9080cf2801d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:25:29.440767 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-080e3520-6aae-4aec-8e12-b9080cf2801d None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:25:29.441931 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-080e3520-6aae-4aec-8e12-b9080cf2801d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:25:29.498725 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1115/2249] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:25:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:25:29.508177 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73385df7-c0f3-40c3-beb9-1f02e4f6e0a1 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:25:29.509892 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-73385df7-c0f3-40c3-beb9-1f02e4f6e0a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:25:29.568866 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73385df7-c0f3-40c3-beb9-1f02e4f6e0a1 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:25:29.572855 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09e5354-e116-4f1b-a7fe-e2fdc8bfe281 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f1dc79540b48c0866478cc48cd8205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:25:29.574236 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09e5354-e116-4f1b-a7fe-e2fdc8bfe281 service neutron] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:25:29.574508 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09e5354-e116-4f1b-a7fe-e2fdc8bfe281 service neutron] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:25:29.574778 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09e5354-e116-4f1b-a7fe-e2fdc8bfe281 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:25:29.583975 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09e5354-e116-4f1b-a7fe-e2fdc8bfe281 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:25:29.585444 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09e5354-e116-4f1b-a7fe-e2fdc8bfe281 service neutron] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:25:29.595296 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1135/2250] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:25:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:25:30.441950 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c822032-8672-402d-b13f-2c87c06db221 None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:25:30.442471 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c822032-8672-402d-b13f-2c87c06db221 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:25:30.442571 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c822032-8672-402d-b13f-2c87c06db221 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:25:30.495571 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-2c822032-8672-402d-b13f-2c87c06db221 None None] MFA Rules not processed for user `4c7ce54253764d788ea48b5ff9b43d54`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:25:30.497174 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-2c822032-8672-402d-b13f-2c87c06db221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:25:30.561567 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1116/2251] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:25:30 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:25:32.111472 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09e5354-e116-4f1b-a7fe-e2fdc8bfe281 service neutron] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:25:32.113149 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-a09e5354-e116-4f1b-a7fe-e2fdc8bfe281 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:25:32.134367 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09e5354-e116-4f1b-a7fe-e2fdc8bfe281 service neutron] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:25:32.142153 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe104ae0-441d-4bae-aafc-b208c070ff09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:25:32.143624 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe104ae0-441d-4bae-aafc-b208c070ff09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:25:32.143912 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe104ae0-441d-4bae-aafc-b208c070ff09 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:25:32.144183 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe104ae0-441d-4bae-aafc-b208c070ff09 admin admin] PATH_INFO: `/v3/users/febf0819a3c54730a500344ad4b05940` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:25:32.145655 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe104ae0-441d-4bae-aafc-b208c070ff09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=febf0819a3c54730a500344ad4b05940)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:25:32.148576 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe104ae0-441d-4bae-aafc-b208c070ff09 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:25:32.233707 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-fe104ae0-441d-4bae-aafc-b208c070ff09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'febf0819a3c54730a500344ad4b05940'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:25:32.246931 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-fe104ae0-441d-4bae-aafc-b208c070ff09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'febf0819a3c54730a500344ad4b05940'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:25:32.249688 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-fe104ae0-441d-4bae-aafc-b208c070ff09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'febf0819a3c54730a500344ad4b05940'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:25:32.255712 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-fe104ae0-441d-4bae-aafc-b208c070ff09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'febf0819a3c54730a500344ad4b05940'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:25:32.262909 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-fe104ae0-441d-4bae-aafc-b208c070ff09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'febf0819a3c54730a500344ad4b05940'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:25:32.275778 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1136/2252] 10.222.0.70 () {58 vars in 1223 bytes} [Tue May 10 19:25:32 2022] DELETE /identity/v3/users/febf0819a3c54730a500344ad4b05940 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:25:32.277124 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dc96f1-43e6-4d19-a105-5aaa9a87102f None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:25:32.277506 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dc96f1-43e6-4d19-a105-5aaa9a87102f None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:25:32.277684 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dc96f1-43e6-4d19-a105-5aaa9a87102f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:25:32.297264 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-76dc96f1-43e6-4d19-a105-5aaa9a87102f None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:25:32.298731 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-76dc96f1-43e6-4d19-a105-5aaa9a87102f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:25:32.373090 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1117/2253] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:25:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:25:32.382517 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe104ae0-441d-4bae-aafc-b208c070ff09 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:25:32.384085 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-fe104ae0-441d-4bae-aafc-b208c070ff09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:25:32.501417 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe104ae0-441d-4bae-aafc-b208c070ff09 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:25:32.505537 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fac9b26-0a17-41ec-b3c6-3f119f43271b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f1dc79540b48c0866478cc48cd8205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:25:32.506339 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fac9b26-0a17-41ec-b3c6-3f119f43271b service neutron] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:25:32.506632 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fac9b26-0a17-41ec-b3c6-3f119f43271b service neutron] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:25:32.506909 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fac9b26-0a17-41ec-b3c6-3f119f43271b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:25:32.527584 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fac9b26-0a17-41ec-b3c6-3f119f43271b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:25:32.529086 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fac9b26-0a17-41ec-b3c6-3f119f43271b service neutron] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:25:32.568001 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1137/2254] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:25:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:25:33.306858 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dc96f1-43e6-4d19-a105-5aaa9a87102f None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:25:33.308918 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-76dc96f1-43e6-4d19-a105-5aaa9a87102f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:25:33.332453 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dc96f1-43e6-4d19-a105-5aaa9a87102f None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:25:33.338870 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6cd826-3cb3-4004-95a6-2484b2147e3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:25:33.340483 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6cd826-3cb3-4004-95a6-2484b2147e3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:25:33.343879 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6cd826-3cb3-4004-95a6-2484b2147e3c admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:25:33.344412 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6cd826-3cb3-4004-95a6-2484b2147e3c admin admin] PATH_INFO: `/v3/projects/789da060576a494baec0442dee7cf80b` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:25:33.350441 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6cd826-3cb3-4004-95a6-2484b2147e3c admin admin] RBAC: Authorizing `identity:delete_project(project_id=789da060576a494baec0442dee7cf80b)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:25:33.354575 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6cd826-3cb3-4004-95a6-2484b2147e3c admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:25:33.442125 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-fc6cd826-3cb3-4004-95a6-2484b2147e3c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '789da060576a494baec0442dee7cf80b', 'request_id': 'req-fc6cd826-3cb3-4004-95a6-2484b2147e3c'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:25:33.452327 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-fc6cd826-3cb3-4004-95a6-2484b2147e3c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '789da060576a494baec0442dee7cf80b', 'request_id': 'req-fc6cd826-3cb3-4004-95a6-2484b2147e3c'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:25:33.489513 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-fc6cd826-3cb3-4004-95a6-2484b2147e3c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '789da060576a494baec0442dee7cf80b', 'request_id': 'req-fc6cd826-3cb3-4004-95a6-2484b2147e3c'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:25:33.507488 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-fc6cd826-3cb3-4004-95a6-2484b2147e3c admin admin] The token cache is being invalidate because project 789da060576a494baec0442dee7cf80b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79993) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:25:33.507904 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-fc6cd826-3cb3-4004-95a6-2484b2147e3c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:25:33.508656 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-fc6cd826-3cb3-4004-95a6-2484b2147e3c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:25:33.514019 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1118/2255] 10.222.0.70 () {58 vars in 1232 bytes} [Tue May 10 19:25:33 2022] DELETE /identity/v3/projects/789da060576a494baec0442dee7cf80b => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:25:33.515254 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8f9bec-7ccf-4707-a336-0065b82642a9 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:25:33.515715 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8f9bec-7ccf-4707-a336-0065b82642a9 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:25:33.515829 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8f9bec-7ccf-4707-a336-0065b82642a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:25:33.539275 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-9e8f9bec-7ccf-4707-a336-0065b82642a9 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:25:33.540969 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-9e8f9bec-7ccf-4707-a336-0065b82642a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:25:33.630705 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1138/2256] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:25:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:25:33.638352 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61047cb5-8216-4a20-b081-21fc0a910492 None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:25:33.638646 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61047cb5-8216-4a20-b081-21fc0a910492 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:25:33.638926 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61047cb5-8216-4a20-b081-21fc0a910492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:25:33.681036 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-61047cb5-8216-4a20-b081-21fc0a910492 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:25:33.682550 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-61047cb5-8216-4a20-b081-21fc0a910492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:25:33.694968 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1119/2257] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:25:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:25:33.699287 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8f9bec-7ccf-4707-a336-0065b82642a9 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:25:33.712394 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8f9bec-7ccf-4707-a336-0065b82642a9 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:25:33.739194 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e73ca3-3d54-41d2-b1f8-d6c68c234bb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:25:33.740029 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e73ca3-3d54-41d2-b1f8-d6c68c234bb3 admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:25:33.743484 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e73ca3-3d54-41d2-b1f8-d6c68c234bb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:25:33.743773 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e73ca3-3d54-41d2-b1f8-d6c68c234bb3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:25:33.745448 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e73ca3-3d54-41d2-b1f8-d6c68c234bb3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:25:33.748076 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e73ca3-3d54-41d2-b1f8-d6c68c234bb3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:25:33.753542 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e73ca3-3d54-41d2-b1f8-d6c68c234bb3 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:25:33.804020 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1139/2258] 10.222.0.70 () {58 vars in 1152 bytes} [Tue May 10 19:25:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:25:33.808952 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61047cb5-8216-4a20-b081-21fc0a910492 None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:25:33.824779 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61047cb5-8216-4a20-b081-21fc0a910492 None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:25:33.833061 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c9be52-360c-4d81-b8d8-2ffd5074bbff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:25:33.837087 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c9be52-360c-4d81-b8d8-2ffd5074bbff admin admin] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:25:33.837651 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c9be52-360c-4d81-b8d8-2ffd5074bbff admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:25:33.839627 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c9be52-360c-4d81-b8d8-2ffd5074bbff admin admin] PATH_INFO: `/v3/projects` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:25:33.840612 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c9be52-360c-4d81-b8d8-2ffd5074bbff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:25:33.843131 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c9be52-360c-4d81-b8d8-2ffd5074bbff admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:25:33.882488 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1120/2259] 10.222.0.70 () {60 vars in 1152 bytes} [Tue May 10 19:25:33 2022] POST /identity/v3/projects => generated 383 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:25:33.886412 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e73ca3-3d54-41d2-b1f8-d6c68c234bb3 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:25:33.904961 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e73ca3-3d54-41d2-b1f8-d6c68c234bb3 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:25:34.040831 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617b17b2-eef3-4f39-a9d1-67f0ccebebe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:25:34.041577 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617b17b2-eef3-4f39-a9d1-67f0ccebebe8 admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:25:34.041861 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617b17b2-eef3-4f39-a9d1-67f0ccebebe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:25:34.042132 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617b17b2-eef3-4f39-a9d1-67f0ccebebe8 admin admin] PATH_INFO: `/v3/users` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:25:34.043189 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617b17b2-eef3-4f39-a9d1-67f0ccebebe8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:25:34.045381 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617b17b2-eef3-4f39-a9d1-67f0ccebebe8 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:25:34.086540 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1140/2260] 10.222.0.70 () {60 vars in 1143 bytes} [Tue May 10 19:25:33 2022] POST /identity/v3/users => generated 292 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:25:34.087922 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c9be52-360c-4d81-b8d8-2ffd5074bbff admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:25:34.109040 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c9be52-360c-4d81-b8d8-2ffd5074bbff admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:25:34.120737 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1564a8b-bc79-499f-980f-371a2ef588bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:25:34.130652 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1564a8b-bc79-499f-980f-371a2ef588bb admin admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:25:34.130952 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1564a8b-bc79-499f-980f-371a2ef588bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:25:34.136099 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1564a8b-bc79-499f-980f-371a2ef588bb admin admin] PATH_INFO: `/v3/roles` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:25:34.138234 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1564a8b-bc79-499f-980f-371a2ef588bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:25:34.144655 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1564a8b-bc79-499f-980f-371a2ef588bb admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:25:34.177285 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1121/2261] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:25:34 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:25:34.179657 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617b17b2-eef3-4f39-a9d1-67f0ccebebe8 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:25:34.217826 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617b17b2-eef3-4f39-a9d1-67f0ccebebe8 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:25:34.239358 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed22db1-de9f-4cdb-b557-2e621cca53f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:25:34.240674 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed22db1-de9f-4cdb-b557-2e621cca53f4 admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:25:34.242738 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed22db1-de9f-4cdb-b557-2e621cca53f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:25:34.243259 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed22db1-de9f-4cdb-b557-2e621cca53f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:25:34.246707 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed22db1-de9f-4cdb-b557-2e621cca53f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:25:34.251367 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed22db1-de9f-4cdb-b557-2e621cca53f4 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:25:34.282064 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1564a8b-bc79-499f-980f-371a2ef588bb admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:25:34.282295 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1141/2262] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:25:34 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:25:34.296409 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1564a8b-bc79-499f-980f-371a2ef588bb admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:25:34.306906 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f08b7f-1610-45e6-a37f-11b2b76d3244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:25:34.308351 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f08b7f-1610-45e6-a37f-11b2b76d3244 admin admin] REQUEST_METHOD: `PUT` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:25:34.308351 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f08b7f-1610-45e6-a37f-11b2b76d3244 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:25:34.308573 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f08b7f-1610-45e6-a37f-11b2b76d3244 admin admin] PATH_INFO: `/v3/projects/fb8f2405eb7a484da3d99929e2e78ddb/users/440240e16b394209885d8a1523a8d4fe/roles/5c07cf5bfbd3427db18428aa50420962` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:25:34.350286 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f08b7f-1610-45e6-a37f-11b2b76d3244 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb8f2405eb7a484da3d99929e2e78ddb, user_id=440240e16b394209885d8a1523a8d4fe, role_id=5c07cf5bfbd3427db18428aa50420962)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:25:34.353166 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f08b7f-1610-45e6-a37f-11b2b76d3244 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:25:34.389324 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1122/2263] 10.222.0.70 () {60 vars in 1482 bytes} [Tue May 10 19:25:34 2022] PUT /identity/v3/projects/fb8f2405eb7a484da3d99929e2e78ddb/users/440240e16b394209885d8a1523a8d4fe/roles/5c07cf5bfbd3427db18428aa50420962 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:25:34.394387 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aab8e0e-5921-444f-b304-04cbf56417bb None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:25:34.394782 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aab8e0e-5921-444f-b304-04cbf56417bb None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:25:34.395160 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aab8e0e-5921-444f-b304-04cbf56417bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:25:34.433070 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-7aab8e0e-5921-444f-b304-04cbf56417bb None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:25:34.434413 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-7aab8e0e-5921-444f-b304-04cbf56417bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:25:34.549975 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1142/2264] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:25:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:25:34.563406 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f08b7f-1610-45e6-a37f-11b2b76d3244 admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:25:34.565175 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-d1f08b7f-1610-45e6-a37f-11b2b76d3244 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:25:34.656392 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f08b7f-1610-45e6-a37f-11b2b76d3244 admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:25:34.660731 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce2d913-0610-4d2e-a483-e5dce4f91ccb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f1dc79540b48c0866478cc48cd8205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:25:34.661495 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce2d913-0610-4d2e-a483-e5dce4f91ccb service neutron] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:25:34.661879 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce2d913-0610-4d2e-a483-e5dce4f91ccb service neutron] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:25:34.662622 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce2d913-0610-4d2e-a483-e5dce4f91ccb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:25:34.699043 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce2d913-0610-4d2e-a483-e5dce4f91ccb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:25:34.703673 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce2d913-0610-4d2e-a483-e5dce4f91ccb service neutron] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:25:34.722486 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1123/2265] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:25:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:25:36.815454 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd13a1a-ec7e-4fc3-b732-bbe57466a260 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:25:36.816452 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd13a1a-ec7e-4fc3-b732-bbe57466a260 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:25:36.817052 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd13a1a-ec7e-4fc3-b732-bbe57466a260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:25:36.858522 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-0bd13a1a-ec7e-4fc3-b732-bbe57466a260 None None] MFA Rules not processed for user `cdb08a49fd924e4c9f9cae5e7a6e44b0`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:25:36.863245 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-0bd13a1a-ec7e-4fc3-b732-bbe57466a260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:25:36.934223 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1143/2266] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:25:36 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:25:36.938423 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce2d913-0610-4d2e-a483-e5dce4f91ccb service neutron] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:25:36.939926 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-2ce2d913-0610-4d2e-a483-e5dce4f91ccb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:25:36.966646 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce2d913-0610-4d2e-a483-e5dce4f91ccb service neutron] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:25:36.972550 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787d3c59-690f-4edc-b0e9-e0e22333bf4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:25:36.973442 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787d3c59-690f-4edc-b0e9-e0e22333bf4c admin admin] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:25:36.973885 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787d3c59-690f-4edc-b0e9-e0e22333bf4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:25:36.974317 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787d3c59-690f-4edc-b0e9-e0e22333bf4c admin admin] PATH_INFO: `/v3/projects` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:25:36.975180 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787d3c59-690f-4edc-b0e9-e0e22333bf4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:25:36.977391 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787d3c59-690f-4edc-b0e9-e0e22333bf4c admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:25:37.014773 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1124/2267] 10.222.0.70 () {60 vars in 1152 bytes} [Tue May 10 19:25:36 2022] POST /identity/v3/projects => generated 367 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 19:25:37.017756 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd13a1a-ec7e-4fc3-b732-bbe57466a260 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:25:37.033530 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd13a1a-ec7e-4fc3-b732-bbe57466a260 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:25:37.110743 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dfca5b-56a4-45ae-8395-d362f39ac567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:25:37.111546 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dfca5b-56a4-45ae-8395-d362f39ac567 admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:25:37.111891 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dfca5b-56a4-45ae-8395-d362f39ac567 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:25:37.112233 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dfca5b-56a4-45ae-8395-d362f39ac567 admin admin] PATH_INFO: `/v3/users` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:25:37.113127 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dfca5b-56a4-45ae-8395-d362f39ac567 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:25:37.115015 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dfca5b-56a4-45ae-8395-d362f39ac567 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:25:37.168360 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1144/2268] 10.222.0.70 () {60 vars in 1143 bytes} [Tue May 10 19:25:37 2022] POST /identity/v3/users => generated 290 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 19:25:37.168627 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787d3c59-690f-4edc-b0e9-e0e22333bf4c admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:25:37.182033 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787d3c59-690f-4edc-b0e9-e0e22333bf4c admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:25:37.188259 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6225fb15-74e2-4bb0-9b0b-fd7d1c478ead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:25:37.189233 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6225fb15-74e2-4bb0-9b0b-fd7d1c478ead admin admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:25:37.189705 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6225fb15-74e2-4bb0-9b0b-fd7d1c478ead admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:25:37.190139 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6225fb15-74e2-4bb0-9b0b-fd7d1c478ead admin admin] PATH_INFO: `/v3/roles` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:25:37.191025 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6225fb15-74e2-4bb0-9b0b-fd7d1c478ead admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:25:37.192993 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6225fb15-74e2-4bb0-9b0b-fd7d1c478ead admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:25:37.212402 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1125/2269] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:25:37 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 19:25:37.222982 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dfca5b-56a4-45ae-8395-d362f39ac567 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:25:37.245976 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dfca5b-56a4-45ae-8395-d362f39ac567 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:25:37.251686 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df0d046-3e89-47a6-a20e-09e6bfc28956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:25:37.252766 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df0d046-3e89-47a6-a20e-09e6bfc28956 admin admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:25:37.253161 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df0d046-3e89-47a6-a20e-09e6bfc28956 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:25:37.253522 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df0d046-3e89-47a6-a20e-09e6bfc28956 admin admin] PATH_INFO: `/v3/projects/435f7af7ef4343358131698c12518566/users/01cbe0ba646f410bbd310c4e4d406ba4/roles/634ba284303b4626b5a0402772c68f5c` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:25:37.278945 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df0d046-3e89-47a6-a20e-09e6bfc28956 admin admin] RBAC: Authorizing `identity:create_grant(project_id=435f7af7ef4343358131698c12518566, user_id=01cbe0ba646f410bbd310c4e4d406ba4, role_id=634ba284303b4626b5a0402772c68f5c)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:25:37.283470 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df0d046-3e89-47a6-a20e-09e6bfc28956 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:25:37.304462 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1145/2270] 10.222.0.70 () {60 vars in 1482 bytes} [Tue May 10 19:25:37 2022] PUT /identity/v3/projects/435f7af7ef4343358131698c12518566/users/01cbe0ba646f410bbd310c4e4d406ba4/roles/634ba284303b4626b5a0402772c68f5c => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 19:25:37.306276 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6225fb15-74e2-4bb0-9b0b-fd7d1c478ead admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:25:37.316164 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6225fb15-74e2-4bb0-9b0b-fd7d1c478ead admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:25:37.390220 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28fffae-cab4-443e-b389-c972d890c2ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:25:37.390979 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28fffae-cab4-443e-b389-c972d890c2ad admin admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:25:37.391485 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28fffae-cab4-443e-b389-c972d890c2ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:25:37.391969 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28fffae-cab4-443e-b389-c972d890c2ad admin admin] PATH_INFO: `/v3/roles` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:25:37.392915 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28fffae-cab4-443e-b389-c972d890c2ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:25:37.394600 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28fffae-cab4-443e-b389-c972d890c2ad admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:25:37.406764 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1126/2271] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:25:37 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:25:37.410839 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df0d046-3e89-47a6-a20e-09e6bfc28956 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:25:37.435777 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df0d046-3e89-47a6-a20e-09e6bfc28956 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:25:37.442870 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5a4008-24f6-495c-a743-03efb0235400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:25:37.443892 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5a4008-24f6-495c-a743-03efb0235400 admin admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:25:37.444391 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5a4008-24f6-495c-a743-03efb0235400 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:25:37.445342 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5a4008-24f6-495c-a743-03efb0235400 admin admin] PATH_INFO: `/v3/projects/435f7af7ef4343358131698c12518566/users/01cbe0ba646f410bbd310c4e4d406ba4/roles/634ba284303b4626b5a0402772c68f5c` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:25:37.449516 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5a4008-24f6-495c-a743-03efb0235400 admin admin] RBAC: Authorizing `identity:create_grant(project_id=435f7af7ef4343358131698c12518566, user_id=01cbe0ba646f410bbd310c4e4d406ba4, role_id=634ba284303b4626b5a0402772c68f5c)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:25:37.456080 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5a4008-24f6-495c-a743-03efb0235400 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:25:37.480726 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1146/2272] 10.222.0.70 () {60 vars in 1482 bytes} [Tue May 10 19:25:37 2022] PUT /identity/v3/projects/435f7af7ef4343358131698c12518566/users/01cbe0ba646f410bbd310c4e4d406ba4/roles/634ba284303b4626b5a0402772c68f5c => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 19:25:42.123396 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794cddeb-1175-4192-84b8-9b89a564f172 None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:25:42.124635 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794cddeb-1175-4192-84b8-9b89a564f172 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:25:42.128730 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794cddeb-1175-4192-84b8-9b89a564f172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:25:42.192238 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-794cddeb-1175-4192-84b8-9b89a564f172 None None] MFA Rules not processed for user `440240e16b394209885d8a1523a8d4fe`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:25:42.194373 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-794cddeb-1175-4192-84b8-9b89a564f172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:25:42.344492 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1127/2273] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:25:42 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:25:42.347733 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5a4008-24f6-495c-a743-03efb0235400 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:25:42.475387 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5a4008-24f6-495c-a743-03efb0235400 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:25:42.480487 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29689ec-953a-4768-bb37-3882ac08994d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:25:42.481191 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29689ec-953a-4768-bb37-3882ac08994d admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:25:42.481480 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29689ec-953a-4768-bb37-3882ac08994d admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:25:42.482040 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29689ec-953a-4768-bb37-3882ac08994d admin admin] PATH_INFO: `/v3/projects` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:25:42.482893 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29689ec-953a-4768-bb37-3882ac08994d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:25:42.484841 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29689ec-953a-4768-bb37-3882ac08994d admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:25:42.545948 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1147/2274] 10.222.0.70 () {60 vars in 1152 bytes} [Tue May 10 19:25:42 2022] POST /identity/v3/projects => generated 385 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 19:25:42.546357 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794cddeb-1175-4192-84b8-9b89a564f172 None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:25:42.594845 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794cddeb-1175-4192-84b8-9b89a564f172 None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:25:42.732179 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5309fca-9cde-4cbf-b7cf-d4b5800486ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:25:42.732912 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5309fca-9cde-4cbf-b7cf-d4b5800486ad admin admin] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:25:42.733200 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5309fca-9cde-4cbf-b7cf-d4b5800486ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:25:42.740104 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5309fca-9cde-4cbf-b7cf-d4b5800486ad admin admin] PATH_INFO: `/v3/users` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:25:42.741001 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5309fca-9cde-4cbf-b7cf-d4b5800486ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:25:42.743019 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5309fca-9cde-4cbf-b7cf-d4b5800486ad admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:25:42.784349 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1128/2275] 10.222.0.70 () {60 vars in 1143 bytes} [Tue May 10 19:25:42 2022] POST /identity/v3/users => generated 299 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:25:42.785620 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29689ec-953a-4768-bb37-3882ac08994d admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:25:42.797683 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29689ec-953a-4768-bb37-3882ac08994d admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:25:42.811769 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40998c36-6d31-4928-aacf-78cd8bc4732c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:25:42.813856 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40998c36-6d31-4928-aacf-78cd8bc4732c admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:25:42.813856 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40998c36-6d31-4928-aacf-78cd8bc4732c admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:25:42.814448 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40998c36-6d31-4928-aacf-78cd8bc4732c admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:25:42.816860 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40998c36-6d31-4928-aacf-78cd8bc4732c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:25:42.819561 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40998c36-6d31-4928-aacf-78cd8bc4732c admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:25:42.836613 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1148/2276] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:25:42 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:25:42.837581 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5309fca-9cde-4cbf-b7cf-d4b5800486ad admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:25:42.849982 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5309fca-9cde-4cbf-b7cf-d4b5800486ad admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:25:42.874211 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2e07b6-2a70-462c-997f-ea07c3079ea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:25:42.877846 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2e07b6-2a70-462c-997f-ea07c3079ea1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:25:42.878817 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2e07b6-2a70-462c-997f-ea07c3079ea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:25:42.879250 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2e07b6-2a70-462c-997f-ea07c3079ea1 admin admin] PATH_INFO: `/v3/projects/c341256c33c245a6ab12863a9e53a7c0/users/12774cb15e944dc8b64bb14c70e7a872/roles/634ba284303b4626b5a0402772c68f5c` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:25:42.902871 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2e07b6-2a70-462c-997f-ea07c3079ea1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c341256c33c245a6ab12863a9e53a7c0, user_id=12774cb15e944dc8b64bb14c70e7a872, role_id=634ba284303b4626b5a0402772c68f5c)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:25:42.912709 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2e07b6-2a70-462c-997f-ea07c3079ea1 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:25:42.938664 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40998c36-6d31-4928-aacf-78cd8bc4732c admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:25:42.939039 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1129/2277] 10.222.0.70 () {60 vars in 1482 bytes} [Tue May 10 19:25:42 2022] PUT /identity/v3/projects/c341256c33c245a6ab12863a9e53a7c0/users/12774cb15e944dc8b64bb14c70e7a872/roles/634ba284303b4626b5a0402772c68f5c => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:25:42.965227 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40998c36-6d31-4928-aacf-78cd8bc4732c admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:25:43.123645 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5ff852-7d88-45ba-9d5a-3244ae66942d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:25:43.124703 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5ff852-7d88-45ba-9d5a-3244ae66942d admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:25:43.127952 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5ff852-7d88-45ba-9d5a-3244ae66942d admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:25:43.128469 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5ff852-7d88-45ba-9d5a-3244ae66942d admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:25:43.129395 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5ff852-7d88-45ba-9d5a-3244ae66942d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:25:43.131221 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5ff852-7d88-45ba-9d5a-3244ae66942d admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:25:43.155777 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1149/2278] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:25:42 2022] GET /identity/v3/roles => generated 1420 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:25:43.159821 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2e07b6-2a70-462c-997f-ea07c3079ea1 admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:25:43.172089 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2e07b6-2a70-462c-997f-ea07c3079ea1 admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:25:43.177089 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c861dc5-4e14-4d39-87fb-91200f5150bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:25:43.178093 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c861dc5-4e14-4d39-87fb-91200f5150bb admin admin] REQUEST_METHOD: `PUT` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:25:43.178438 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c861dc5-4e14-4d39-87fb-91200f5150bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:25:43.178777 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c861dc5-4e14-4d39-87fb-91200f5150bb admin admin] PATH_INFO: `/v3/projects/c341256c33c245a6ab12863a9e53a7c0/users/12774cb15e944dc8b64bb14c70e7a872/roles/634ba284303b4626b5a0402772c68f5c` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:25:43.182440 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c861dc5-4e14-4d39-87fb-91200f5150bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=c341256c33c245a6ab12863a9e53a7c0, user_id=12774cb15e944dc8b64bb14c70e7a872, role_id=634ba284303b4626b5a0402772c68f5c)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:25:43.185798 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c861dc5-4e14-4d39-87fb-91200f5150bb admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:25:43.224522 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1130/2279] 10.222.0.70 () {60 vars in 1482 bytes} [Tue May 10 19:25:43 2022] PUT /identity/v3/projects/c341256c33c245a6ab12863a9e53a7c0/users/12774cb15e944dc8b64bb14c70e7a872/roles/634ba284303b4626b5a0402772c68f5c => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:25:45.208364 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9ba5cc-46f0-4f75-b4f6-6b66c9f55cc4 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:25:45.211600 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9ba5cc-46f0-4f75-b4f6-6b66c9f55cc4 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:25:45.212061 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9ba5cc-46f0-4f75-b4f6-6b66c9f55cc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:25:45.263662 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-fb9ba5cc-46f0-4f75-b4f6-6b66c9f55cc4 None None] MFA Rules not processed for user `01cbe0ba646f410bbd310c4e4d406ba4`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:25:45.266223 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-fb9ba5cc-46f0-4f75-b4f6-6b66c9f55cc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:25:45.406110 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1150/2280] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:25:45 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:25:45.421433 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c861dc5-4e14-4d39-87fb-91200f5150bb admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:25:45.424147 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-9c861dc5-4e14-4d39-87fb-91200f5150bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:25:45.524784 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c861dc5-4e14-4d39-87fb-91200f5150bb admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:25:45.533720 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c41d19-49d9-4b24-b385-cf0de50cc232 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9f310a468ec4058b3c95356ea60ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:25:45.534436 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c41d19-49d9-4b24-b385-cf0de50cc232 service nova] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:25:45.534717 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c41d19-49d9-4b24-b385-cf0de50cc232 service nova] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:25:45.535056 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c41d19-49d9-4b24-b385-cf0de50cc232 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:25:45.602364 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c41d19-49d9-4b24-b385-cf0de50cc232 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:25:45.604748 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c41d19-49d9-4b24-b385-cf0de50cc232 service nova] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:25:45.614446 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1131/2281] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:25:45 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 19:25:47.082482 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9ba5cc-46f0-4f75-b4f6-6b66c9f55cc4 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:25:47.084027 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-fb9ba5cc-46f0-4f75-b4f6-6b66c9f55cc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:25:47.209907 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9ba5cc-46f0-4f75-b4f6-6b66c9f55cc4 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:25:47.216084 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ded6ff1-2775-44e6-b9f1-19758215e3c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f1dc79540b48c0866478cc48cd8205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:25:47.217171 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ded6ff1-2775-44e6-b9f1-19758215e3c5 service neutron] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:25:47.217595 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ded6ff1-2775-44e6-b9f1-19758215e3c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:25:47.217975 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ded6ff1-2775-44e6-b9f1-19758215e3c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:25:47.220501 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-9ded6ff1-2775-44e6-b9f1-19758215e3c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:25:47.251927 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ded6ff1-2775-44e6-b9f1-19758215e3c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:25:47.257958 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ded6ff1-2775-44e6-b9f1-19758215e3c5 service neutron] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:25:47.274218 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1151/2282] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:25:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:25:47.275973 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c41d19-49d9-4b24-b385-cf0de50cc232 service nova] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:25:47.289390 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c41d19-49d9-4b24-b385-cf0de50cc232 service nova] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:25:47.294356 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af6eeb5-0365-4ce1-a56d-4c7745651282 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f1dc79540b48c0866478cc48cd8205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:25:47.295021 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af6eeb5-0365-4ce1-a56d-4c7745651282 service neutron] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:25:47.295301 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af6eeb5-0365-4ce1-a56d-4c7745651282 service neutron] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:25:47.295571 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af6eeb5-0365-4ce1-a56d-4c7745651282 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:25:47.298761 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-3af6eeb5-0365-4ce1-a56d-4c7745651282 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:25:47.317127 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af6eeb5-0365-4ce1-a56d-4c7745651282 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:25:47.319566 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af6eeb5-0365-4ce1-a56d-4c7745651282 service neutron] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:25:47.337148 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1132/2283] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:25:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:25:47.599710 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45c60c9-34f3-4143-9e9a-712007049473 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:25:47.599916 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45c60c9-34f3-4143-9e9a-712007049473 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:25:47.600190 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45c60c9-34f3-4143-9e9a-712007049473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:25:47.633040 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-f45c60c9-34f3-4143-9e9a-712007049473 None None] MFA Rules not processed for user `cdb08a49fd924e4c9f9cae5e7a6e44b0`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:25:47.635260 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-f45c60c9-34f3-4143-9e9a-712007049473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:25:47.644083 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1152/2284] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:25:47 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:25:50.311592 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77ce96b-05d7-464e-9ad7-7c6aa132aebc None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:25:50.314202 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77ce96b-05d7-464e-9ad7-7c6aa132aebc None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:25:50.314737 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77ce96b-05d7-464e-9ad7-7c6aa132aebc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:25:50.369240 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-b77ce96b-05d7-464e-9ad7-7c6aa132aebc None None] MFA Rules not processed for user `12774cb15e944dc8b64bb14c70e7a872`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:25:50.370836 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-b77ce96b-05d7-464e-9ad7-7c6aa132aebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:25:50.521764 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1133/2285] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:25:50 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:25:50.537326 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45c60c9-34f3-4143-9e9a-712007049473 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:25:50.539499 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-f45c60c9-34f3-4143-9e9a-712007049473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:25:50.680801 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45c60c9-34f3-4143-9e9a-712007049473 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:25:50.693673 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7275ed3-6ce6-4af6-990d-04ab4f26515e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24ca97ff2a1745e58dedba4cef61b3f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:25:50.694629 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7275ed3-6ce6-4af6-990d-04ab4f26515e service glance] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:25:50.695420 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7275ed3-6ce6-4af6-990d-04ab4f26515e service glance] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:25:50.695976 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7275ed3-6ce6-4af6-990d-04ab4f26515e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:25:50.802647 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7275ed3-6ce6-4af6-990d-04ab4f26515e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:25:50.813684 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7275ed3-6ce6-4af6-990d-04ab4f26515e service glance] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:25:50.832566 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1153/2286] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:25:50 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:25:50.980129 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80accff5-dbc0-404c-aecf-67f3f768e0ea None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:25:50.980435 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80accff5-dbc0-404c-aecf-67f3f768e0ea None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:25:50.980919 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80accff5-dbc0-404c-aecf-67f3f768e0ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:25:51.026704 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-80accff5-dbc0-404c-aecf-67f3f768e0ea None None] MFA Rules not processed for user `058e52f1bf0b4aba965d945815d4acb3`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:25:51.028860 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-80accff5-dbc0-404c-aecf-67f3f768e0ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:25:51.234738 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1134/2287] 10.222.0.70 () {58 vars in 1009 bytes} [Tue May 10 19:25:50 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:25:51.284101 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7275ed3-6ce6-4af6-990d-04ab4f26515e service glance] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:25:51.286017 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-b7275ed3-6ce6-4af6-990d-04ab4f26515e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:25:51.499462 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7275ed3-6ce6-4af6-990d-04ab4f26515e service glance] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:25:51.506803 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c58583b-4fda-40a6-b354-494b2ab719c8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0454aa03fa31487ea1464b9d0008212c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:25:51.507668 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c58583b-4fda-40a6-b354-494b2ab719c8 service swift] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:25:51.508106 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c58583b-4fda-40a6-b354-494b2ab719c8 service swift] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:25:51.508559 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c58583b-4fda-40a6-b354-494b2ab719c8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:25:51.536248 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c58583b-4fda-40a6-b354-494b2ab719c8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:25:51.538200 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c58583b-4fda-40a6-b354-494b2ab719c8 service swift] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:25:51.574124 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1154/2288] 10.222.0.70 () {60 vars in 1384 bytes} [Tue May 10 19:25:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 19:25:57.455211 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80accff5-dbc0-404c-aecf-67f3f768e0ea None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:25:57.466384 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80accff5-dbc0-404c-aecf-67f3f768e0ea None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:25:57.482333 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0d2bfe-9498-49be-aa42-806508f46ae1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f1dc79540b48c0866478cc48cd8205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:25:57.482996 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0d2bfe-9498-49be-aa42-806508f46ae1 service neutron] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:25:57.485160 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0d2bfe-9498-49be-aa42-806508f46ae1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:25:57.490958 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0d2bfe-9498-49be-aa42-806508f46ae1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:25:57.497161 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-8e0d2bfe-9498-49be-aa42-806508f46ae1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:25:57.662917 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0d2bfe-9498-49be-aa42-806508f46ae1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:25:57.664402 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0d2bfe-9498-49be-aa42-806508f46ae1 service neutron] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:25:57.689441 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1135/2289] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:25:57 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:25:59.005341 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560a1c05-56b6-4e24-ab48-5d9ae8409b78 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:25:59.006310 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560a1c05-56b6-4e24-ab48-5d9ae8409b78 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:25:59.006806 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560a1c05-56b6-4e24-ab48-5d9ae8409b78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:25:59.031266 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-560a1c05-56b6-4e24-ab48-5d9ae8409b78 None None] MFA Rules not processed for user `db6fd87ab33946808f4153585fc1d07a`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:25:59.032544 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-560a1c05-56b6-4e24-ab48-5d9ae8409b78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:25:59.126369 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1155/2290] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:25:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:25:59.753660 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0634af94-7bfe-42d8-8092-c932d35a5c05 None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:25:59.754951 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0634af94-7bfe-42d8-8092-c932d35a5c05 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:25:59.755390 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0634af94-7bfe-42d8-8092-c932d35a5c05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:25:59.777568 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-0634af94-7bfe-42d8-8092-c932d35a5c05 None None] MFA Rules not processed for user `90bbeed46811450f953507e570a2bd94`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:25:59.779615 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-0634af94-7bfe-42d8-8092-c932d35a5c05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:25:59.797922 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1136/2291] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:25:59 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:25:59.984740 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560a1c05-56b6-4e24-ab48-5d9ae8409b78 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:25:59.986928 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-560a1c05-56b6-4e24-ab48-5d9ae8409b78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:26:00.075093 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560a1c05-56b6-4e24-ab48-5d9ae8409b78 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:26:00.085407 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a7f5f1-c414-4051-aabb-d7539f43029e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b95d3824f34cfcada6915ee57a7e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:26:00.086079 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a7f5f1-c414-4051-aabb-d7539f43029e service placement] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:26:00.086357 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a7f5f1-c414-4051-aabb-d7539f43029e service placement] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:26:00.086631 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a7f5f1-c414-4051-aabb-d7539f43029e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:26:00.092922 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-67a7f5f1-c414-4051-aabb-d7539f43029e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:26:00.105689 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a7f5f1-c414-4051-aabb-d7539f43029e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:26:00.107301 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a7f5f1-c414-4051-aabb-d7539f43029e service placement] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:26:00.127609 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1156/2292] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:25:59 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:26:00.311670 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0634af94-7bfe-42d8-8092-c932d35a5c05 None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:26:00.322542 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0634af94-7bfe-42d8-8092-c932d35a5c05 None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:26:00.327109 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e05fb2-fc33-4790-9882-1cf4d666c383 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f1dc79540b48c0866478cc48cd8205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:26:00.328141 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e05fb2-fc33-4790-9882-1cf4d666c383 service neutron] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:26:00.328383 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e05fb2-fc33-4790-9882-1cf4d666c383 service neutron] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:26:00.328755 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e05fb2-fc33-4790-9882-1cf4d666c383 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:26:00.330696 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-c5e05fb2-fc33-4790-9882-1cf4d666c383 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:26:00.346408 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e05fb2-fc33-4790-9882-1cf4d666c383 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:26:00.347858 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e05fb2-fc33-4790-9882-1cf4d666c383 service neutron] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:26:00.359079 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1137/2293] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:26:00 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:26:01.233594 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a7f5f1-c414-4051-aabb-d7539f43029e service placement] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:26:01.246633 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a7f5f1-c414-4051-aabb-d7539f43029e service placement] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:26:01.257443 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f15bcc-679f-4497-aa5d-42f5fcd0e00d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9f310a468ec4058b3c95356ea60ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:26:01.259493 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f15bcc-679f-4497-aa5d-42f5fcd0e00d service nova] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:26:01.260431 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f15bcc-679f-4497-aa5d-42f5fcd0e00d service nova] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:26:01.261005 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f15bcc-679f-4497-aa5d-42f5fcd0e00d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:26:01.263438 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-11f15bcc-679f-4497-aa5d-42f5fcd0e00d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:26:01.279210 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f15bcc-679f-4497-aa5d-42f5fcd0e00d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:26:01.281873 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f15bcc-679f-4497-aa5d-42f5fcd0e00d service nova] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:26:01.304824 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1157/2294] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:26:01 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:26:05.512955 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e05fb2-fc33-4790-9882-1cf4d666c383 service neutron] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:26:05.541708 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e05fb2-fc33-4790-9882-1cf4d666c383 service neutron] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:26:05.559677 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a93bbac-d17a-477e-96c4-5b39423536fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f1dc79540b48c0866478cc48cd8205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:26:05.561407 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a93bbac-d17a-477e-96c4-5b39423536fd service neutron] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:26:05.561951 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a93bbac-d17a-477e-96c4-5b39423536fd service neutron] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:26:05.562475 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a93bbac-d17a-477e-96c4-5b39423536fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:26:05.565055 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-0a93bbac-d17a-477e-96c4-5b39423536fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:26:05.584302 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a93bbac-d17a-477e-96c4-5b39423536fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:26:05.589317 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a93bbac-d17a-477e-96c4-5b39423536fd service neutron] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:26:05.637954 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1138/2295] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:26:05 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:26:08.441826 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696a193d-c583-4598-94fc-c25f52f34601 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:26:08.445207 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696a193d-c583-4598-94fc-c25f52f34601 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:26:08.445798 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696a193d-c583-4598-94fc-c25f52f34601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:26:08.478254 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-696a193d-c583-4598-94fc-c25f52f34601 None None] MFA Rules not processed for user `440240e16b394209885d8a1523a8d4fe`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:26:08.479508 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-696a193d-c583-4598-94fc-c25f52f34601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:26:08.488844 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1158/2296] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:26:08 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:26:11.706942 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e5b188-87b8-4a3a-8807-3a8550d3b431 None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:26:11.707449 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e5b188-87b8-4a3a-8807-3a8550d3b431 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:26:11.707705 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e5b188-87b8-4a3a-8807-3a8550d3b431 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:26:11.728860 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-05e5b188-87b8-4a3a-8807-3a8550d3b431 None None] MFA Rules not processed for user `058e52f1bf0b4aba965d945815d4acb3`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:26:11.730502 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-05e5b188-87b8-4a3a-8807-3a8550d3b431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:26:11.738688 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1139/2297] 10.222.0.70 () {58 vars in 1009 bytes} [Tue May 10 19:26:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:26:11.753479 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696a193d-c583-4598-94fc-c25f52f34601 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:26:11.765958 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696a193d-c583-4598-94fc-c25f52f34601 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:26:11.773657 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e9932f-cf5a-4d8c-b4be-af293c9540d0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0454aa03fa31487ea1464b9d0008212c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:26:11.774615 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e9932f-cf5a-4d8c-b4be-af293c9540d0 service swift] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:26:11.775092 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e9932f-cf5a-4d8c-b4be-af293c9540d0 service swift] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:26:11.775526 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e9932f-cf5a-4d8c-b4be-af293c9540d0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:26:11.786818 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e9932f-cf5a-4d8c-b4be-af293c9540d0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:26:11.788719 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e9932f-cf5a-4d8c-b4be-af293c9540d0 service swift] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:26:11.819429 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1159/2298] 10.222.0.70 () {60 vars in 1384 bytes} [Tue May 10 19:26:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 19:26:13.320511 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8362ba3-d615-4858-95ce-7bae01bdb8d1 None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:26:13.321610 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8362ba3-d615-4858-95ce-7bae01bdb8d1 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:26:13.321707 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8362ba3-d615-4858-95ce-7bae01bdb8d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:26:13.388502 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-f8362ba3-d615-4858-95ce-7bae01bdb8d1 None None] MFA Rules not processed for user `a7188fbb905a4ef984d8d3eda8d443d9`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:26:13.389867 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-f8362ba3-d615-4858-95ce-7bae01bdb8d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:26:13.493334 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1140/2299] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:26:13 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:26:13.645805 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e9932f-cf5a-4d8c-b4be-af293c9540d0 service swift] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:26:13.647343 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-e8e9932f-cf5a-4d8c-b4be-af293c9540d0 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:26:13.663170 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e9932f-cf5a-4d8c-b4be-af293c9540d0 service swift] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:26:13.669823 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95a54f0-5f0f-48c4-bc82-764ba925058c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9f310a468ec4058b3c95356ea60ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:26:13.670719 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95a54f0-5f0f-48c4-bc82-764ba925058c service nova] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:26:13.670982 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95a54f0-5f0f-48c4-bc82-764ba925058c service nova] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:26:13.671259 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95a54f0-5f0f-48c4-bc82-764ba925058c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:26:13.673212 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-a95a54f0-5f0f-48c4-bc82-764ba925058c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:26:13.685207 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95a54f0-5f0f-48c4-bc82-764ba925058c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:26:13.686940 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95a54f0-5f0f-48c4-bc82-764ba925058c service nova] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:26:13.697025 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1160/2300] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:26:13 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:26:14.272733 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8362ba3-d615-4858-95ce-7bae01bdb8d1 None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:26:14.286162 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8362ba3-d615-4858-95ce-7bae01bdb8d1 None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:26:14.296018 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6cee5c-8afd-4094-91c1-b9b39d289c98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f1dc79540b48c0866478cc48cd8205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:26:14.296842 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6cee5c-8afd-4094-91c1-b9b39d289c98 service neutron] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:26:14.297166 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6cee5c-8afd-4094-91c1-b9b39d289c98 service neutron] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:26:14.297529 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6cee5c-8afd-4094-91c1-b9b39d289c98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:26:14.301307 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-3b6cee5c-8afd-4094-91c1-b9b39d289c98 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:26:14.325499 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6cee5c-8afd-4094-91c1-b9b39d289c98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:26:14.327049 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6cee5c-8afd-4094-91c1-b9b39d289c98 service neutron] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:26:14.346567 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1141/2301] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:26:14 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:26:15.947100 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95a54f0-5f0f-48c4-bc82-764ba925058c service nova] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:26:15.959798 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-a95a54f0-5f0f-48c4-bc82-764ba925058c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:26:16.058221 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95a54f0-5f0f-48c4-bc82-764ba925058c service nova] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:26:16.062758 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de418d17-7d55-434a-b4da-d467e142ea10 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15df2a8967aa43299c10e365f4200d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:26:16.063689 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de418d17-7d55-434a-b4da-d467e142ea10 service cinder] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:26:16.064234 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de418d17-7d55-434a-b4da-d467e142ea10 service cinder] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:26:16.064765 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de418d17-7d55-434a-b4da-d467e142ea10 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:26:16.066891 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-de418d17-7d55-434a-b4da-d467e142ea10 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:26:16.191725 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de418d17-7d55-434a-b4da-d467e142ea10 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:26:16.193921 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de418d17-7d55-434a-b4da-d467e142ea10 service cinder] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:26:16.220263 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1161/2302] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:26:15 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:26:23.988296 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6cee5c-8afd-4094-91c1-b9b39d289c98 service neutron] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:26:24.012207 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6cee5c-8afd-4094-91c1-b9b39d289c98 service neutron] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:26:24.030970 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305ea204-7f44-4f6c-b2b4-ce78ec3289ca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9f310a468ec4058b3c95356ea60ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:26:24.032231 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305ea204-7f44-4f6c-b2b4-ce78ec3289ca service nova] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:26:24.032778 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305ea204-7f44-4f6c-b2b4-ce78ec3289ca service nova] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:26:24.033024 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305ea204-7f44-4f6c-b2b4-ce78ec3289ca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:26:24.034892 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-305ea204-7f44-4f6c-b2b4-ce78ec3289ca service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:26:24.048696 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305ea204-7f44-4f6c-b2b4-ce78ec3289ca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:26:24.051005 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305ea204-7f44-4f6c-b2b4-ce78ec3289ca service nova] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:26:24.066515 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1142/2303] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:26:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:26:26.469484 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de418d17-7d55-434a-b4da-d467e142ea10 service cinder] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:26:26.487315 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de418d17-7d55-434a-b4da-d467e142ea10 service cinder] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:26:26.496565 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1964aae-8e63-47fc-9ee6-b3f3c22e2da9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9f310a468ec4058b3c95356ea60ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:26:26.497629 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1964aae-8e63-47fc-9ee6-b3f3c22e2da9 service nova] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:26:26.498289 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1964aae-8e63-47fc-9ee6-b3f3c22e2da9 service nova] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:26:26.498665 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1964aae-8e63-47fc-9ee6-b3f3c22e2da9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:26:26.501194 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-b1964aae-8e63-47fc-9ee6-b3f3c22e2da9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:26:26.524271 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1964aae-8e63-47fc-9ee6-b3f3c22e2da9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:26:26.526484 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1964aae-8e63-47fc-9ee6-b3f3c22e2da9 service nova] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:26:26.553942 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1162/2304] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:26:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:26:30.075006 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305ea204-7f44-4f6c-b2b4-ce78ec3289ca service nova] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:26:30.088006 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305ea204-7f44-4f6c-b2b4-ce78ec3289ca service nova] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:26:30.093648 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7eb72ce-790a-4af8-8ac6-834a470eedc0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9f310a468ec4058b3c95356ea60ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:26:30.094540 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eb72ce-790a-4af8-8ac6-834a470eedc0 service nova] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:26:30.094974 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eb72ce-790a-4af8-8ac6-834a470eedc0 service nova] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:26:30.095413 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eb72ce-790a-4af8-8ac6-834a470eedc0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:26:30.097370 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-a7eb72ce-790a-4af8-8ac6-834a470eedc0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:26:30.111041 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7eb72ce-790a-4af8-8ac6-834a470eedc0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:26:30.113010 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7eb72ce-790a-4af8-8ac6-834a470eedc0 service nova] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:26:30.125710 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1143/2305] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:26:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:26:37.604689 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1964aae-8e63-47fc-9ee6-b3f3c22e2da9 service nova] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:26:37.614253 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1964aae-8e63-47fc-9ee6-b3f3c22e2da9 service nova] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:26:37.617867 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6e98dd-771d-464e-ba11-3a55cc3402ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f1dc79540b48c0866478cc48cd8205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:26:37.619034 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6e98dd-771d-464e-ba11-3a55cc3402ca service neutron] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:26:37.619314 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6e98dd-771d-464e-ba11-3a55cc3402ca service neutron] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:26:37.619587 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6e98dd-771d-464e-ba11-3a55cc3402ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:26:37.629079 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6e98dd-771d-464e-ba11-3a55cc3402ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:26:37.630498 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6e98dd-771d-464e-ba11-3a55cc3402ca service neutron] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:26:37.640345 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1163/2306] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:26:37 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:26:45.115999 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7eb72ce-790a-4af8-8ac6-834a470eedc0 service nova] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:26:45.125850 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7eb72ce-790a-4af8-8ac6-834a470eedc0 service nova] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:26:45.130626 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2e13ff-02f1-4098-8b10-2cb4a2d7c5aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f1dc79540b48c0866478cc48cd8205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:26:45.131376 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2e13ff-02f1-4098-8b10-2cb4a2d7c5aa service neutron] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:26:45.131889 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2e13ff-02f1-4098-8b10-2cb4a2d7c5aa service neutron] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:26:45.132229 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2e13ff-02f1-4098-8b10-2cb4a2d7c5aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:26:45.144187 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2e13ff-02f1-4098-8b10-2cb4a2d7c5aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:26:45.145705 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2e13ff-02f1-4098-8b10-2cb4a2d7c5aa service neutron] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:26:45.159423 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1144/2307] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:26:45 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:26:45.789994 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6e98dd-771d-464e-ba11-3a55cc3402ca service neutron] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:26:45.798968 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6e98dd-771d-464e-ba11-3a55cc3402ca service neutron] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:26:45.802592 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb4a2fe-1dfb-4f88-9f3b-8e6ec5f34132 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f1dc79540b48c0866478cc48cd8205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:26:45.803231 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb4a2fe-1dfb-4f88-9f3b-8e6ec5f34132 service neutron] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:26:45.803516 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb4a2fe-1dfb-4f88-9f3b-8e6ec5f34132 service neutron] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:26:45.803792 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb4a2fe-1dfb-4f88-9f3b-8e6ec5f34132 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:26:45.806193 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-dcb4a2fe-1dfb-4f88-9f3b-8e6ec5f34132 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:26:45.869327 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb4a2fe-1dfb-4f88-9f3b-8e6ec5f34132 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:26:45.870778 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb4a2fe-1dfb-4f88-9f3b-8e6ec5f34132 service neutron] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:26:45.880959 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1164/2308] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:26:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:26:51.003428 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2e13ff-02f1-4098-8b10-2cb4a2d7c5aa service neutron] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:26:51.004950 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-6b2e13ff-02f1-4098-8b10-2cb4a2d7c5aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:26:51.018932 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2e13ff-02f1-4098-8b10-2cb4a2d7c5aa service neutron] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:26:51.023345 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7e338b-9fb7-4f97-a2c7-81e48201c3ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:26:51.024731 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7e338b-9fb7-4f97-a2c7-81e48201c3ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:26:51.025010 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7e338b-9fb7-4f97-a2c7-81e48201c3ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:26:51.025282 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7e338b-9fb7-4f97-a2c7-81e48201c3ba admin admin] PATH_INFO: `/v3/users/4c7ce54253764d788ea48b5ff9b43d54` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:26:51.026440 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7e338b-9fb7-4f97-a2c7-81e48201c3ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c7ce54253764d788ea48b5ff9b43d54)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:26:51.028386 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7e338b-9fb7-4f97-a2c7-81e48201c3ba admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:26:51.074181 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-3c7e338b-9fb7-4f97-a2c7-81e48201c3ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c7ce54253764d788ea48b5ff9b43d54'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:26:51.085361 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-3c7e338b-9fb7-4f97-a2c7-81e48201c3ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c7ce54253764d788ea48b5ff9b43d54'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:26:51.092381 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-3c7e338b-9fb7-4f97-a2c7-81e48201c3ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c7ce54253764d788ea48b5ff9b43d54'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:26:51.093075 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-3c7e338b-9fb7-4f97-a2c7-81e48201c3ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c7ce54253764d788ea48b5ff9b43d54'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:26:51.100178 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-3c7e338b-9fb7-4f97-a2c7-81e48201c3ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c7ce54253764d788ea48b5ff9b43d54'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:26:51.106440 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1145/2309] 10.222.0.70 () {58 vars in 1223 bytes} [Tue May 10 19:26:51 2022] DELETE /identity/v3/users/4c7ce54253764d788ea48b5ff9b43d54 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:26:51.277379 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb4a2fe-1dfb-4f88-9f3b-8e6ec5f34132 service neutron] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:26:51.291748 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb4a2fe-1dfb-4f88-9f3b-8e6ec5f34132 service neutron] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:26:51.346781 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca833d0-eb51-4ffa-ac33-d326aabf32ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:26:51.347640 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca833d0-eb51-4ffa-ac33-d326aabf32ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:26:51.347925 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca833d0-eb51-4ffa-ac33-d326aabf32ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:26:51.348197 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca833d0-eb51-4ffa-ac33-d326aabf32ee admin admin] PATH_INFO: `/v3/projects/b01ea9fc16b94ff0899ce6ae2f229400` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:26:51.349412 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca833d0-eb51-4ffa-ac33-d326aabf32ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=b01ea9fc16b94ff0899ce6ae2f229400)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:26:51.351307 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca833d0-eb51-4ffa-ac33-d326aabf32ee admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:26:51.394291 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-8ca833d0-eb51-4ffa-ac33-d326aabf32ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b01ea9fc16b94ff0899ce6ae2f229400', 'request_id': 'req-8ca833d0-eb51-4ffa-ac33-d326aabf32ee'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:26:51.399794 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-8ca833d0-eb51-4ffa-ac33-d326aabf32ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b01ea9fc16b94ff0899ce6ae2f229400', 'request_id': 'req-8ca833d0-eb51-4ffa-ac33-d326aabf32ee'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:26:51.406796 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-8ca833d0-eb51-4ffa-ac33-d326aabf32ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b01ea9fc16b94ff0899ce6ae2f229400', 'request_id': 'req-8ca833d0-eb51-4ffa-ac33-d326aabf32ee'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:26:51.417312 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-8ca833d0-eb51-4ffa-ac33-d326aabf32ee admin admin] The token cache is being invalidate because project b01ea9fc16b94ff0899ce6ae2f229400 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79994) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:26:51.417590 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-8ca833d0-eb51-4ffa-ac33-d326aabf32ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:26:51.418202 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-8ca833d0-eb51-4ffa-ac33-d326aabf32ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:26:51.419720 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1165/2310] 10.222.0.70 () {58 vars in 1232 bytes} [Tue May 10 19:26:51 2022] DELETE /identity/v3/projects/b01ea9fc16b94ff0899ce6ae2f229400 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:26:51.424640 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f12427-2a46-4f68-88d5-15f813a1ffd4 None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:26:51.424934 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f12427-2a46-4f68-88d5-15f813a1ffd4 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:26:51.425216 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f12427-2a46-4f68-88d5-15f813a1ffd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:26:51.442177 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-90f12427-2a46-4f68-88d5-15f813a1ffd4 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:26:51.443391 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-90f12427-2a46-4f68-88d5-15f813a1ffd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:26:51.500667 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1146/2311] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:26:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:26:51.508766 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b56fc0a-ee04-4eee-b8e3-81cd8ca0495f None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:26:51.509058 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b56fc0a-ee04-4eee-b8e3-81cd8ca0495f None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:26:51.509335 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b56fc0a-ee04-4eee-b8e3-81cd8ca0495f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:26:51.527418 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-8b56fc0a-ee04-4eee-b8e3-81cd8ca0495f None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:26:51.528707 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-8b56fc0a-ee04-4eee-b8e3-81cd8ca0495f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:26:51.536593 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1166/2312] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:26:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:26:51.540523 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f12427-2a46-4f68-88d5-15f813a1ffd4 None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:26:51.549753 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f12427-2a46-4f68-88d5-15f813a1ffd4 None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:26:51.554218 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ec3f0b-2aed-4f65-a5f0-70b5c76ad687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:26:51.554877 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ec3f0b-2aed-4f65-a5f0-70b5c76ad687 admin admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:26:51.555660 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ec3f0b-2aed-4f65-a5f0-70b5c76ad687 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:26:51.555931 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ec3f0b-2aed-4f65-a5f0-70b5c76ad687 admin admin] PATH_INFO: `/v3/domains` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:26:51.556746 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ec3f0b-2aed-4f65-a5f0-70b5c76ad687 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:26:51.557055 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ec3f0b-2aed-4f65-a5f0-70b5c76ad687 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:26:51.558633 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ec3f0b-2aed-4f65-a5f0-70b5c76ad687 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:26:51.569661 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1147/2313] 10.222.0.70 () {58 vars in 1152 bytes} [Tue May 10 19:26:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:26:51.574551 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b56fc0a-ee04-4eee-b8e3-81cd8ca0495f None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:26:51.583555 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b56fc0a-ee04-4eee-b8e3-81cd8ca0495f None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:26:51.588223 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bdcd6f-1bbf-49be-917c-3479fd37011d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:26:51.588953 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bdcd6f-1bbf-49be-917c-3479fd37011d admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:26:51.589237 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bdcd6f-1bbf-49be-917c-3479fd37011d admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:26:51.589511 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bdcd6f-1bbf-49be-917c-3479fd37011d admin admin] PATH_INFO: `/v3/projects` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:26:51.590197 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bdcd6f-1bbf-49be-917c-3479fd37011d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:26:51.592126 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bdcd6f-1bbf-49be-917c-3479fd37011d admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:26:51.616225 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1167/2314] 10.222.0.70 () {60 vars in 1152 bytes} [Tue May 10 19:26:51 2022] POST /identity/v3/projects => generated 371 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:26:51.620790 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ec3f0b-2aed-4f65-a5f0-70b5c76ad687 admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:26:51.630599 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ec3f0b-2aed-4f65-a5f0-70b5c76ad687 admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:26:51.686459 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aef3f98-a5fc-4090-b94c-7e8a72ed7ce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:26:51.687125 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aef3f98-a5fc-4090-b94c-7e8a72ed7ce1 admin admin] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:26:51.687406 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aef3f98-a5fc-4090-b94c-7e8a72ed7ce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:26:51.687829 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aef3f98-a5fc-4090-b94c-7e8a72ed7ce1 admin admin] PATH_INFO: `/v3/users` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:26:51.688562 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aef3f98-a5fc-4090-b94c-7e8a72ed7ce1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:26:51.690494 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aef3f98-a5fc-4090-b94c-7e8a72ed7ce1 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:26:51.709982 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1148/2315] 10.222.0.70 () {60 vars in 1143 bytes} [Tue May 10 19:26:51 2022] POST /identity/v3/users => generated 286 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:26:51.714202 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bdcd6f-1bbf-49be-917c-3479fd37011d admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:26:51.724170 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bdcd6f-1bbf-49be-917c-3479fd37011d admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:26:51.729113 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad874959-bd6f-40c1-9aa1-f25f57aa3fbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:26:51.729777 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad874959-bd6f-40c1-9aa1-f25f57aa3fbd admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:26:51.730059 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad874959-bd6f-40c1-9aa1-f25f57aa3fbd admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:26:51.730332 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad874959-bd6f-40c1-9aa1-f25f57aa3fbd admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:26:51.731129 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad874959-bd6f-40c1-9aa1-f25f57aa3fbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:26:51.732930 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad874959-bd6f-40c1-9aa1-f25f57aa3fbd admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:26:51.743756 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1168/2316] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:26:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:26:51.747758 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aef3f98-a5fc-4090-b94c-7e8a72ed7ce1 admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:26:51.757308 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aef3f98-a5fc-4090-b94c-7e8a72ed7ce1 admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:26:51.762629 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9da177f-3a4e-4825-85ea-20d7c015a631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:26:51.763287 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9da177f-3a4e-4825-85ea-20d7c015a631 admin admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:26:51.763573 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9da177f-3a4e-4825-85ea-20d7c015a631 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:26:51.763874 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9da177f-3a4e-4825-85ea-20d7c015a631 admin admin] PATH_INFO: `/v3/roles` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:26:51.764713 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9da177f-3a4e-4825-85ea-20d7c015a631 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:26:51.766406 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9da177f-3a4e-4825-85ea-20d7c015a631 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:26:51.776763 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1149/2317] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:26:51 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 19:26:51.780630 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad874959-bd6f-40c1-9aa1-f25f57aa3fbd admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:26:51.790303 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad874959-bd6f-40c1-9aa1-f25f57aa3fbd admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:26:51.794820 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460b5fc4-d439-437b-a2ec-05e099b93aa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:26:51.795684 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460b5fc4-d439-437b-a2ec-05e099b93aa3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:26:51.795964 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460b5fc4-d439-437b-a2ec-05e099b93aa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:26:51.796236 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460b5fc4-d439-437b-a2ec-05e099b93aa3 admin admin] PATH_INFO: `/v3/projects/7546357d3332420da38b0941ee1fd16e/users/5392cec307b84ed28174b3a17dc76823/roles/5c07cf5bfbd3427db18428aa50420962` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:26:51.811097 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460b5fc4-d439-437b-a2ec-05e099b93aa3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7546357d3332420da38b0941ee1fd16e, user_id=5392cec307b84ed28174b3a17dc76823, role_id=5c07cf5bfbd3427db18428aa50420962)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:26:51.813760 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460b5fc4-d439-437b-a2ec-05e099b93aa3 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:26:51.827759 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1169/2318] 10.222.0.70 () {60 vars in 1482 bytes} [Tue May 10 19:26:51 2022] PUT /identity/v3/projects/7546357d3332420da38b0941ee1fd16e/users/5392cec307b84ed28174b3a17dc76823/roles/5c07cf5bfbd3427db18428aa50420962 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 19:26:51.837941 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0938da-4d44-4e1c-a5cd-42ecf3a34c02 None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:26:51.838233 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0938da-4d44-4e1c-a5cd-42ecf3a34c02 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:26:51.838514 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0938da-4d44-4e1c-a5cd-42ecf3a34c02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:26:51.863856 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-df0938da-4d44-4e1c-a5cd-42ecf3a34c02 None None] MFA Rules not processed for user `5392cec307b84ed28174b3a17dc76823`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:26:51.865081 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-df0938da-4d44-4e1c-a5cd-42ecf3a34c02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:26:51.927384 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1150/2319] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:26:51 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:26:51.932313 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460b5fc4-d439-437b-a2ec-05e099b93aa3 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:26:51.994570 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460b5fc4-d439-437b-a2ec-05e099b93aa3 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:26:51.999630 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec97b60-fdc8-41a5-aa6c-b76a1d8a9df4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:26:52.000295 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec97b60-fdc8-41a5-aa6c-b76a1d8a9df4 admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:26:52.000749 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec97b60-fdc8-41a5-aa6c-b76a1d8a9df4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:26:52.001043 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec97b60-fdc8-41a5-aa6c-b76a1d8a9df4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:26:52.001745 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec97b60-fdc8-41a5-aa6c-b76a1d8a9df4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:26:52.003631 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec97b60-fdc8-41a5-aa6c-b76a1d8a9df4 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:26:52.027830 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1170/2320] 10.222.0.70 () {60 vars in 1152 bytes} [Tue May 10 19:26:51 2022] POST /identity/v3/projects => generated 373 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:26:52.031786 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0938da-4d44-4e1c-a5cd-42ecf3a34c02 None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:26:52.042931 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0938da-4d44-4e1c-a5cd-42ecf3a34c02 None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:26:52.097361 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6a26bd-7386-4365-8e43-dbb3a5abaac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:26:52.098024 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6a26bd-7386-4365-8e43-dbb3a5abaac4 admin admin] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:26:52.098311 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6a26bd-7386-4365-8e43-dbb3a5abaac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:26:52.098590 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6a26bd-7386-4365-8e43-dbb3a5abaac4 admin admin] PATH_INFO: `/v3/users` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:26:52.099284 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6a26bd-7386-4365-8e43-dbb3a5abaac4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:26:52.101267 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6a26bd-7386-4365-8e43-dbb3a5abaac4 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:26:52.120997 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1151/2321] 10.222.0.70 () {60 vars in 1143 bytes} [Tue May 10 19:26:52 2022] POST /identity/v3/users => generated 293 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:26:52.124935 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec97b60-fdc8-41a5-aa6c-b76a1d8a9df4 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:26:52.135001 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec97b60-fdc8-41a5-aa6c-b76a1d8a9df4 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:26:52.139678 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458ea6b6-f818-4b7d-bdef-0ee588d8019b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:26:52.140324 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458ea6b6-f818-4b7d-bdef-0ee588d8019b admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:26:52.140641 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458ea6b6-f818-4b7d-bdef-0ee588d8019b admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:26:52.140918 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458ea6b6-f818-4b7d-bdef-0ee588d8019b admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:26:52.141637 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458ea6b6-f818-4b7d-bdef-0ee588d8019b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:26:52.143225 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458ea6b6-f818-4b7d-bdef-0ee588d8019b admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:26:52.153382 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1171/2322] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:26:52 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:26:52.157505 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6a26bd-7386-4365-8e43-dbb3a5abaac4 admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:26:52.167692 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6a26bd-7386-4365-8e43-dbb3a5abaac4 admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:26:52.172294 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c901af5-6705-4440-ba59-2f7d03ffe951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:26:52.173201 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c901af5-6705-4440-ba59-2f7d03ffe951 admin admin] REQUEST_METHOD: `PUT` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:26:52.173486 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c901af5-6705-4440-ba59-2f7d03ffe951 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:26:52.173762 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c901af5-6705-4440-ba59-2f7d03ffe951 admin admin] PATH_INFO: `/v3/projects/83a67c016d1f4b748d070a360a247e03/users/870f4730ac1b46cabe38f7cb4bb15920/roles/634ba284303b4626b5a0402772c68f5c` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:26:52.188146 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c901af5-6705-4440-ba59-2f7d03ffe951 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83a67c016d1f4b748d070a360a247e03, user_id=870f4730ac1b46cabe38f7cb4bb15920, role_id=634ba284303b4626b5a0402772c68f5c)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:26:52.190834 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c901af5-6705-4440-ba59-2f7d03ffe951 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:26:52.207789 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458ea6b6-f818-4b7d-bdef-0ee588d8019b admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:26:52.208494 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1152/2323] 10.222.0.70 () {60 vars in 1482 bytes} [Tue May 10 19:26:52 2022] PUT /identity/v3/projects/83a67c016d1f4b748d070a360a247e03/users/870f4730ac1b46cabe38f7cb4bb15920/roles/634ba284303b4626b5a0402772c68f5c => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:26:52.218193 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458ea6b6-f818-4b7d-bdef-0ee588d8019b admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:26:52.271744 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82643d88-62e4-4c31-a457-24680a26cb71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:26:52.272400 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82643d88-62e4-4c31-a457-24680a26cb71 admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:26:52.272714 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82643d88-62e4-4c31-a457-24680a26cb71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:26:52.272988 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82643d88-62e4-4c31-a457-24680a26cb71 admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:26:52.273730 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82643d88-62e4-4c31-a457-24680a26cb71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:26:52.275317 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82643d88-62e4-4c31-a457-24680a26cb71 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:26:52.284747 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1172/2324] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:26:52 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:26:52.289003 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c901af5-6705-4440-ba59-2f7d03ffe951 admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:26:52.299531 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c901af5-6705-4440-ba59-2f7d03ffe951 admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:26:52.304034 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3c52e7-9c79-4109-a061-341adb440e2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:26:52.305065 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3c52e7-9c79-4109-a061-341adb440e2d admin admin] REQUEST_METHOD: `PUT` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:26:52.305515 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3c52e7-9c79-4109-a061-341adb440e2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:26:52.305967 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3c52e7-9c79-4109-a061-341adb440e2d admin admin] PATH_INFO: `/v3/projects/83a67c016d1f4b748d070a360a247e03/users/870f4730ac1b46cabe38f7cb4bb15920/roles/634ba284303b4626b5a0402772c68f5c` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:26:52.308063 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3c52e7-9c79-4109-a061-341adb440e2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=83a67c016d1f4b748d070a360a247e03, user_id=870f4730ac1b46cabe38f7cb4bb15920, role_id=634ba284303b4626b5a0402772c68f5c)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:26:52.310734 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3c52e7-9c79-4109-a061-341adb440e2d admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:26:52.321168 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1153/2325] 10.222.0.70 () {60 vars in 1482 bytes} [Tue May 10 19:26:52 2022] PUT /identity/v3/projects/83a67c016d1f4b748d070a360a247e03/users/870f4730ac1b46cabe38f7cb4bb15920/roles/634ba284303b4626b5a0402772c68f5c => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:26:52.333370 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca18d45-9e11-4ff8-91fb-b97d3dae9179 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:26:52.333659 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca18d45-9e11-4ff8-91fb-b97d3dae9179 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:26:52.333934 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca18d45-9e11-4ff8-91fb-b97d3dae9179 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:26:52.360380 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-8ca18d45-9e11-4ff8-91fb-b97d3dae9179 None None] MFA Rules not processed for user `870f4730ac1b46cabe38f7cb4bb15920`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:26:52.361582 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-8ca18d45-9e11-4ff8-91fb-b97d3dae9179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:26:52.431316 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1173/2326] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:26:52 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:26:52.442518 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3c52e7-9c79-4109-a061-341adb440e2d admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:26:52.444235 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-cc3c52e7-9c79-4109-a061-341adb440e2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:26:52.498836 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3c52e7-9c79-4109-a061-341adb440e2d admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:26:52.502619 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682d5808-bb2b-4b99-9b56-9588a8ff4d02 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15df2a8967aa43299c10e365f4200d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:26:52.503257 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682d5808-bb2b-4b99-9b56-9588a8ff4d02 service cinder] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:26:52.503536 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682d5808-bb2b-4b99-9b56-9588a8ff4d02 service cinder] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:26:52.503807 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682d5808-bb2b-4b99-9b56-9588a8ff4d02 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:26:52.512664 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682d5808-bb2b-4b99-9b56-9588a8ff4d02 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:26:52.514088 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682d5808-bb2b-4b99-9b56-9588a8ff4d02 service cinder] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:26:52.523177 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1154/2327] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:26:52 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:26:52.595922 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca18d45-9e11-4ff8-91fb-b97d3dae9179 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:26:52.605787 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca18d45-9e11-4ff8-91fb-b97d3dae9179 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:26:52.609642 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a091e0b-6cca-4dfd-841a-5e7feeab4c7e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15df2a8967aa43299c10e365f4200d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:26:52.610275 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a091e0b-6cca-4dfd-841a-5e7feeab4c7e service cinder] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:26:52.610557 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a091e0b-6cca-4dfd-841a-5e7feeab4c7e service cinder] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:26:52.610830 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a091e0b-6cca-4dfd-841a-5e7feeab4c7e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:26:52.664064 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a091e0b-6cca-4dfd-841a-5e7feeab4c7e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:26:52.666000 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a091e0b-6cca-4dfd-841a-5e7feeab4c7e service cinder] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:26:52.674856 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1174/2328] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:26:52 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:27:25.293775 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d3a4e2-654b-499d-9a71-aec3bcc78bb5 None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:27:25.294327 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d3a4e2-654b-499d-9a71-aec3bcc78bb5 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:27:25.294431 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d3a4e2-654b-499d-9a71-aec3bcc78bb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:27:25.312162 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-77d3a4e2-654b-499d-9a71-aec3bcc78bb5 None None] MFA Rules not processed for user `f2fbc31d945b4a61beb3fd9a28657583`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:27:25.313405 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-77d3a4e2-654b-499d-9a71-aec3bcc78bb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:27:25.380675 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1155/2329] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:27:25 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:27:33.995328 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a091e0b-6cca-4dfd-841a-5e7feeab4c7e service cinder] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:27:34.084082 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a091e0b-6cca-4dfd-841a-5e7feeab4c7e service cinder] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:27:34.089229 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb042b6-7192-4a61-86fa-8432c6742cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:27:34.091274 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb042b6-7192-4a61-86fa-8432c6742cb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:27:34.091624 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb042b6-7192-4a61-86fa-8432c6742cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:27:34.091891 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb042b6-7192-4a61-86fa-8432c6742cb5 admin admin] PATH_INFO: `/v3/users/5392cec307b84ed28174b3a17dc76823` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:27:34.093142 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb042b6-7192-4a61-86fa-8432c6742cb5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5392cec307b84ed28174b3a17dc76823)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:27:34.095053 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb042b6-7192-4a61-86fa-8432c6742cb5 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:27:34.153402 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-2eb042b6-7192-4a61-86fa-8432c6742cb5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5392cec307b84ed28174b3a17dc76823'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:27:34.166048 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-2eb042b6-7192-4a61-86fa-8432c6742cb5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5392cec307b84ed28174b3a17dc76823'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:27:34.166861 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-2eb042b6-7192-4a61-86fa-8432c6742cb5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5392cec307b84ed28174b3a17dc76823'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:27:34.174221 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-2eb042b6-7192-4a61-86fa-8432c6742cb5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5392cec307b84ed28174b3a17dc76823'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:27:34.181154 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-2eb042b6-7192-4a61-86fa-8432c6742cb5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5392cec307b84ed28174b3a17dc76823'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:27:34.187088 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1175/2330] 10.222.0.70 () {58 vars in 1223 bytes} [Tue May 10 19:27:33 2022] DELETE /identity/v3/users/5392cec307b84ed28174b3a17dc76823 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:27:34.191633 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2691df57-1616-404f-a98f-51f4c69c951c None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:27:34.192506 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2691df57-1616-404f-a98f-51f4c69c951c None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:27:34.192795 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2691df57-1616-404f-a98f-51f4c69c951c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:27:34.210810 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-2691df57-1616-404f-a98f-51f4c69c951c None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:27:34.212607 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-2691df57-1616-404f-a98f-51f4c69c951c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:27:34.279447 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1156/2331] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:27:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:27:34.289091 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb042b6-7192-4a61-86fa-8432c6742cb5 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:27:34.291161 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-2eb042b6-7192-4a61-86fa-8432c6742cb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:27:34.361388 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb042b6-7192-4a61-86fa-8432c6742cb5 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:27:34.365337 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add33832-30fe-4759-b69a-1632a498ee90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f1dc79540b48c0866478cc48cd8205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:27:34.365971 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add33832-30fe-4759-b69a-1632a498ee90 service neutron] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:27:34.366255 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add33832-30fe-4759-b69a-1632a498ee90 service neutron] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:27:34.366533 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add33832-30fe-4759-b69a-1632a498ee90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:27:34.378316 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add33832-30fe-4759-b69a-1632a498ee90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:27:34.379784 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add33832-30fe-4759-b69a-1632a498ee90 service neutron] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:27:34.391988 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1176/2332] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:27:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:27:35.046289 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2691df57-1616-404f-a98f-51f4c69c951c None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:27:35.048299 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-2691df57-1616-404f-a98f-51f4c69c951c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:27:35.080085 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2691df57-1616-404f-a98f-51f4c69c951c None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:27:35.085416 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c460aa-e045-4c6b-ac39-1c8ebb78c7b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:27:35.085906 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c460aa-e045-4c6b-ac39-1c8ebb78c7b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:27:35.086195 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c460aa-e045-4c6b-ac39-1c8ebb78c7b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:27:35.086467 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c460aa-e045-4c6b-ac39-1c8ebb78c7b0 admin admin] PATH_INFO: `/v3/projects/7546357d3332420da38b0941ee1fd16e` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:27:35.088242 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c460aa-e045-4c6b-ac39-1c8ebb78c7b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7546357d3332420da38b0941ee1fd16e)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:27:35.090372 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c460aa-e045-4c6b-ac39-1c8ebb78c7b0 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:27:35.139188 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-76c460aa-e045-4c6b-ac39-1c8ebb78c7b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7546357d3332420da38b0941ee1fd16e', 'request_id': 'req-76c460aa-e045-4c6b-ac39-1c8ebb78c7b0'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:27:35.144638 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-76c460aa-e045-4c6b-ac39-1c8ebb78c7b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7546357d3332420da38b0941ee1fd16e', 'request_id': 'req-76c460aa-e045-4c6b-ac39-1c8ebb78c7b0'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:27:35.153323 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-76c460aa-e045-4c6b-ac39-1c8ebb78c7b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7546357d3332420da38b0941ee1fd16e', 'request_id': 'req-76c460aa-e045-4c6b-ac39-1c8ebb78c7b0'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:27:35.164850 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-76c460aa-e045-4c6b-ac39-1c8ebb78c7b0 admin admin] The token cache is being invalidate because project 7546357d3332420da38b0941ee1fd16e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79993) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:27:35.165171 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-76c460aa-e045-4c6b-ac39-1c8ebb78c7b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:27:35.165831 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-76c460aa-e045-4c6b-ac39-1c8ebb78c7b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:27:35.167402 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1157/2333] 10.222.0.70 () {58 vars in 1232 bytes} [Tue May 10 19:27:35 2022] DELETE /identity/v3/projects/7546357d3332420da38b0941ee1fd16e => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:27:35.171467 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add33832-30fe-4759-b69a-1632a498ee90 service neutron] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:27:35.181754 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add33832-30fe-4759-b69a-1632a498ee90 service neutron] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:27:35.239078 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce249f72-43d7-42f0-b36e-13306fdc2685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:27:35.239949 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce249f72-43d7-42f0-b36e-13306fdc2685 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:27:35.240232 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce249f72-43d7-42f0-b36e-13306fdc2685 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:27:35.240608 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce249f72-43d7-42f0-b36e-13306fdc2685 admin admin] PATH_INFO: `/v3/users/870f4730ac1b46cabe38f7cb4bb15920` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:27:35.241802 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce249f72-43d7-42f0-b36e-13306fdc2685 admin admin] RBAC: Authorizing `identity:delete_user(user_id=870f4730ac1b46cabe38f7cb4bb15920)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:27:35.243751 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce249f72-43d7-42f0-b36e-13306fdc2685 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:27:35.290561 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-ce249f72-43d7-42f0-b36e-13306fdc2685 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '870f4730ac1b46cabe38f7cb4bb15920'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:27:35.301981 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-ce249f72-43d7-42f0-b36e-13306fdc2685 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '870f4730ac1b46cabe38f7cb4bb15920'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:27:35.302696 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-ce249f72-43d7-42f0-b36e-13306fdc2685 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '870f4730ac1b46cabe38f7cb4bb15920'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:27:35.309931 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-ce249f72-43d7-42f0-b36e-13306fdc2685 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '870f4730ac1b46cabe38f7cb4bb15920'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:27:35.316645 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-ce249f72-43d7-42f0-b36e-13306fdc2685 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '870f4730ac1b46cabe38f7cb4bb15920'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:27:35.323605 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1177/2334] 10.222.0.70 () {58 vars in 1223 bytes} [Tue May 10 19:27:35 2022] DELETE /identity/v3/users/870f4730ac1b46cabe38f7cb4bb15920 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:27:35.519743 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5145a132-0570-471a-ad91-7d41393ec7b7 None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:27:35.520221 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5145a132-0570-471a-ad91-7d41393ec7b7 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:27:35.520315 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5145a132-0570-471a-ad91-7d41393ec7b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:27:35.538370 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-5145a132-0570-471a-ad91-7d41393ec7b7 None None] MFA Rules not processed for user `db6fd87ab33946808f4153585fc1d07a`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:27:35.539562 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-5145a132-0570-471a-ad91-7d41393ec7b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:27:35.600733 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce249f72-43d7-42f0-b36e-13306fdc2685 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:27:35.602161 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-ce249f72-43d7-42f0-b36e-13306fdc2685 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:27:35.608460 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1158/2335] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:27:35 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:27:35.671040 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce249f72-43d7-42f0-b36e-13306fdc2685 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:27:35.675179 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8618346b-0f53-492e-850d-80f7f5c11ab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:27:35.676063 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8618346b-0f53-492e-850d-80f7f5c11ab8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:27:35.676345 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8618346b-0f53-492e-850d-80f7f5c11ab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:27:35.676769 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8618346b-0f53-492e-850d-80f7f5c11ab8 admin admin] PATH_INFO: `/v3/projects/83a67c016d1f4b748d070a360a247e03` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:27:35.678236 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8618346b-0f53-492e-850d-80f7f5c11ab8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=83a67c016d1f4b748d070a360a247e03)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:27:35.681379 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8618346b-0f53-492e-850d-80f7f5c11ab8 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:27:35.729717 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-8618346b-0f53-492e-850d-80f7f5c11ab8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83a67c016d1f4b748d070a360a247e03', 'request_id': 'req-8618346b-0f53-492e-850d-80f7f5c11ab8'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:27:35.735059 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-8618346b-0f53-492e-850d-80f7f5c11ab8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83a67c016d1f4b748d070a360a247e03', 'request_id': 'req-8618346b-0f53-492e-850d-80f7f5c11ab8'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:27:35.742554 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-8618346b-0f53-492e-850d-80f7f5c11ab8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83a67c016d1f4b748d070a360a247e03', 'request_id': 'req-8618346b-0f53-492e-850d-80f7f5c11ab8'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:27:35.756042 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-8618346b-0f53-492e-850d-80f7f5c11ab8 admin admin] The token cache is being invalidate because project 83a67c016d1f4b748d070a360a247e03 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79994) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:27:35.756199 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-8618346b-0f53-492e-850d-80f7f5c11ab8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:27:35.756873 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-8618346b-0f53-492e-850d-80f7f5c11ab8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:27:35.762785 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1178/2336] 10.222.0.70 () {58 vars in 1232 bytes} [Tue May 10 19:27:35 2022] DELETE /identity/v3/projects/83a67c016d1f4b748d070a360a247e03 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:27:35.764039 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ac8c14-86c7-4641-a311-cfdcc1157d41 None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:27:35.764333 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ac8c14-86c7-4641-a311-cfdcc1157d41 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:27:35.764642 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ac8c14-86c7-4641-a311-cfdcc1157d41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:27:35.784125 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-e2ac8c14-86c7-4641-a311-cfdcc1157d41 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:27:35.785495 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-e2ac8c14-86c7-4641-a311-cfdcc1157d41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:27:35.845702 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1159/2337] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:27:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:27:35.853925 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734af587-e656-4c0e-9e30-0f984c965381 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:27:35.854211 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734af587-e656-4c0e-9e30-0f984c965381 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:27:35.854487 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734af587-e656-4c0e-9e30-0f984c965381 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:27:35.872850 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-734af587-e656-4c0e-9e30-0f984c965381 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:27:35.874034 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-734af587-e656-4c0e-9e30-0f984c965381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:27:35.882842 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1179/2338] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:27:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:27:35.887086 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ac8c14-86c7-4641-a311-cfdcc1157d41 None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:27:35.896867 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ac8c14-86c7-4641-a311-cfdcc1157d41 None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:27:35.906738 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1def8864-ef81-4a89-9b2f-bac3d4f00ee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:27:35.907338 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1def8864-ef81-4a89-9b2f-bac3d4f00ee6 admin admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:27:35.907621 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1def8864-ef81-4a89-9b2f-bac3d4f00ee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:27:35.907898 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1def8864-ef81-4a89-9b2f-bac3d4f00ee6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:27:35.908650 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1def8864-ef81-4a89-9b2f-bac3d4f00ee6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:27:35.908960 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1def8864-ef81-4a89-9b2f-bac3d4f00ee6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:27:35.910563 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1def8864-ef81-4a89-9b2f-bac3d4f00ee6 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:27:35.923446 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1160/2339] 10.222.0.70 () {58 vars in 1152 bytes} [Tue May 10 19:27:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:27:35.927621 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734af587-e656-4c0e-9e30-0f984c965381 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:27:35.937630 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734af587-e656-4c0e-9e30-0f984c965381 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:27:35.946805 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0bb83d-5e37-40b2-9def-e5f9c4002712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:27:35.946805 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0bb83d-5e37-40b2-9def-e5f9c4002712 admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:27:35.946805 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0bb83d-5e37-40b2-9def-e5f9c4002712 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:27:35.946805 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0bb83d-5e37-40b2-9def-e5f9c4002712 admin admin] PATH_INFO: `/v3/projects` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:27:35.947225 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0bb83d-5e37-40b2-9def-e5f9c4002712 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:27:35.947225 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0bb83d-5e37-40b2-9def-e5f9c4002712 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:27:35.999182 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1180/2340] 10.222.0.70 () {60 vars in 1152 bytes} [Tue May 10 19:27:35 2022] POST /identity/v3/projects => generated 369 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 19:27:36.003175 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1def8864-ef81-4a89-9b2f-bac3d4f00ee6 admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:27:36.014308 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1def8864-ef81-4a89-9b2f-bac3d4f00ee6 admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:27:36.070194 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e66a216-685c-4fa9-9a4c-513e430bf7ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:27:36.070874 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e66a216-685c-4fa9-9a4c-513e430bf7ab admin admin] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:27:36.071186 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e66a216-685c-4fa9-9a4c-513e430bf7ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:27:36.071472 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e66a216-685c-4fa9-9a4c-513e430bf7ab admin admin] PATH_INFO: `/v3/users` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:27:36.072212 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e66a216-685c-4fa9-9a4c-513e430bf7ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:27:36.074200 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e66a216-685c-4fa9-9a4c-513e430bf7ab admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:27:36.094683 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1161/2341] 10.222.0.70 () {60 vars in 1143 bytes} [Tue May 10 19:27:36 2022] POST /identity/v3/users => generated 285 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:27:36.098770 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0bb83d-5e37-40b2-9def-e5f9c4002712 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:27:36.109495 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0bb83d-5e37-40b2-9def-e5f9c4002712 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:27:36.114228 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae033006-93ae-462f-9203-b9b11dc88e18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:27:36.115009 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae033006-93ae-462f-9203-b9b11dc88e18 admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:27:36.115157 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae033006-93ae-462f-9203-b9b11dc88e18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:27:36.115436 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae033006-93ae-462f-9203-b9b11dc88e18 admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:27:36.116162 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae033006-93ae-462f-9203-b9b11dc88e18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:27:36.117944 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae033006-93ae-462f-9203-b9b11dc88e18 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:27:36.129199 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1181/2342] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:27:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:27:36.133523 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e66a216-685c-4fa9-9a4c-513e430bf7ab admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:27:36.143624 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e66a216-685c-4fa9-9a4c-513e430bf7ab admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:27:36.148499 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b618a59-9cd2-45f1-bca6-e5fd691176b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:27:36.149164 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b618a59-9cd2-45f1-bca6-e5fd691176b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:27:36.149506 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b618a59-9cd2-45f1-bca6-e5fd691176b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:27:36.150277 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b618a59-9cd2-45f1-bca6-e5fd691176b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:27:36.151144 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b618a59-9cd2-45f1-bca6-e5fd691176b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:27:36.152775 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b618a59-9cd2-45f1-bca6-e5fd691176b5 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:27:36.167181 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1162/2343] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:27:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:27:36.168267 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae033006-93ae-462f-9203-b9b11dc88e18 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:27:36.178181 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae033006-93ae-462f-9203-b9b11dc88e18 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:27:36.184072 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad4511a-ab2b-4512-aa07-1a885efdb2f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:27:36.184987 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad4511a-ab2b-4512-aa07-1a885efdb2f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:27:36.185269 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad4511a-ab2b-4512-aa07-1a885efdb2f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:27:36.185541 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad4511a-ab2b-4512-aa07-1a885efdb2f7 admin admin] PATH_INFO: `/v3/projects/67616b6d8caf4d488f8df1928f8f6bc0/users/a2bd2460b679474f9b3f6ab30047e22c/roles/5c07cf5bfbd3427db18428aa50420962` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:27:36.200916 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad4511a-ab2b-4512-aa07-1a885efdb2f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67616b6d8caf4d488f8df1928f8f6bc0, user_id=a2bd2460b679474f9b3f6ab30047e22c, role_id=5c07cf5bfbd3427db18428aa50420962)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:27:36.203584 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad4511a-ab2b-4512-aa07-1a885efdb2f7 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:27:36.218019 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1182/2344] 10.222.0.70 () {60 vars in 1482 bytes} [Tue May 10 19:27:36 2022] PUT /identity/v3/projects/67616b6d8caf4d488f8df1928f8f6bc0/users/a2bd2460b679474f9b3f6ab30047e22c/roles/5c07cf5bfbd3427db18428aa50420962 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 19:27:36.228559 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afff3513-72c5-41e2-85b1-ed025bdc9322 None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:27:36.228859 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afff3513-72c5-41e2-85b1-ed025bdc9322 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:27:36.229137 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afff3513-72c5-41e2-85b1-ed025bdc9322 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:27:36.261523 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-afff3513-72c5-41e2-85b1-ed025bdc9322 None None] MFA Rules not processed for user `a2bd2460b679474f9b3f6ab30047e22c`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:27:36.264589 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-afff3513-72c5-41e2-85b1-ed025bdc9322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:27:36.338609 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1163/2345] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:27:36 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:27:36.343174 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad4511a-ab2b-4512-aa07-1a885efdb2f7 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:27:36.427510 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad4511a-ab2b-4512-aa07-1a885efdb2f7 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:27:36.444123 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbc6751-393f-405c-8e07-64c6ce9b967f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:27:36.445092 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbc6751-393f-405c-8e07-64c6ce9b967f admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:27:36.445377 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbc6751-393f-405c-8e07-64c6ce9b967f admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:27:36.445653 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbc6751-393f-405c-8e07-64c6ce9b967f admin admin] PATH_INFO: `/v3/projects` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:27:36.447068 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbc6751-393f-405c-8e07-64c6ce9b967f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:27:36.449024 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbc6751-393f-405c-8e07-64c6ce9b967f admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:27:36.474326 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1183/2346] 10.222.0.70 () {60 vars in 1152 bytes} [Tue May 10 19:27:36 2022] POST /identity/v3/projects => generated 367 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 19:27:36.478472 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afff3513-72c5-41e2-85b1-ed025bdc9322 None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:27:36.490430 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afff3513-72c5-41e2-85b1-ed025bdc9322 None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:27:36.546619 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61a937f-0e1f-4ff6-9b75-8f7a058ca81c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:27:36.547305 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61a937f-0e1f-4ff6-9b75-8f7a058ca81c admin admin] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:27:36.547590 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61a937f-0e1f-4ff6-9b75-8f7a058ca81c admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:27:36.548041 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61a937f-0e1f-4ff6-9b75-8f7a058ca81c admin admin] PATH_INFO: `/v3/users` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:27:36.548783 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61a937f-0e1f-4ff6-9b75-8f7a058ca81c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:27:36.550737 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61a937f-0e1f-4ff6-9b75-8f7a058ca81c admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:27:36.575085 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1164/2347] 10.222.0.70 () {60 vars in 1143 bytes} [Tue May 10 19:27:36 2022] POST /identity/v3/users => generated 290 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 19:27:36.578705 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbc6751-393f-405c-8e07-64c6ce9b967f admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:27:36.592615 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbc6751-393f-405c-8e07-64c6ce9b967f admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:27:36.597443 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885fef33-dc53-4f01-bf08-321d923c29e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:27:36.598114 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885fef33-dc53-4f01-bf08-321d923c29e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:27:36.598416 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885fef33-dc53-4f01-bf08-321d923c29e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:27:36.598678 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885fef33-dc53-4f01-bf08-321d923c29e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:27:36.599564 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885fef33-dc53-4f01-bf08-321d923c29e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:27:36.601205 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885fef33-dc53-4f01-bf08-321d923c29e5 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:27:36.613363 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1184/2348] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:27:36 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:27:36.617644 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61a937f-0e1f-4ff6-9b75-8f7a058ca81c admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:27:36.628895 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61a937f-0e1f-4ff6-9b75-8f7a058ca81c admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:27:36.634035 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9932c2d9-2ecd-4f0d-962f-e245669da195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:27:36.634930 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9932c2d9-2ecd-4f0d-962f-e245669da195 admin admin] REQUEST_METHOD: `PUT` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:27:36.635209 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9932c2d9-2ecd-4f0d-962f-e245669da195 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:27:36.635770 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9932c2d9-2ecd-4f0d-962f-e245669da195 admin admin] PATH_INFO: `/v3/projects/40bfd1f716514a3e9031cc713ea7711a/users/f3acdf35138a4e92bc66015bcd4b1df0/roles/634ba284303b4626b5a0402772c68f5c` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:27:36.650803 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9932c2d9-2ecd-4f0d-962f-e245669da195 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40bfd1f716514a3e9031cc713ea7711a, user_id=f3acdf35138a4e92bc66015bcd4b1df0, role_id=634ba284303b4626b5a0402772c68f5c)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:27:36.653566 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9932c2d9-2ecd-4f0d-962f-e245669da195 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:27:36.668289 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1165/2349] 10.222.0.70 () {60 vars in 1482 bytes} [Tue May 10 19:27:36 2022] PUT /identity/v3/projects/40bfd1f716514a3e9031cc713ea7711a/users/f3acdf35138a4e92bc66015bcd4b1df0/roles/634ba284303b4626b5a0402772c68f5c => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 19:27:36.672614 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885fef33-dc53-4f01-bf08-321d923c29e5 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:27:36.686291 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885fef33-dc53-4f01-bf08-321d923c29e5 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:27:36.747824 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96409aab-68b4-4d35-a5c2-7f5cf4533517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:27:36.748863 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96409aab-68b4-4d35-a5c2-7f5cf4533517 admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:27:36.749228 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96409aab-68b4-4d35-a5c2-7f5cf4533517 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:27:36.749649 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96409aab-68b4-4d35-a5c2-7f5cf4533517 admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:27:36.750489 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96409aab-68b4-4d35-a5c2-7f5cf4533517 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:27:36.752171 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96409aab-68b4-4d35-a5c2-7f5cf4533517 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:27:36.763885 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1185/2350] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:27:36 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:27:36.768189 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9932c2d9-2ecd-4f0d-962f-e245669da195 admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:27:36.780405 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9932c2d9-2ecd-4f0d-962f-e245669da195 admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:27:36.785315 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73cc5cf-8490-424f-bbcb-9a74ff2f30ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:27:36.786212 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73cc5cf-8490-424f-bbcb-9a74ff2f30ea admin admin] REQUEST_METHOD: `PUT` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:27:36.786493 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73cc5cf-8490-424f-bbcb-9a74ff2f30ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:27:36.786766 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73cc5cf-8490-424f-bbcb-9a74ff2f30ea admin admin] PATH_INFO: `/v3/projects/40bfd1f716514a3e9031cc713ea7711a/users/f3acdf35138a4e92bc66015bcd4b1df0/roles/634ba284303b4626b5a0402772c68f5c` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:27:36.788731 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73cc5cf-8490-424f-bbcb-9a74ff2f30ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=40bfd1f716514a3e9031cc713ea7711a, user_id=f3acdf35138a4e92bc66015bcd4b1df0, role_id=634ba284303b4626b5a0402772c68f5c)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:27:36.792069 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73cc5cf-8490-424f-bbcb-9a74ff2f30ea admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:27:36.802285 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1166/2351] 10.222.0.70 () {60 vars in 1482 bytes} [Tue May 10 19:27:36 2022] PUT /identity/v3/projects/40bfd1f716514a3e9031cc713ea7711a/users/f3acdf35138a4e92bc66015bcd4b1df0/roles/634ba284303b4626b5a0402772c68f5c => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:27:36.812865 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375f6fc0-bd06-48ab-a3c3-19c052ea857e None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:27:36.813156 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375f6fc0-bd06-48ab-a3c3-19c052ea857e None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:27:36.813432 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375f6fc0-bd06-48ab-a3c3-19c052ea857e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:27:36.841233 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-375f6fc0-bd06-48ab-a3c3-19c052ea857e None None] MFA Rules not processed for user `f3acdf35138a4e92bc66015bcd4b1df0`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:27:36.842678 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-375f6fc0-bd06-48ab-a3c3-19c052ea857e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:27:36.932229 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1186/2352] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:27:36 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:27:36.949786 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73cc5cf-8490-424f-bbcb-9a74ff2f30ea admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:27:36.953703 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-a73cc5cf-8490-424f-bbcb-9a74ff2f30ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:27:37.019322 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73cc5cf-8490-424f-bbcb-9a74ff2f30ea admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:27:37.023079 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909265d9-0079-47be-abb1-aae02c76f046 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15df2a8967aa43299c10e365f4200d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:27:37.023735 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909265d9-0079-47be-abb1-aae02c76f046 service cinder] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:27:37.024835 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909265d9-0079-47be-abb1-aae02c76f046 service cinder] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:27:37.024835 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909265d9-0079-47be-abb1-aae02c76f046 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:27:37.035093 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909265d9-0079-47be-abb1-aae02c76f046 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:27:37.036573 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909265d9-0079-47be-abb1-aae02c76f046 service cinder] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:27:37.050593 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1167/2353] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:27:36 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:27:38.598672 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375f6fc0-bd06-48ab-a3c3-19c052ea857e None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:27:38.700338 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375f6fc0-bd06-48ab-a3c3-19c052ea857e None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:27:38.705884 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0a3775-746b-47d3-95b0-ea7fb5df18ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:27:38.706796 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0a3775-746b-47d3-95b0-ea7fb5df18ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:27:38.707140 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0a3775-746b-47d3-95b0-ea7fb5df18ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:27:38.707422 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0a3775-746b-47d3-95b0-ea7fb5df18ac admin admin] PATH_INFO: `/v3/users/a2bd2460b679474f9b3f6ab30047e22c` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:27:38.708675 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0a3775-746b-47d3-95b0-ea7fb5df18ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2bd2460b679474f9b3f6ab30047e22c)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:27:38.710600 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0a3775-746b-47d3-95b0-ea7fb5df18ac admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:27:38.770601 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-7e0a3775-746b-47d3-95b0-ea7fb5df18ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2bd2460b679474f9b3f6ab30047e22c'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:27:38.787384 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-7e0a3775-746b-47d3-95b0-ea7fb5df18ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2bd2460b679474f9b3f6ab30047e22c'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:27:38.788150 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-7e0a3775-746b-47d3-95b0-ea7fb5df18ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2bd2460b679474f9b3f6ab30047e22c'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:27:38.797277 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-7e0a3775-746b-47d3-95b0-ea7fb5df18ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2bd2460b679474f9b3f6ab30047e22c'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:27:38.807146 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-7e0a3775-746b-47d3-95b0-ea7fb5df18ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2bd2460b679474f9b3f6ab30047e22c'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:27:38.813861 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1187/2354] 10.222.0.70 () {58 vars in 1223 bytes} [Tue May 10 19:27:38 2022] DELETE /identity/v3/users/a2bd2460b679474f9b3f6ab30047e22c => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:27:38.818278 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84750413-d27d-4311-81e0-b8f104ad40d2 None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:27:38.818822 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84750413-d27d-4311-81e0-b8f104ad40d2 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:27:38.818822 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84750413-d27d-4311-81e0-b8f104ad40d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:27:38.845506 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-84750413-d27d-4311-81e0-b8f104ad40d2 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:27:38.846906 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-84750413-d27d-4311-81e0-b8f104ad40d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:27:38.922830 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1168/2355] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:27:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:27:38.936453 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0a3775-746b-47d3-95b0-ea7fb5df18ac admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:27:38.938064 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-7e0a3775-746b-47d3-95b0-ea7fb5df18ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:27:39.011463 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0a3775-746b-47d3-95b0-ea7fb5df18ac admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:27:39.015675 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1b91e2-70be-4c7b-a4aa-c0134b38c9f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f1dc79540b48c0866478cc48cd8205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:27:39.016644 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1b91e2-70be-4c7b-a4aa-c0134b38c9f4 service neutron] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:27:39.016928 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1b91e2-70be-4c7b-a4aa-c0134b38c9f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:27:39.017204 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1b91e2-70be-4c7b-a4aa-c0134b38c9f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:27:39.028646 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1b91e2-70be-4c7b-a4aa-c0134b38c9f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:27:39.030111 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1b91e2-70be-4c7b-a4aa-c0134b38c9f4 service neutron] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:27:39.040548 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1188/2356] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:27:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 19:27:39.343917 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84750413-d27d-4311-81e0-b8f104ad40d2 None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:27:39.345419 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-84750413-d27d-4311-81e0-b8f104ad40d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:27:39.360183 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84750413-d27d-4311-81e0-b8f104ad40d2 None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:27:39.365282 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9602c87e-45bd-4dc2-ba80-4f2736ce9d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:27:39.366181 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9602c87e-45bd-4dc2-ba80-4f2736ce9d38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:27:39.366648 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9602c87e-45bd-4dc2-ba80-4f2736ce9d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:27:39.366978 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9602c87e-45bd-4dc2-ba80-4f2736ce9d38 admin admin] PATH_INFO: `/v3/projects/67616b6d8caf4d488f8df1928f8f6bc0` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:27:39.369145 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9602c87e-45bd-4dc2-ba80-4f2736ce9d38 admin admin] RBAC: Authorizing `identity:delete_project(project_id=67616b6d8caf4d488f8df1928f8f6bc0)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:27:39.371068 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9602c87e-45bd-4dc2-ba80-4f2736ce9d38 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:27:39.419012 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-9602c87e-45bd-4dc2-ba80-4f2736ce9d38 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67616b6d8caf4d488f8df1928f8f6bc0', 'request_id': 'req-9602c87e-45bd-4dc2-ba80-4f2736ce9d38'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:27:39.424226 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-9602c87e-45bd-4dc2-ba80-4f2736ce9d38 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67616b6d8caf4d488f8df1928f8f6bc0', 'request_id': 'req-9602c87e-45bd-4dc2-ba80-4f2736ce9d38'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:27:39.432114 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-9602c87e-45bd-4dc2-ba80-4f2736ce9d38 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67616b6d8caf4d488f8df1928f8f6bc0', 'request_id': 'req-9602c87e-45bd-4dc2-ba80-4f2736ce9d38'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:27:39.442783 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-9602c87e-45bd-4dc2-ba80-4f2736ce9d38 admin admin] The token cache is being invalidate because project 67616b6d8caf4d488f8df1928f8f6bc0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79993) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:27:39.443068 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-9602c87e-45bd-4dc2-ba80-4f2736ce9d38 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:27:39.443681 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-9602c87e-45bd-4dc2-ba80-4f2736ce9d38 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:27:39.445495 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1169/2357] 10.222.0.70 () {58 vars in 1232 bytes} [Tue May 10 19:27:39 2022] DELETE /identity/v3/projects/67616b6d8caf4d488f8df1928f8f6bc0 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:27:39.449910 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1b91e2-70be-4c7b-a4aa-c0134b38c9f4 service neutron] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:27:39.459390 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1b91e2-70be-4c7b-a4aa-c0134b38c9f4 service neutron] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:27:39.516793 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f46aa91-943d-4664-8c05-55f8f04cea75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:27:39.517670 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f46aa91-943d-4664-8c05-55f8f04cea75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:27:39.517983 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f46aa91-943d-4664-8c05-55f8f04cea75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:27:39.518254 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f46aa91-943d-4664-8c05-55f8f04cea75 admin admin] PATH_INFO: `/v3/users/f3acdf35138a4e92bc66015bcd4b1df0` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:27:39.519462 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f46aa91-943d-4664-8c05-55f8f04cea75 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3acdf35138a4e92bc66015bcd4b1df0)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:27:39.521411 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f46aa91-943d-4664-8c05-55f8f04cea75 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:27:39.566583 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-4f46aa91-943d-4664-8c05-55f8f04cea75 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3acdf35138a4e92bc66015bcd4b1df0'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:27:39.578195 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-4f46aa91-943d-4664-8c05-55f8f04cea75 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3acdf35138a4e92bc66015bcd4b1df0'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:27:39.578871 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-4f46aa91-943d-4664-8c05-55f8f04cea75 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3acdf35138a4e92bc66015bcd4b1df0'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:27:39.586856 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-4f46aa91-943d-4664-8c05-55f8f04cea75 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3acdf35138a4e92bc66015bcd4b1df0'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:27:39.594721 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-4f46aa91-943d-4664-8c05-55f8f04cea75 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3acdf35138a4e92bc66015bcd4b1df0'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:27:39.602013 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1189/2358] 10.222.0.70 () {58 vars in 1223 bytes} [Tue May 10 19:27:39 2022] DELETE /identity/v3/users/f3acdf35138a4e92bc66015bcd4b1df0 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:27:40.152261 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9602c87e-45bd-4dc2-ba80-4f2736ce9d38 admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:27:40.153797 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-9602c87e-45bd-4dc2-ba80-4f2736ce9d38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:27:40.169108 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9602c87e-45bd-4dc2-ba80-4f2736ce9d38 admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:27:40.238334 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cedfc7-0de8-4d44-9e95-9564e59a7f24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:27:40.239521 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cedfc7-0de8-4d44-9e95-9564e59a7f24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:27:40.239806 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cedfc7-0de8-4d44-9e95-9564e59a7f24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:27:40.240079 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cedfc7-0de8-4d44-9e95-9564e59a7f24 admin admin] PATH_INFO: `/v3/projects/40bfd1f716514a3e9031cc713ea7711a` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:27:40.241311 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cedfc7-0de8-4d44-9e95-9564e59a7f24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=40bfd1f716514a3e9031cc713ea7711a)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:27:40.243773 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cedfc7-0de8-4d44-9e95-9564e59a7f24 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:27:40.295173 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-a4cedfc7-0de8-4d44-9e95-9564e59a7f24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40bfd1f716514a3e9031cc713ea7711a', 'request_id': 'req-a4cedfc7-0de8-4d44-9e95-9564e59a7f24'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:27:40.301315 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-a4cedfc7-0de8-4d44-9e95-9564e59a7f24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40bfd1f716514a3e9031cc713ea7711a', 'request_id': 'req-a4cedfc7-0de8-4d44-9e95-9564e59a7f24'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:27:40.310206 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-a4cedfc7-0de8-4d44-9e95-9564e59a7f24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40bfd1f716514a3e9031cc713ea7711a', 'request_id': 'req-a4cedfc7-0de8-4d44-9e95-9564e59a7f24'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:27:40.328856 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-a4cedfc7-0de8-4d44-9e95-9564e59a7f24 admin admin] The token cache is being invalidate because project 40bfd1f716514a3e9031cc713ea7711a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79993) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:27:40.328856 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-a4cedfc7-0de8-4d44-9e95-9564e59a7f24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:27:40.328856 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-a4cedfc7-0de8-4d44-9e95-9564e59a7f24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:27:40.332502 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1170/2359] 10.222.0.70 () {58 vars in 1232 bytes} [Tue May 10 19:27:40 2022] DELETE /identity/v3/projects/40bfd1f716514a3e9031cc713ea7711a => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:27:40.334716 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53253c91-46d1-4a18-b807-88b251a94179 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:27:40.334865 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53253c91-46d1-4a18-b807-88b251a94179 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:27:40.335129 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53253c91-46d1-4a18-b807-88b251a94179 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:27:40.352808 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-53253c91-46d1-4a18-b807-88b251a94179 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:27:40.353985 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-53253c91-46d1-4a18-b807-88b251a94179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:27:40.415808 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1190/2360] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:27:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:27:40.424243 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8750e3d2-c92c-4551-b755-4a59fa661d20 None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:27:40.424556 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8750e3d2-c92c-4551-b755-4a59fa661d20 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:27:40.424835 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8750e3d2-c92c-4551-b755-4a59fa661d20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:27:40.445359 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-8750e3d2-c92c-4551-b755-4a59fa661d20 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:27:40.446711 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-8750e3d2-c92c-4551-b755-4a59fa661d20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:27:40.456738 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1171/2361] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:27:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:27:40.461047 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53253c91-46d1-4a18-b807-88b251a94179 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:27:40.474659 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53253c91-46d1-4a18-b807-88b251a94179 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:27:40.480556 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6313514-baa5-47e0-b260-e79a84c93b3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:27:40.481531 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6313514-baa5-47e0-b260-e79a84c93b3a admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:27:40.482043 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6313514-baa5-47e0-b260-e79a84c93b3a admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:27:40.482497 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6313514-baa5-47e0-b260-e79a84c93b3a admin admin] PATH_INFO: `/v3/domains` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:27:40.483391 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6313514-baa5-47e0-b260-e79a84c93b3a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:27:40.483865 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6313514-baa5-47e0-b260-e79a84c93b3a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:27:40.485829 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6313514-baa5-47e0-b260-e79a84c93b3a admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:27:40.501425 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1191/2362] 10.222.0.70 () {58 vars in 1152 bytes} [Tue May 10 19:27:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:27:40.506522 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8750e3d2-c92c-4551-b755-4a59fa661d20 None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:27:40.518460 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8750e3d2-c92c-4551-b755-4a59fa661d20 None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:27:40.523625 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0f09dd-ca9c-4930-befd-eaa071692d8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:27:40.524339 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0f09dd-ca9c-4930-befd-eaa071692d8d admin admin] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:27:40.524656 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0f09dd-ca9c-4930-befd-eaa071692d8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:27:40.524942 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0f09dd-ca9c-4930-befd-eaa071692d8d admin admin] PATH_INFO: `/v3/projects` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:27:40.525625 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0f09dd-ca9c-4930-befd-eaa071692d8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:27:40.527689 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0f09dd-ca9c-4930-befd-eaa071692d8d admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:27:40.554860 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1172/2363] 10.222.0.70 () {60 vars in 1152 bytes} [Tue May 10 19:27:40 2022] POST /identity/v3/projects => generated 369 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:27:40.562237 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6313514-baa5-47e0-b260-e79a84c93b3a admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:27:40.572656 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6313514-baa5-47e0-b260-e79a84c93b3a admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:27:40.627762 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2592ae26-470a-4dee-b792-0d9d969b1035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:27:40.628451 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2592ae26-470a-4dee-b792-0d9d969b1035 admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:27:40.628734 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2592ae26-470a-4dee-b792-0d9d969b1035 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:27:40.629016 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2592ae26-470a-4dee-b792-0d9d969b1035 admin admin] PATH_INFO: `/v3/users` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:27:40.629716 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2592ae26-470a-4dee-b792-0d9d969b1035 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:27:40.631700 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2592ae26-470a-4dee-b792-0d9d969b1035 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:27:40.655885 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1192/2364] 10.222.0.70 () {60 vars in 1143 bytes} [Tue May 10 19:27:40 2022] POST /identity/v3/users => generated 285 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 19:27:40.657232 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0f09dd-ca9c-4930-befd-eaa071692d8d admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:27:40.668156 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0f09dd-ca9c-4930-befd-eaa071692d8d admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:27:40.673063 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb6c039-17e0-478e-8011-95cebfe166a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:27:40.673732 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb6c039-17e0-478e-8011-95cebfe166a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:27:40.674018 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb6c039-17e0-478e-8011-95cebfe166a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:27:40.674293 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb6c039-17e0-478e-8011-95cebfe166a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:27:40.675053 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb6c039-17e0-478e-8011-95cebfe166a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:27:40.676749 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb6c039-17e0-478e-8011-95cebfe166a2 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:27:40.688278 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1173/2365] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:27:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:27:40.692152 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2592ae26-470a-4dee-b792-0d9d969b1035 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:27:40.702450 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2592ae26-470a-4dee-b792-0d9d969b1035 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:27:40.716125 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c712ccbd-0e43-4fb9-9425-ae9eabdd212c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:27:40.716841 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c712ccbd-0e43-4fb9-9425-ae9eabdd212c admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:27:40.717698 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c712ccbd-0e43-4fb9-9425-ae9eabdd212c admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:27:40.717983 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c712ccbd-0e43-4fb9-9425-ae9eabdd212c admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:27:40.718712 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c712ccbd-0e43-4fb9-9425-ae9eabdd212c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:27:40.720329 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c712ccbd-0e43-4fb9-9425-ae9eabdd212c admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:27:40.730943 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1193/2366] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:27:40 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:27:40.735068 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb6c039-17e0-478e-8011-95cebfe166a2 admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:27:40.744904 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb6c039-17e0-478e-8011-95cebfe166a2 admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:27:40.749535 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bb018e-fcda-47a1-bc1f-c491c3cd158c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:27:40.750355 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bb018e-fcda-47a1-bc1f-c491c3cd158c admin admin] REQUEST_METHOD: `PUT` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:27:40.750638 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bb018e-fcda-47a1-bc1f-c491c3cd158c admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:27:40.750913 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bb018e-fcda-47a1-bc1f-c491c3cd158c admin admin] PATH_INFO: `/v3/projects/fc81d6b1c9d74f3895cc6285d116b7fa/users/262eaa9a576f4414adefda15bc9c79e2/roles/5c07cf5bfbd3427db18428aa50420962` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:27:40.765352 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bb018e-fcda-47a1-bc1f-c491c3cd158c admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc81d6b1c9d74f3895cc6285d116b7fa, user_id=262eaa9a576f4414adefda15bc9c79e2, role_id=5c07cf5bfbd3427db18428aa50420962)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:27:40.768011 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bb018e-fcda-47a1-bc1f-c491c3cd158c admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:27:40.781227 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1174/2367] 10.222.0.70 () {60 vars in 1482 bytes} [Tue May 10 19:27:40 2022] PUT /identity/v3/projects/fc81d6b1c9d74f3895cc6285d116b7fa/users/262eaa9a576f4414adefda15bc9c79e2/roles/5c07cf5bfbd3427db18428aa50420962 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:27:40.792815 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dd31e8-72ac-4fb6-901b-2749090ac93b None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:27:40.793192 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dd31e8-72ac-4fb6-901b-2749090ac93b None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:27:40.793484 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dd31e8-72ac-4fb6-901b-2749090ac93b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:27:40.819882 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-d6dd31e8-72ac-4fb6-901b-2749090ac93b None None] MFA Rules not processed for user `262eaa9a576f4414adefda15bc9c79e2`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:27:40.821206 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-d6dd31e8-72ac-4fb6-901b-2749090ac93b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:27:40.889173 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1194/2368] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:27:40 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:27:40.893562 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bb018e-fcda-47a1-bc1f-c491c3cd158c admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:27:40.979166 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bb018e-fcda-47a1-bc1f-c491c3cd158c admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:27:40.991437 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ec0123-0fd1-47b0-a61b-86f286655b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:27:40.992551 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ec0123-0fd1-47b0-a61b-86f286655b71 admin admin] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:27:40.992988 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ec0123-0fd1-47b0-a61b-86f286655b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:27:40.993266 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ec0123-0fd1-47b0-a61b-86f286655b71 admin admin] PATH_INFO: `/v3/projects` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:27:40.994631 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ec0123-0fd1-47b0-a61b-86f286655b71 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:27:40.997180 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ec0123-0fd1-47b0-a61b-86f286655b71 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:27:41.044726 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1175/2369] 10.222.0.70 () {60 vars in 1152 bytes} [Tue May 10 19:27:40 2022] POST /identity/v3/projects => generated 369 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:27:41.048791 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dd31e8-72ac-4fb6-901b-2749090ac93b None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:27:41.062347 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dd31e8-72ac-4fb6-901b-2749090ac93b None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:27:41.066690 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50835415-646f-4206-a729-270fbede6635 None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:27:41.066985 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50835415-646f-4206-a729-270fbede6635 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:27:41.067267 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50835415-646f-4206-a729-270fbede6635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:27:41.086204 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-50835415-646f-4206-a729-270fbede6635 None None] MFA Rules not processed for user `058e52f1bf0b4aba965d945815d4acb3`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:27:41.088135 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-50835415-646f-4206-a729-270fbede6635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:27:41.144156 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5a01ae-5348-4d4e-b186-fc6b567c32aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:27:41.144884 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5a01ae-5348-4d4e-b186-fc6b567c32aa admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:27:41.145179 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5a01ae-5348-4d4e-b186-fc6b567c32aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:27:41.145440 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5a01ae-5348-4d4e-b186-fc6b567c32aa admin admin] PATH_INFO: `/v3/users` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:27:41.146141 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5a01ae-5348-4d4e-b186-fc6b567c32aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:27:41.148069 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5a01ae-5348-4d4e-b186-fc6b567c32aa admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:27:41.161562 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1176/2370] 10.222.0.70 () {58 vars in 1009 bytes} [Tue May 10 19:27:41 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:27:41.174921 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1195/2371] 10.222.0.70 () {60 vars in 1143 bytes} [Tue May 10 19:27:41 2022] POST /identity/v3/users => generated 291 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 19:27:41.176165 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50835415-646f-4206-a729-270fbede6635 None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:27:41.189408 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50835415-646f-4206-a729-270fbede6635 None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:27:41.194887 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ec9bf5-ac2e-4767-85f1-96663be225f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:27:41.195660 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ec9bf5-ac2e-4767-85f1-96663be225f1 admin admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:27:41.196590 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ec9bf5-ac2e-4767-85f1-96663be225f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:27:41.196965 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ec9bf5-ac2e-4767-85f1-96663be225f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:27:41.197864 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ec9bf5-ac2e-4767-85f1-96663be225f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:27:41.199556 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ec9bf5-ac2e-4767-85f1-96663be225f1 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:27:41.211050 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1177/2372] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:27:41 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:27:41.216039 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5a01ae-5348-4d4e-b186-fc6b567c32aa admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:27:41.223908 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ec9bf5-ac2e-4767-85f1-96663be225f1 admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:27:41.226463 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-48ec9bf5-ac2e-4767-85f1-96663be225f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:27:41.235218 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5a01ae-5348-4d4e-b186-fc6b567c32aa admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:27:41.241121 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118beaa2-39b0-41c6-80be-d3484426fd1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:27:41.242198 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118beaa2-39b0-41c6-80be-d3484426fd1e admin admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:27:41.242587 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118beaa2-39b0-41c6-80be-d3484426fd1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:27:41.242949 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118beaa2-39b0-41c6-80be-d3484426fd1e admin admin] PATH_INFO: `/v3/projects/18aa510fd53b4bbd8988fff927aa3ff6/users/fa3588ae15a14be1abaf1e13b2bc72db/roles/634ba284303b4626b5a0402772c68f5c` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:27:41.264214 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118beaa2-39b0-41c6-80be-d3484426fd1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=18aa510fd53b4bbd8988fff927aa3ff6, user_id=fa3588ae15a14be1abaf1e13b2bc72db, role_id=634ba284303b4626b5a0402772c68f5c)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:27:41.267643 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118beaa2-39b0-41c6-80be-d3484426fd1e admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:27:41.286778 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1196/2373] 10.222.0.70 () {60 vars in 1482 bytes} [Tue May 10 19:27:41 2022] PUT /identity/v3/projects/18aa510fd53b4bbd8988fff927aa3ff6/users/fa3588ae15a14be1abaf1e13b2bc72db/roles/634ba284303b4626b5a0402772c68f5c => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:27:41.290905 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118beaa2-39b0-41c6-80be-d3484426fd1e admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:27:41.320585 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ec9bf5-ac2e-4767-85f1-96663be225f1 admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:27:41.365277 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118beaa2-39b0-41c6-80be-d3484426fd1e admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:27:41.372021 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffc3729-6cfc-44af-8822-5ec34b95dd62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:27:41.373113 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffc3729-6cfc-44af-8822-5ec34b95dd62 admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:27:41.373597 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffc3729-6cfc-44af-8822-5ec34b95dd62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:27:41.373882 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffc3729-6cfc-44af-8822-5ec34b95dd62 admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:27:41.374725 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffc3729-6cfc-44af-8822-5ec34b95dd62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:27:41.376673 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffc3729-6cfc-44af-8822-5ec34b95dd62 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:27:41.387394 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3587b9-7560-493d-97a2-513ebab0effa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0454aa03fa31487ea1464b9d0008212c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:27:41.391083 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3587b9-7560-493d-97a2-513ebab0effa service swift] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:27:41.391217 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1197/2374] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:27:41 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:27:41.391341 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3587b9-7560-493d-97a2-513ebab0effa service swift] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:27:41.391341 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3587b9-7560-493d-97a2-513ebab0effa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:27:41.392289 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffc3729-6cfc-44af-8822-5ec34b95dd62 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:27:41.402699 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffc3729-6cfc-44af-8822-5ec34b95dd62 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:27:41.407262 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c13e8c-16fc-422b-97a9-ed2c2bfe91d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:27:41.408285 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c13e8c-16fc-422b-97a9-ed2c2bfe91d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:27:41.408647 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c13e8c-16fc-422b-97a9-ed2c2bfe91d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:27:41.408938 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c13e8c-16fc-422b-97a9-ed2c2bfe91d2 admin admin] PATH_INFO: `/v3/projects/18aa510fd53b4bbd8988fff927aa3ff6/users/fa3588ae15a14be1abaf1e13b2bc72db/roles/634ba284303b4626b5a0402772c68f5c` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:27:41.410911 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c13e8c-16fc-422b-97a9-ed2c2bfe91d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18aa510fd53b4bbd8988fff927aa3ff6, user_id=fa3588ae15a14be1abaf1e13b2bc72db, role_id=634ba284303b4626b5a0402772c68f5c)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:27:41.413581 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c13e8c-16fc-422b-97a9-ed2c2bfe91d2 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:27:41.424703 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1198/2375] 10.222.0.70 () {60 vars in 1482 bytes} [Tue May 10 19:27:41 2022] PUT /identity/v3/projects/18aa510fd53b4bbd8988fff927aa3ff6/users/fa3588ae15a14be1abaf1e13b2bc72db/roles/634ba284303b4626b5a0402772c68f5c => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 19:27:41.437095 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40e25f4-8d10-42d6-a8c9-07cec6e2102d None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:27:41.437383 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40e25f4-8d10-42d6-a8c9-07cec6e2102d None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:27:41.437657 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40e25f4-8d10-42d6-a8c9-07cec6e2102d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:27:41.447822 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3587b9-7560-493d-97a2-513ebab0effa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:27:41.449487 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3587b9-7560-493d-97a2-513ebab0effa service swift] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:27:41.457420 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1178/2376] 10.222.0.70 () {60 vars in 1384 bytes} [Tue May 10 19:27:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 10 19:27:41.465133 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-b40e25f4-8d10-42d6-a8c9-07cec6e2102d None None] MFA Rules not processed for user `fa3588ae15a14be1abaf1e13b2bc72db`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:27:41.466336 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-b40e25f4-8d10-42d6-a8c9-07cec6e2102d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:27:41.554717 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1199/2377] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:27:41 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:27:41.568349 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3587b9-7560-493d-97a2-513ebab0effa service swift] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:27:41.570841 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-0e3587b9-7560-493d-97a2-513ebab0effa service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:27:41.656314 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3587b9-7560-493d-97a2-513ebab0effa service swift] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:27:41.726780 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e9ec88-caeb-4f04-ade4-608343218c01 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15df2a8967aa43299c10e365f4200d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:27:41.727728 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e9ec88-caeb-4f04-ade4-608343218c01 service cinder] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:27:41.728174 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e9ec88-caeb-4f04-ade4-608343218c01 service cinder] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:27:41.728753 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e9ec88-caeb-4f04-ade4-608343218c01 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:27:41.743460 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e9ec88-caeb-4f04-ade4-608343218c01 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:27:41.745228 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e9ec88-caeb-4f04-ade4-608343218c01 service cinder] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:27:41.755134 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1179/2378] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:27:41 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:27:41.809557 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40e25f4-8d10-42d6-a8c9-07cec6e2102d None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:27:41.811149 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-b40e25f4-8d10-42d6-a8c9-07cec6e2102d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:27:41.824041 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40e25f4-8d10-42d6-a8c9-07cec6e2102d None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:27:41.828065 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f78c5a9-12d7-4027-a743-edefa8f0feb8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15df2a8967aa43299c10e365f4200d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:27:41.828825 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f78c5a9-12d7-4027-a743-edefa8f0feb8 service cinder] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:27:41.829176 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f78c5a9-12d7-4027-a743-edefa8f0feb8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:27:41.829518 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f78c5a9-12d7-4027-a743-edefa8f0feb8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:27:41.904382 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f78c5a9-12d7-4027-a743-edefa8f0feb8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:27:41.906753 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f78c5a9-12d7-4027-a743-edefa8f0feb8 service cinder] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:27:41.916365 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1200/2379] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:27:41 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:27:45.708030 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e9ec88-caeb-4f04-ade4-608343218c01 service cinder] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:27:45.809494 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e9ec88-caeb-4f04-ade4-608343218c01 service cinder] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:27:45.814879 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a337b3-f3e9-445c-8919-38a95d0e647e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:27:45.815834 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a337b3-f3e9-445c-8919-38a95d0e647e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:27:45.816176 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a337b3-f3e9-445c-8919-38a95d0e647e admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:27:45.816599 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a337b3-f3e9-445c-8919-38a95d0e647e admin admin] PATH_INFO: `/v3/users/262eaa9a576f4414adefda15bc9c79e2` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:27:45.818238 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a337b3-f3e9-445c-8919-38a95d0e647e admin admin] RBAC: Authorizing `identity:delete_user(user_id=262eaa9a576f4414adefda15bc9c79e2)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:27:45.820695 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a337b3-f3e9-445c-8919-38a95d0e647e admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:27:45.936620 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-35a337b3-f3e9-445c-8919-38a95d0e647e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '262eaa9a576f4414adefda15bc9c79e2'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:27:45.996455 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-35a337b3-f3e9-445c-8919-38a95d0e647e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '262eaa9a576f4414adefda15bc9c79e2'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:27:46.012338 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-35a337b3-f3e9-445c-8919-38a95d0e647e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '262eaa9a576f4414adefda15bc9c79e2'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:27:46.013343 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-35a337b3-f3e9-445c-8919-38a95d0e647e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '262eaa9a576f4414adefda15bc9c79e2'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:27:46.027345 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-35a337b3-f3e9-445c-8919-38a95d0e647e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '262eaa9a576f4414adefda15bc9c79e2'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:27:46.035949 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1180/2380] 10.222.0.70 () {58 vars in 1223 bytes} [Tue May 10 19:27:45 2022] DELETE /identity/v3/users/262eaa9a576f4414adefda15bc9c79e2 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:27:46.042330 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2101b12-a965-4e0d-92b6-0f90463fa7f8 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:27:46.043438 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2101b12-a965-4e0d-92b6-0f90463fa7f8 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:27:46.044247 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2101b12-a965-4e0d-92b6-0f90463fa7f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:27:46.091098 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-b2101b12-a965-4e0d-92b6-0f90463fa7f8 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:27:46.092514 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-b2101b12-a965-4e0d-92b6-0f90463fa7f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:27:46.199283 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1201/2381] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:27:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:27:46.209134 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a337b3-f3e9-445c-8919-38a95d0e647e admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:27:46.210534 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-35a337b3-f3e9-445c-8919-38a95d0e647e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:27:46.314283 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a337b3-f3e9-445c-8919-38a95d0e647e admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:27:46.320373 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edda272d-d0d7-49ab-b7c7-d6c2e461c888 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f1dc79540b48c0866478cc48cd8205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:27:46.323437 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edda272d-d0d7-49ab-b7c7-d6c2e461c888 service neutron] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:27:46.324223 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edda272d-d0d7-49ab-b7c7-d6c2e461c888 service neutron] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:27:46.324502 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edda272d-d0d7-49ab-b7c7-d6c2e461c888 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:27:46.344371 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edda272d-d0d7-49ab-b7c7-d6c2e461c888 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:27:46.346407 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edda272d-d0d7-49ab-b7c7-d6c2e461c888 service neutron] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:27:46.357539 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1181/2382] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:27:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:27:46.811493 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2101b12-a965-4e0d-92b6-0f90463fa7f8 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:27:46.813373 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-b2101b12-a965-4e0d-92b6-0f90463fa7f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:27:46.869719 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2101b12-a965-4e0d-92b6-0f90463fa7f8 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:27:46.877359 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6235b0ec-d632-42ba-b7d2-e0fa712f6a3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:27:46.877359 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6235b0ec-d632-42ba-b7d2-e0fa712f6a3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:27:46.877802 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6235b0ec-d632-42ba-b7d2-e0fa712f6a3a admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:27:46.878027 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6235b0ec-d632-42ba-b7d2-e0fa712f6a3a admin admin] PATH_INFO: `/v3/projects/fc81d6b1c9d74f3895cc6285d116b7fa` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:27:46.879280 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6235b0ec-d632-42ba-b7d2-e0fa712f6a3a admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc81d6b1c9d74f3895cc6285d116b7fa)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:27:46.881384 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6235b0ec-d632-42ba-b7d2-e0fa712f6a3a admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:27:46.960159 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-6235b0ec-d632-42ba-b7d2-e0fa712f6a3a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc81d6b1c9d74f3895cc6285d116b7fa', 'request_id': 'req-6235b0ec-d632-42ba-b7d2-e0fa712f6a3a'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:27:46.968290 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-6235b0ec-d632-42ba-b7d2-e0fa712f6a3a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc81d6b1c9d74f3895cc6285d116b7fa', 'request_id': 'req-6235b0ec-d632-42ba-b7d2-e0fa712f6a3a'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:27:46.990610 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-6235b0ec-d632-42ba-b7d2-e0fa712f6a3a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc81d6b1c9d74f3895cc6285d116b7fa', 'request_id': 'req-6235b0ec-d632-42ba-b7d2-e0fa712f6a3a'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:27:47.012200 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-6235b0ec-d632-42ba-b7d2-e0fa712f6a3a admin admin] The token cache is being invalidate because project fc81d6b1c9d74f3895cc6285d116b7fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79994) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:27:47.012597 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-6235b0ec-d632-42ba-b7d2-e0fa712f6a3a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:27:47.013330 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-6235b0ec-d632-42ba-b7d2-e0fa712f6a3a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:27:47.017974 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1202/2383] 10.222.0.70 () {58 vars in 1232 bytes} [Tue May 10 19:27:46 2022] DELETE /identity/v3/projects/fc81d6b1c9d74f3895cc6285d116b7fa => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:27:47.019210 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edda272d-d0d7-49ab-b7c7-d6c2e461c888 service neutron] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:27:47.039285 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edda272d-d0d7-49ab-b7c7-d6c2e461c888 service neutron] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:27:47.140162 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a55bb6-ed11-449e-9bf8-509333cc3dbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:27:47.141003 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a55bb6-ed11-449e-9bf8-509333cc3dbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:27:47.141282 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a55bb6-ed11-449e-9bf8-509333cc3dbd admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:27:47.141556 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a55bb6-ed11-449e-9bf8-509333cc3dbd admin admin] PATH_INFO: `/v3/users/fa3588ae15a14be1abaf1e13b2bc72db` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:27:47.142870 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a55bb6-ed11-449e-9bf8-509333cc3dbd admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa3588ae15a14be1abaf1e13b2bc72db)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:27:47.144975 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a55bb6-ed11-449e-9bf8-509333cc3dbd admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:27:47.208458 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-c9a55bb6-ed11-449e-9bf8-509333cc3dbd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa3588ae15a14be1abaf1e13b2bc72db'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:27:47.226222 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-c9a55bb6-ed11-449e-9bf8-509333cc3dbd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa3588ae15a14be1abaf1e13b2bc72db'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:27:47.234746 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-c9a55bb6-ed11-449e-9bf8-509333cc3dbd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa3588ae15a14be1abaf1e13b2bc72db'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:27:47.235482 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-c9a55bb6-ed11-449e-9bf8-509333cc3dbd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa3588ae15a14be1abaf1e13b2bc72db'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:27:47.245238 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-c9a55bb6-ed11-449e-9bf8-509333cc3dbd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa3588ae15a14be1abaf1e13b2bc72db'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:27:47.268312 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1182/2384] 10.222.0.70 () {58 vars in 1223 bytes} [Tue May 10 19:27:47 2022] DELETE /identity/v3/users/fa3588ae15a14be1abaf1e13b2bc72db => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:27:47.895490 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6235b0ec-d632-42ba-b7d2-e0fa712f6a3a admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:27:47.897118 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-6235b0ec-d632-42ba-b7d2-e0fa712f6a3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:27:47.918723 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6235b0ec-d632-42ba-b7d2-e0fa712f6a3a admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:27:48.022792 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4aebc3-9478-4363-9008-2a09c5c343e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:27:48.024384 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4aebc3-9478-4363-9008-2a09c5c343e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:27:48.024703 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4aebc3-9478-4363-9008-2a09c5c343e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:27:48.024957 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4aebc3-9478-4363-9008-2a09c5c343e8 admin admin] PATH_INFO: `/v3/projects/18aa510fd53b4bbd8988fff927aa3ff6` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:27:48.026193 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4aebc3-9478-4363-9008-2a09c5c343e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=18aa510fd53b4bbd8988fff927aa3ff6)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:27:48.028126 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4aebc3-9478-4363-9008-2a09c5c343e8 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:27:48.106242 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-5f4aebc3-9478-4363-9008-2a09c5c343e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18aa510fd53b4bbd8988fff927aa3ff6', 'request_id': 'req-5f4aebc3-9478-4363-9008-2a09c5c343e8'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:27:48.121384 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-5f4aebc3-9478-4363-9008-2a09c5c343e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18aa510fd53b4bbd8988fff927aa3ff6', 'request_id': 'req-5f4aebc3-9478-4363-9008-2a09c5c343e8'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:27:48.135976 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-5f4aebc3-9478-4363-9008-2a09c5c343e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18aa510fd53b4bbd8988fff927aa3ff6', 'request_id': 'req-5f4aebc3-9478-4363-9008-2a09c5c343e8'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:27:48.162313 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-5f4aebc3-9478-4363-9008-2a09c5c343e8 admin admin] The token cache is being invalidate because project 18aa510fd53b4bbd8988fff927aa3ff6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79994) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:27:48.164698 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-5f4aebc3-9478-4363-9008-2a09c5c343e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:27:48.165483 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-5f4aebc3-9478-4363-9008-2a09c5c343e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:27:48.168406 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1203/2385] 10.222.0.70 () {58 vars in 1232 bytes} [Tue May 10 19:27:47 2022] DELETE /identity/v3/projects/18aa510fd53b4bbd8988fff927aa3ff6 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:27:48.173301 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3c13e5-950e-41f3-8a35-be930112aa3c None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:27:48.173805 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3c13e5-950e-41f3-8a35-be930112aa3c None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:27:48.174277 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3c13e5-950e-41f3-8a35-be930112aa3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:27:48.197370 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-6e3c13e5-950e-41f3-8a35-be930112aa3c None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:27:48.199402 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-6e3c13e5-950e-41f3-8a35-be930112aa3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:27:48.291431 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1183/2386] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:27:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:27:48.299196 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c439005-3069-4c05-84aa-af4d32cebd3a None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:27:48.299749 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c439005-3069-4c05-84aa-af4d32cebd3a None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:27:48.300227 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c439005-3069-4c05-84aa-af4d32cebd3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:27:48.330085 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-1c439005-3069-4c05-84aa-af4d32cebd3a None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:27:48.331401 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-1c439005-3069-4c05-84aa-af4d32cebd3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:27:48.342078 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1204/2387] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:27:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:27:48.344099 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3c13e5-950e-41f3-8a35-be930112aa3c None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:27:48.354477 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3c13e5-950e-41f3-8a35-be930112aa3c None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:27:48.359425 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440e5bf0-3f5b-4cae-86d8-4d806b29f1b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:27:48.360201 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440e5bf0-3f5b-4cae-86d8-4d806b29f1b4 admin admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:27:48.360737 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440e5bf0-3f5b-4cae-86d8-4d806b29f1b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:27:48.361232 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440e5bf0-3f5b-4cae-86d8-4d806b29f1b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:27:48.362147 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440e5bf0-3f5b-4cae-86d8-4d806b29f1b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:27:48.362628 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440e5bf0-3f5b-4cae-86d8-4d806b29f1b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:27:48.364502 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440e5bf0-3f5b-4cae-86d8-4d806b29f1b4 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:27:48.378681 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1184/2388] 10.222.0.70 () {58 vars in 1152 bytes} [Tue May 10 19:27:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:27:48.382771 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c439005-3069-4c05-84aa-af4d32cebd3a None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:27:48.397696 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c439005-3069-4c05-84aa-af4d32cebd3a None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:27:48.408080 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b182c0c-4b9e-45e1-95a2-c98872be49d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:27:48.418594 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b182c0c-4b9e-45e1-95a2-c98872be49d9 admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:27:48.419595 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b182c0c-4b9e-45e1-95a2-c98872be49d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:27:48.420052 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b182c0c-4b9e-45e1-95a2-c98872be49d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:27:48.421047 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b182c0c-4b9e-45e1-95a2-c98872be49d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:27:48.424528 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b182c0c-4b9e-45e1-95a2-c98872be49d9 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:27:48.476924 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1205/2389] 10.222.0.70 () {60 vars in 1152 bytes} [Tue May 10 19:27:48 2022] POST /identity/v3/projects => generated 379 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:27:48.483117 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440e5bf0-3f5b-4cae-86d8-4d806b29f1b4 admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:27:48.502018 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440e5bf0-3f5b-4cae-86d8-4d806b29f1b4 admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:27:48.590829 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f473fafe-fae7-4fdf-a12a-be5b750ef453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:27:48.592741 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f473fafe-fae7-4fdf-a12a-be5b750ef453 admin admin] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:27:48.593029 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f473fafe-fae7-4fdf-a12a-be5b750ef453 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:27:48.593307 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f473fafe-fae7-4fdf-a12a-be5b750ef453 admin admin] PATH_INFO: `/v3/users` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:27:48.594008 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f473fafe-fae7-4fdf-a12a-be5b750ef453 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:27:48.596369 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f473fafe-fae7-4fdf-a12a-be5b750ef453 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:27:48.639138 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1185/2390] 10.222.0.70 () {60 vars in 1143 bytes} [Tue May 10 19:27:48 2022] POST /identity/v3/users => generated 290 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:27:48.639932 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b182c0c-4b9e-45e1-95a2-c98872be49d9 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:27:48.655036 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b182c0c-4b9e-45e1-95a2-c98872be49d9 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:27:48.672187 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cabb79-728c-4dc5-946f-e6075dabe49b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:27:48.673124 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cabb79-728c-4dc5-946f-e6075dabe49b admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:27:48.673515 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cabb79-728c-4dc5-946f-e6075dabe49b admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:27:48.673894 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cabb79-728c-4dc5-946f-e6075dabe49b admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:27:48.675125 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cabb79-728c-4dc5-946f-e6075dabe49b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:27:48.676454 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cabb79-728c-4dc5-946f-e6075dabe49b admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:27:48.700739 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1206/2391] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:27:48 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 19:27:48.705747 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f473fafe-fae7-4fdf-a12a-be5b750ef453 admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:27:48.729395 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f473fafe-fae7-4fdf-a12a-be5b750ef453 admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:27:48.734403 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ba6b2c-c03c-4404-8969-72f73233c78e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:27:48.735025 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ba6b2c-c03c-4404-8969-72f73233c78e admin admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:27:48.735311 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ba6b2c-c03c-4404-8969-72f73233c78e admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:27:48.735587 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ba6b2c-c03c-4404-8969-72f73233c78e admin admin] PATH_INFO: `/v3/roles` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:27:48.736311 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ba6b2c-c03c-4404-8969-72f73233c78e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:27:48.738102 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ba6b2c-c03c-4404-8969-72f73233c78e admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:27:48.754547 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1186/2392] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:27:48 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:27:48.759159 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cabb79-728c-4dc5-946f-e6075dabe49b admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:27:48.779053 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cabb79-728c-4dc5-946f-e6075dabe49b admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:27:48.793358 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700e76ac-9482-4911-9712-781f5bce2145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:27:48.794408 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700e76ac-9482-4911-9712-781f5bce2145 admin admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:27:48.795009 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700e76ac-9482-4911-9712-781f5bce2145 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:27:48.795009 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700e76ac-9482-4911-9712-781f5bce2145 admin admin] PATH_INFO: `/v3/projects/5aace0ea4f984ce58d2f304271879b33/users/2edc47decdc64faaa3b0a90245e8380f/roles/5c07cf5bfbd3427db18428aa50420962` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:27:48.832622 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700e76ac-9482-4911-9712-781f5bce2145 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5aace0ea4f984ce58d2f304271879b33, user_id=2edc47decdc64faaa3b0a90245e8380f, role_id=5c07cf5bfbd3427db18428aa50420962)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:27:48.839597 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700e76ac-9482-4911-9712-781f5bce2145 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:27:48.861637 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1207/2393] 10.222.0.70 () {60 vars in 1482 bytes} [Tue May 10 19:27:48 2022] PUT /identity/v3/projects/5aace0ea4f984ce58d2f304271879b33/users/2edc47decdc64faaa3b0a90245e8380f/roles/5c07cf5bfbd3427db18428aa50420962 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:27:48.877727 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d1a028-b8c0-4b48-ab48-def468e0a82a None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:27:48.879464 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d1a028-b8c0-4b48-ab48-def468e0a82a None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:27:48.880333 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d1a028-b8c0-4b48-ab48-def468e0a82a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:27:48.926059 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-33d1a028-b8c0-4b48-ab48-def468e0a82a None None] MFA Rules not processed for user `2edc47decdc64faaa3b0a90245e8380f`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:27:48.927435 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-33d1a028-b8c0-4b48-ab48-def468e0a82a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:27:49.044839 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1187/2394] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:27:48 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:27:49.049707 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700e76ac-9482-4911-9712-781f5bce2145 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:27:49.125748 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700e76ac-9482-4911-9712-781f5bce2145 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:27:49.131554 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eccb47-2534-4c3a-86d0-9d891b074ea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:27:49.132235 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eccb47-2534-4c3a-86d0-9d891b074ea3 admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:27:49.132560 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eccb47-2534-4c3a-86d0-9d891b074ea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:27:49.132831 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eccb47-2534-4c3a-86d0-9d891b074ea3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:27:49.134103 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93eccb47-2534-4c3a-86d0-9d891b074ea3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:27:49.135997 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93eccb47-2534-4c3a-86d0-9d891b074ea3 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:27:49.176234 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1208/2395] 10.222.0.70 () {60 vars in 1152 bytes} [Tue May 10 19:27:49 2022] POST /identity/v3/projects => generated 381 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:27:49.177448 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d1a028-b8c0-4b48-ab48-def468e0a82a None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:27:49.189600 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d1a028-b8c0-4b48-ab48-def468e0a82a None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:27:49.260509 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361c2619-a4b9-4f5c-b529-d5df258ceeab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:27:49.261868 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361c2619-a4b9-4f5c-b529-d5df258ceeab admin admin] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:27:49.262366 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361c2619-a4b9-4f5c-b529-d5df258ceeab admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:27:49.263331 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361c2619-a4b9-4f5c-b529-d5df258ceeab admin admin] PATH_INFO: `/v3/users` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:27:49.264266 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361c2619-a4b9-4f5c-b529-d5df258ceeab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:27:49.266764 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361c2619-a4b9-4f5c-b529-d5df258ceeab admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:27:49.296320 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1188/2396] 10.222.0.70 () {60 vars in 1143 bytes} [Tue May 10 19:27:49 2022] POST /identity/v3/users => generated 297 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 19:27:49.297518 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eccb47-2534-4c3a-86d0-9d891b074ea3 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:27:49.311651 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eccb47-2534-4c3a-86d0-9d891b074ea3 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:27:49.324589 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60482195-7015-4570-a3f5-76cb0e7fb211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:27:49.325332 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60482195-7015-4570-a3f5-76cb0e7fb211 admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:27:49.325551 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60482195-7015-4570-a3f5-76cb0e7fb211 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:27:49.325830 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60482195-7015-4570-a3f5-76cb0e7fb211 admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:27:49.326575 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60482195-7015-4570-a3f5-76cb0e7fb211 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:27:49.328275 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60482195-7015-4570-a3f5-76cb0e7fb211 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:27:49.346720 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1209/2397] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:27:49 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:27:49.348279 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361c2619-a4b9-4f5c-b529-d5df258ceeab admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:27:49.363902 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361c2619-a4b9-4f5c-b529-d5df258ceeab admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:27:49.376823 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbfa2d5-a861-40a6-a011-2d7da043eb45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:27:49.377563 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbfa2d5-a861-40a6-a011-2d7da043eb45 admin admin] REQUEST_METHOD: `PUT` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:27:49.377852 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbfa2d5-a861-40a6-a011-2d7da043eb45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:27:49.378129 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbfa2d5-a861-40a6-a011-2d7da043eb45 admin admin] PATH_INFO: `/v3/projects/36b9260b8a3241c9b036d57d13620346/users/5ad999fdaaa64ff58005679f926c81bd/roles/634ba284303b4626b5a0402772c68f5c` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:27:49.407207 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbfa2d5-a861-40a6-a011-2d7da043eb45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36b9260b8a3241c9b036d57d13620346, user_id=5ad999fdaaa64ff58005679f926c81bd, role_id=634ba284303b4626b5a0402772c68f5c)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:27:49.411437 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbfa2d5-a861-40a6-a011-2d7da043eb45 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:27:49.433495 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1189/2398] 10.222.0.70 () {60 vars in 1482 bytes} [Tue May 10 19:27:49 2022] PUT /identity/v3/projects/36b9260b8a3241c9b036d57d13620346/users/5ad999fdaaa64ff58005679f926c81bd/roles/634ba284303b4626b5a0402772c68f5c => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 19:27:49.437601 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60482195-7015-4570-a3f5-76cb0e7fb211 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:27:49.448547 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60482195-7015-4570-a3f5-76cb0e7fb211 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:27:49.548237 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64a6e0a-3e8b-45d2-946a-724f3a9abbe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:27:49.550210 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64a6e0a-3e8b-45d2-946a-724f3a9abbe1 admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:27:49.550659 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64a6e0a-3e8b-45d2-946a-724f3a9abbe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:27:49.551178 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64a6e0a-3e8b-45d2-946a-724f3a9abbe1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:27:49.552095 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64a6e0a-3e8b-45d2-946a-724f3a9abbe1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:27:49.553884 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64a6e0a-3e8b-45d2-946a-724f3a9abbe1 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:27:49.565752 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1210/2399] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:27:49 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:27:49.569739 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbfa2d5-a861-40a6-a011-2d7da043eb45 admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:27:49.584181 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbfa2d5-a861-40a6-a011-2d7da043eb45 admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:27:49.589737 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278d92c6-63ae-48d1-9e81-5beebcc37912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:27:49.590879 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278d92c6-63ae-48d1-9e81-5beebcc37912 admin admin] REQUEST_METHOD: `PUT` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:27:49.591464 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278d92c6-63ae-48d1-9e81-5beebcc37912 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:27:49.591910 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278d92c6-63ae-48d1-9e81-5beebcc37912 admin admin] PATH_INFO: `/v3/projects/36b9260b8a3241c9b036d57d13620346/users/5ad999fdaaa64ff58005679f926c81bd/roles/634ba284303b4626b5a0402772c68f5c` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:27:49.594171 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278d92c6-63ae-48d1-9e81-5beebcc37912 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36b9260b8a3241c9b036d57d13620346, user_id=5ad999fdaaa64ff58005679f926c81bd, role_id=634ba284303b4626b5a0402772c68f5c)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:27:49.597038 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278d92c6-63ae-48d1-9e81-5beebcc37912 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:27:49.613073 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1190/2400] 10.222.0.70 () {60 vars in 1482 bytes} [Tue May 10 19:27:49 2022] PUT /identity/v3/projects/36b9260b8a3241c9b036d57d13620346/users/5ad999fdaaa64ff58005679f926c81bd/roles/634ba284303b4626b5a0402772c68f5c => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:27:49.625542 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897d5cb4-d814-456e-b03d-a44a4dc06699 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:27:49.626458 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897d5cb4-d814-456e-b03d-a44a4dc06699 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:27:49.626820 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897d5cb4-d814-456e-b03d-a44a4dc06699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:27:49.683499 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-897d5cb4-d814-456e-b03d-a44a4dc06699 None None] MFA Rules not processed for user `5ad999fdaaa64ff58005679f926c81bd`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:27:49.685127 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-897d5cb4-d814-456e-b03d-a44a4dc06699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:27:49.782893 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1211/2401] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:27:49 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:27:49.797039 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278d92c6-63ae-48d1-9e81-5beebcc37912 admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:27:49.799102 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-278d92c6-63ae-48d1-9e81-5beebcc37912 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:27:49.886384 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278d92c6-63ae-48d1-9e81-5beebcc37912 admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:27:49.890432 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035c67fa-68f1-493c-ab45-ab9f20828d53 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15df2a8967aa43299c10e365f4200d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:27:49.891256 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035c67fa-68f1-493c-ab45-ab9f20828d53 service cinder] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:27:49.891703 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035c67fa-68f1-493c-ab45-ab9f20828d53 service cinder] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:27:49.892166 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035c67fa-68f1-493c-ab45-ab9f20828d53 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:27:49.905920 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035c67fa-68f1-493c-ab45-ab9f20828d53 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:27:49.907768 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035c67fa-68f1-493c-ab45-ab9f20828d53 service cinder] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:27:49.942595 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1191/2402] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:27:49 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:27:50.478910 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897d5cb4-d814-456e-b03d-a44a4dc06699 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:27:50.495380 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897d5cb4-d814-456e-b03d-a44a4dc06699 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:27:50.504311 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc365cff-819e-4b0d-87c0-8c48cc725c84 tempest-VolumeQuotaClassesTest-1652950853 tempest-VolumeQuotaClassesTest-1652950853-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ad999fdaaa64ff58005679f926c81bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36b9260b8a3241c9b036d57d13620346', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:27:50.505900 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc365cff-819e-4b0d-87c0-8c48cc725c84 tempest-VolumeQuotaClassesTest-1652950853 tempest-VolumeQuotaClassesTest-1652950853-project-admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:27:50.506282 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc365cff-819e-4b0d-87c0-8c48cc725c84 tempest-VolumeQuotaClassesTest-1652950853 tempest-VolumeQuotaClassesTest-1652950853-project-admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:27:50.506795 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc365cff-819e-4b0d-87c0-8c48cc725c84 tempest-VolumeQuotaClassesTest-1652950853 tempest-VolumeQuotaClassesTest-1652950853-project-admin] PATH_INFO: `/v3/domains` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:27:50.508618 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc365cff-819e-4b0d-87c0-8c48cc725c84 tempest-VolumeQuotaClassesTest-1652950853 tempest-VolumeQuotaClassesTest-1652950853-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:27:50.509154 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc365cff-819e-4b0d-87c0-8c48cc725c84 tempest-VolumeQuotaClassesTest-1652950853 tempest-VolumeQuotaClassesTest-1652950853-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:27:50.511577 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc365cff-819e-4b0d-87c0-8c48cc725c84 tempest-VolumeQuotaClassesTest-1652950853 tempest-VolumeQuotaClassesTest-1652950853-project-admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:27:50.534491 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1212/2403] 10.222.0.70 () {58 vars in 1152 bytes} [Tue May 10 19:27:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:27:50.538470 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035c67fa-68f1-493c-ab45-ab9f20828d53 service cinder] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:27:50.555921 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035c67fa-68f1-493c-ab45-ab9f20828d53 service cinder] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:27:50.571196 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cddc245-a593-4a55-a742-ccf10f2e6f47 tempest-VolumeQuotaClassesTest-1652950853 tempest-VolumeQuotaClassesTest-1652950853-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ad999fdaaa64ff58005679f926c81bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36b9260b8a3241c9b036d57d13620346', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:27:50.572274 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cddc245-a593-4a55-a742-ccf10f2e6f47 tempest-VolumeQuotaClassesTest-1652950853 tempest-VolumeQuotaClassesTest-1652950853-project-admin] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:27:50.573198 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cddc245-a593-4a55-a742-ccf10f2e6f47 tempest-VolumeQuotaClassesTest-1652950853 tempest-VolumeQuotaClassesTest-1652950853-project-admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:27:50.573715 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cddc245-a593-4a55-a742-ccf10f2e6f47 tempest-VolumeQuotaClassesTest-1652950853 tempest-VolumeQuotaClassesTest-1652950853-project-admin] PATH_INFO: `/v3/projects` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:27:50.574760 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cddc245-a593-4a55-a742-ccf10f2e6f47 tempest-VolumeQuotaClassesTest-1652950853 tempest-VolumeQuotaClassesTest-1652950853-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:27:50.576969 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cddc245-a593-4a55-a742-ccf10f2e6f47 tempest-VolumeQuotaClassesTest-1652950853 tempest-VolumeQuotaClassesTest-1652950853-project-admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:27:50.616875 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1192/2404] 10.222.0.70 () {60 vars in 1152 bytes} [Tue May 10 19:27:50 2022] POST /identity/v3/projects => generated 354 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:27:50.622106 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc365cff-819e-4b0d-87c0-8c48cc725c84 tempest-VolumeQuotaClassesTest-1652950853 tempest-VolumeQuotaClassesTest-1652950853-project-admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:27:50.667923 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc365cff-819e-4b0d-87c0-8c48cc725c84 tempest-VolumeQuotaClassesTest-1652950853 tempest-VolumeQuotaClassesTest-1652950853-project-admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:27:50.798347 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaa0217-8283-4b2a-b028-c288313e2360 tempest-VolumeQuotaClassesTest-1652950853 tempest-VolumeQuotaClassesTest-1652950853-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ad999fdaaa64ff58005679f926c81bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36b9260b8a3241c9b036d57d13620346', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:27:50.799048 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaa0217-8283-4b2a-b028-c288313e2360 tempest-VolumeQuotaClassesTest-1652950853 tempest-VolumeQuotaClassesTest-1652950853-project-admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:27:50.799331 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaa0217-8283-4b2a-b028-c288313e2360 tempest-VolumeQuotaClassesTest-1652950853 tempest-VolumeQuotaClassesTest-1652950853-project-admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:27:50.799612 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaa0217-8283-4b2a-b028-c288313e2360 tempest-VolumeQuotaClassesTest-1652950853 tempest-VolumeQuotaClassesTest-1652950853-project-admin] PATH_INFO: `/v3/domains` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:27:50.804577 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaa0217-8283-4b2a-b028-c288313e2360 tempest-VolumeQuotaClassesTest-1652950853 tempest-VolumeQuotaClassesTest-1652950853-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:27:50.804961 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaa0217-8283-4b2a-b028-c288313e2360 tempest-VolumeQuotaClassesTest-1652950853 tempest-VolumeQuotaClassesTest-1652950853-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:27:50.807104 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaa0217-8283-4b2a-b028-c288313e2360 tempest-VolumeQuotaClassesTest-1652950853 tempest-VolumeQuotaClassesTest-1652950853-project-admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:27:50.826592 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1213/2405] 10.222.0.70 () {58 vars in 1152 bytes} [Tue May 10 19:27:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:27:50.882375 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cddc245-a593-4a55-a742-ccf10f2e6f47 tempest-VolumeQuotaClassesTest-1652950853 tempest-VolumeQuotaClassesTest-1652950853-project-admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:27:50.895828 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cddc245-a593-4a55-a742-ccf10f2e6f47 tempest-VolumeQuotaClassesTest-1652950853 tempest-VolumeQuotaClassesTest-1652950853-project-admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:27:50.919660 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84575222-45a4-4033-9e3d-2a07584de000 tempest-VolumeQuotaClassesTest-1652950853 tempest-VolumeQuotaClassesTest-1652950853-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ad999fdaaa64ff58005679f926c81bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36b9260b8a3241c9b036d57d13620346', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:27:50.921236 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84575222-45a4-4033-9e3d-2a07584de000 tempest-VolumeQuotaClassesTest-1652950853 tempest-VolumeQuotaClassesTest-1652950853-project-admin] REQUEST_METHOD: `DELETE` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:27:50.921750 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84575222-45a4-4033-9e3d-2a07584de000 tempest-VolumeQuotaClassesTest-1652950853 tempest-VolumeQuotaClassesTest-1652950853-project-admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:27:50.922196 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84575222-45a4-4033-9e3d-2a07584de000 tempest-VolumeQuotaClassesTest-1652950853 tempest-VolumeQuotaClassesTest-1652950853-project-admin] PATH_INFO: `/v3/projects/e815b3b3b7e149939e000e97a8666971` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:27:50.923776 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84575222-45a4-4033-9e3d-2a07584de000 tempest-VolumeQuotaClassesTest-1652950853 tempest-VolumeQuotaClassesTest-1652950853-project-admin] RBAC: Authorizing `identity:delete_project(project_id=e815b3b3b7e149939e000e97a8666971)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:27:50.925906 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84575222-45a4-4033-9e3d-2a07584de000 tempest-VolumeQuotaClassesTest-1652950853 tempest-VolumeQuotaClassesTest-1652950853-project-admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:27:51.029027 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-84575222-45a4-4033-9e3d-2a07584de000 tempest-VolumeQuotaClassesTest-1652950853 tempest-VolumeQuotaClassesTest-1652950853-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e815b3b3b7e149939e000e97a8666971', 'request_id': 'req-84575222-45a4-4033-9e3d-2a07584de000'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:27:51.048163 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-84575222-45a4-4033-9e3d-2a07584de000 tempest-VolumeQuotaClassesTest-1652950853 tempest-VolumeQuotaClassesTest-1652950853-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e815b3b3b7e149939e000e97a8666971', 'request_id': 'req-84575222-45a4-4033-9e3d-2a07584de000'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:27:51.061876 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-84575222-45a4-4033-9e3d-2a07584de000 tempest-VolumeQuotaClassesTest-1652950853 tempest-VolumeQuotaClassesTest-1652950853-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e815b3b3b7e149939e000e97a8666971', 'request_id': 'req-84575222-45a4-4033-9e3d-2a07584de000'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:27:51.079854 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-84575222-45a4-4033-9e3d-2a07584de000 tempest-VolumeQuotaClassesTest-1652950853 tempest-VolumeQuotaClassesTest-1652950853-project-admin] The token cache is being invalidate because project e815b3b3b7e149939e000e97a8666971 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79993) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:27:51.080622 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-84575222-45a4-4033-9e3d-2a07584de000 tempest-VolumeQuotaClassesTest-1652950853 tempest-VolumeQuotaClassesTest-1652950853-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:27:51.081855 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-84575222-45a4-4033-9e3d-2a07584de000 tempest-VolumeQuotaClassesTest-1652950853 tempest-VolumeQuotaClassesTest-1652950853-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:27:51.083716 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1193/2406] 10.222.0.70 () {58 vars in 1232 bytes} [Tue May 10 19:27:50 2022] DELETE /identity/v3/projects/e815b3b3b7e149939e000e97a8666971 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:27:51.480883 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaa0217-8283-4b2a-b028-c288313e2360 tempest-VolumeQuotaClassesTest-1652950853 tempest-VolumeQuotaClassesTest-1652950853-project-admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:27:51.483585 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-6eaa0217-8283-4b2a-b028-c288313e2360 tempest-VolumeQuotaClassesTest-1652950853 tempest-VolumeQuotaClassesTest-1652950853-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:27:51.623026 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaa0217-8283-4b2a-b028-c288313e2360 tempest-VolumeQuotaClassesTest-1652950853 tempest-VolumeQuotaClassesTest-1652950853-project-admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:27:51.746813 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea038c74-404b-4f91-9fa7-ffafe250b81d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:27:51.747894 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea038c74-404b-4f91-9fa7-ffafe250b81d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:27:51.748910 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea038c74-404b-4f91-9fa7-ffafe250b81d admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:27:51.753296 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea038c74-404b-4f91-9fa7-ffafe250b81d admin admin] PATH_INFO: `/v3/users/2edc47decdc64faaa3b0a90245e8380f` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:27:51.755507 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea038c74-404b-4f91-9fa7-ffafe250b81d admin admin] RBAC: Authorizing `identity:delete_user(user_id=2edc47decdc64faaa3b0a90245e8380f)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:27:51.759020 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea038c74-404b-4f91-9fa7-ffafe250b81d admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:27:51.873334 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-ea038c74-404b-4f91-9fa7-ffafe250b81d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2edc47decdc64faaa3b0a90245e8380f'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:27:51.887061 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-ea038c74-404b-4f91-9fa7-ffafe250b81d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2edc47decdc64faaa3b0a90245e8380f'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:27:51.887799 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-ea038c74-404b-4f91-9fa7-ffafe250b81d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2edc47decdc64faaa3b0a90245e8380f'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:27:51.901056 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-ea038c74-404b-4f91-9fa7-ffafe250b81d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2edc47decdc64faaa3b0a90245e8380f'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:27:51.916039 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-ea038c74-404b-4f91-9fa7-ffafe250b81d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2edc47decdc64faaa3b0a90245e8380f'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:27:51.935144 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1214/2407] 10.222.0.70 () {58 vars in 1223 bytes} [Tue May 10 19:27:51 2022] DELETE /identity/v3/users/2edc47decdc64faaa3b0a90245e8380f => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:27:51.939316 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5052637-c4df-41fd-a919-daeb3d895993 None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:27:51.939792 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5052637-c4df-41fd-a919-daeb3d895993 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:27:51.939912 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5052637-c4df-41fd-a919-daeb3d895993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:27:51.968257 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-e5052637-c4df-41fd-a919-daeb3d895993 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:27:51.980737 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-e5052637-c4df-41fd-a919-daeb3d895993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:27:52.098432 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1194/2408] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:27:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:27:52.105668 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea038c74-404b-4f91-9fa7-ffafe250b81d admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:27:52.109101 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-ea038c74-404b-4f91-9fa7-ffafe250b81d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:27:52.219913 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea038c74-404b-4f91-9fa7-ffafe250b81d admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:27:52.223642 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ce2ce1-e342-4545-a94e-69dc7c0bf7ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f1dc79540b48c0866478cc48cd8205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:27:52.224329 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ce2ce1-e342-4545-a94e-69dc7c0bf7ea service neutron] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:27:52.232887 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ce2ce1-e342-4545-a94e-69dc7c0bf7ea service neutron] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:27:52.233263 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ce2ce1-e342-4545-a94e-69dc7c0bf7ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:27:52.272013 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ce2ce1-e342-4545-a94e-69dc7c0bf7ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:27:52.273542 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ce2ce1-e342-4545-a94e-69dc7c0bf7ea service neutron] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:27:52.294701 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1215/2409] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:27:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:27:52.938638 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5052637-c4df-41fd-a919-daeb3d895993 None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:27:52.938638 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-e5052637-c4df-41fd-a919-daeb3d895993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:27:53.043400 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5052637-c4df-41fd-a919-daeb3d895993 None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:27:53.054464 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6f5afe-49a8-4079-8646-b4d317bc0c6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:27:53.055984 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6f5afe-49a8-4079-8646-b4d317bc0c6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:27:53.056266 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6f5afe-49a8-4079-8646-b4d317bc0c6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:27:53.056608 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6f5afe-49a8-4079-8646-b4d317bc0c6b admin admin] PATH_INFO: `/v3/projects/5aace0ea4f984ce58d2f304271879b33` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:27:53.057899 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6f5afe-49a8-4079-8646-b4d317bc0c6b admin admin] RBAC: Authorizing `identity:delete_project(project_id=5aace0ea4f984ce58d2f304271879b33)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:27:53.059956 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6f5afe-49a8-4079-8646-b4d317bc0c6b admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:27:53.151666 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-8c6f5afe-49a8-4079-8646-b4d317bc0c6b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5aace0ea4f984ce58d2f304271879b33', 'request_id': 'req-8c6f5afe-49a8-4079-8646-b4d317bc0c6b'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:27:53.159487 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-8c6f5afe-49a8-4079-8646-b4d317bc0c6b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5aace0ea4f984ce58d2f304271879b33', 'request_id': 'req-8c6f5afe-49a8-4079-8646-b4d317bc0c6b'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:27:53.171194 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-8c6f5afe-49a8-4079-8646-b4d317bc0c6b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5aace0ea4f984ce58d2f304271879b33', 'request_id': 'req-8c6f5afe-49a8-4079-8646-b4d317bc0c6b'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:27:53.190969 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-8c6f5afe-49a8-4079-8646-b4d317bc0c6b admin admin] The token cache is being invalidate because project 5aace0ea4f984ce58d2f304271879b33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79993) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:27:53.191345 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-8c6f5afe-49a8-4079-8646-b4d317bc0c6b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:27:53.192312 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-8c6f5afe-49a8-4079-8646-b4d317bc0c6b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:27:53.197811 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1195/2410] 10.222.0.70 () {58 vars in 1232 bytes} [Tue May 10 19:27:52 2022] DELETE /identity/v3/projects/5aace0ea4f984ce58d2f304271879b33 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:27:53.202263 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ce2ce1-e342-4545-a94e-69dc7c0bf7ea service neutron] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:27:53.218286 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ce2ce1-e342-4545-a94e-69dc7c0bf7ea service neutron] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:27:53.359223 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ef6b1b-203f-4711-a6c3-7abefd2aa745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:27:53.360271 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ef6b1b-203f-4711-a6c3-7abefd2aa745 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:27:53.360607 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ef6b1b-203f-4711-a6c3-7abefd2aa745 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:27:53.360890 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ef6b1b-203f-4711-a6c3-7abefd2aa745 admin admin] PATH_INFO: `/v3/users/5ad999fdaaa64ff58005679f926c81bd` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:27:53.362227 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ef6b1b-203f-4711-a6c3-7abefd2aa745 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ad999fdaaa64ff58005679f926c81bd)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:27:53.364106 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ef6b1b-203f-4711-a6c3-7abefd2aa745 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:27:53.449136 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-97ef6b1b-203f-4711-a6c3-7abefd2aa745 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ad999fdaaa64ff58005679f926c81bd'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:27:53.465049 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-97ef6b1b-203f-4711-a6c3-7abefd2aa745 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ad999fdaaa64ff58005679f926c81bd'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:27:53.465792 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-97ef6b1b-203f-4711-a6c3-7abefd2aa745 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ad999fdaaa64ff58005679f926c81bd'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:27:53.481645 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-97ef6b1b-203f-4711-a6c3-7abefd2aa745 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ad999fdaaa64ff58005679f926c81bd'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:27:53.491116 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-97ef6b1b-203f-4711-a6c3-7abefd2aa745 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ad999fdaaa64ff58005679f926c81bd'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:27:53.515463 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1216/2411] 10.222.0.70 () {58 vars in 1223 bytes} [Tue May 10 19:27:53 2022] DELETE /identity/v3/users/5ad999fdaaa64ff58005679f926c81bd => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:27:54.011169 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6f5afe-49a8-4079-8646-b4d317bc0c6b admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:27:54.013207 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-8c6f5afe-49a8-4079-8646-b4d317bc0c6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:27:54.032599 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6f5afe-49a8-4079-8646-b4d317bc0c6b admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:27:54.124359 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2478780a-ff49-4b44-af0e-e9c6a47c7c62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:27:54.125555 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2478780a-ff49-4b44-af0e-e9c6a47c7c62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:27:54.125918 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2478780a-ff49-4b44-af0e-e9c6a47c7c62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:27:54.126268 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2478780a-ff49-4b44-af0e-e9c6a47c7c62 admin admin] PATH_INFO: `/v3/projects/36b9260b8a3241c9b036d57d13620346` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:27:54.127697 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2478780a-ff49-4b44-af0e-e9c6a47c7c62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=36b9260b8a3241c9b036d57d13620346)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:27:54.129713 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2478780a-ff49-4b44-af0e-e9c6a47c7c62 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:27:54.236688 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-2478780a-ff49-4b44-af0e-e9c6a47c7c62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36b9260b8a3241c9b036d57d13620346', 'request_id': 'req-2478780a-ff49-4b44-af0e-e9c6a47c7c62'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:27:54.236688 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-2478780a-ff49-4b44-af0e-e9c6a47c7c62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36b9260b8a3241c9b036d57d13620346', 'request_id': 'req-2478780a-ff49-4b44-af0e-e9c6a47c7c62'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:27:54.242085 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-2478780a-ff49-4b44-af0e-e9c6a47c7c62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36b9260b8a3241c9b036d57d13620346', 'request_id': 'req-2478780a-ff49-4b44-af0e-e9c6a47c7c62'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:27:54.256708 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-2478780a-ff49-4b44-af0e-e9c6a47c7c62 admin admin] The token cache is being invalidate because project 36b9260b8a3241c9b036d57d13620346 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79993) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:27:54.257045 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-2478780a-ff49-4b44-af0e-e9c6a47c7c62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:27:54.257868 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-2478780a-ff49-4b44-af0e-e9c6a47c7c62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:27:54.260518 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1196/2412] 10.222.0.70 () {58 vars in 1232 bytes} [Tue May 10 19:27:54 2022] DELETE /identity/v3/projects/36b9260b8a3241c9b036d57d13620346 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:27:54.266213 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170c0efa-6f90-4901-a949-0f129762dd03 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:27:54.266709 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170c0efa-6f90-4901-a949-0f129762dd03 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:27:54.266809 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170c0efa-6f90-4901-a949-0f129762dd03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:27:54.293746 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-170c0efa-6f90-4901-a949-0f129762dd03 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:27:54.295405 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-170c0efa-6f90-4901-a949-0f129762dd03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:27:54.368968 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1217/2413] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:27:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:27:54.376319 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ebb1fd-97bd-44ca-9047-4467122b4862 None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:27:54.376708 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ebb1fd-97bd-44ca-9047-4467122b4862 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:27:54.376999 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ebb1fd-97bd-44ca-9047-4467122b4862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:27:54.395760 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-a8ebb1fd-97bd-44ca-9047-4467122b4862 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:27:54.397015 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-a8ebb1fd-97bd-44ca-9047-4467122b4862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:27:54.405565 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1197/2414] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:27:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:27:54.409974 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170c0efa-6f90-4901-a949-0f129762dd03 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:27:54.420270 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170c0efa-6f90-4901-a949-0f129762dd03 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:27:54.425349 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d250f4-ad61-440d-9bde-2ea0ef5c7a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:27:54.426138 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d250f4-ad61-440d-9bde-2ea0ef5c7a1d admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:27:54.426520 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d250f4-ad61-440d-9bde-2ea0ef5c7a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:27:54.426991 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d250f4-ad61-440d-9bde-2ea0ef5c7a1d admin admin] PATH_INFO: `/v3/domains` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:27:54.428412 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d250f4-ad61-440d-9bde-2ea0ef5c7a1d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:27:54.428412 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d250f4-ad61-440d-9bde-2ea0ef5c7a1d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:27:54.429692 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d250f4-ad61-440d-9bde-2ea0ef5c7a1d admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:27:54.441922 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1218/2415] 10.222.0.70 () {58 vars in 1152 bytes} [Tue May 10 19:27:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:27:54.446583 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ebb1fd-97bd-44ca-9047-4467122b4862 None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:27:54.455761 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ebb1fd-97bd-44ca-9047-4467122b4862 None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:27:54.460551 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e70c23-6440-4224-9f28-1aa3b5a88996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:27:54.461756 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e70c23-6440-4224-9f28-1aa3b5a88996 admin admin] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:27:54.462044 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e70c23-6440-4224-9f28-1aa3b5a88996 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:27:54.462313 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e70c23-6440-4224-9f28-1aa3b5a88996 admin admin] PATH_INFO: `/v3/projects` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:27:54.463060 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e70c23-6440-4224-9f28-1aa3b5a88996 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:27:54.465019 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e70c23-6440-4224-9f28-1aa3b5a88996 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:27:54.489991 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1198/2416] 10.222.0.70 () {60 vars in 1152 bytes} [Tue May 10 19:27:54 2022] POST /identity/v3/projects => generated 387 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:27:54.494145 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d250f4-ad61-440d-9bde-2ea0ef5c7a1d admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:27:54.503904 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d250f4-ad61-440d-9bde-2ea0ef5c7a1d admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:27:54.557024 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa04bcbb-9d61-4c55-a3f1-667e571792be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:27:54.557687 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa04bcbb-9d61-4c55-a3f1-667e571792be admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:27:54.557975 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa04bcbb-9d61-4c55-a3f1-667e571792be admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:27:54.558251 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa04bcbb-9d61-4c55-a3f1-667e571792be admin admin] PATH_INFO: `/v3/users` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:27:54.558930 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa04bcbb-9d61-4c55-a3f1-667e571792be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:27:54.560866 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa04bcbb-9d61-4c55-a3f1-667e571792be admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:27:54.580062 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1219/2417] 10.222.0.70 () {60 vars in 1143 bytes} [Tue May 10 19:27:54 2022] POST /identity/v3/users => generated 294 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:27:54.584079 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e70c23-6440-4224-9f28-1aa3b5a88996 admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:27:54.594591 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e70c23-6440-4224-9f28-1aa3b5a88996 admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:27:54.599169 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65773d87-90d8-4b0f-a185-6c987f9de16b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:27:54.599820 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65773d87-90d8-4b0f-a185-6c987f9de16b admin admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:27:54.600103 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65773d87-90d8-4b0f-a185-6c987f9de16b admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:27:54.600379 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65773d87-90d8-4b0f-a185-6c987f9de16b admin admin] PATH_INFO: `/v3/roles` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:27:54.601127 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65773d87-90d8-4b0f-a185-6c987f9de16b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:27:54.602754 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65773d87-90d8-4b0f-a185-6c987f9de16b admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:27:54.612704 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1199/2418] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:27:54 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:27:54.616354 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa04bcbb-9d61-4c55-a3f1-667e571792be admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:27:54.626016 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa04bcbb-9d61-4c55-a3f1-667e571792be admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:27:54.630777 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b7979c-9eb2-429f-a95d-dc226eeef3e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:27:54.631453 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b7979c-9eb2-429f-a95d-dc226eeef3e7 admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:27:54.631737 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b7979c-9eb2-429f-a95d-dc226eeef3e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:27:54.632010 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b7979c-9eb2-429f-a95d-dc226eeef3e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:27:54.633320 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b7979c-9eb2-429f-a95d-dc226eeef3e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:27:54.634893 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b7979c-9eb2-429f-a95d-dc226eeef3e7 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:27:54.644403 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1220/2419] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:27:54 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:27:54.649111 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65773d87-90d8-4b0f-a185-6c987f9de16b admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:27:54.658884 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65773d87-90d8-4b0f-a185-6c987f9de16b admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:27:54.663486 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2858fa84-0c4b-47f6-8e25-9bc49c7e123d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:27:54.664346 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2858fa84-0c4b-47f6-8e25-9bc49c7e123d admin admin] REQUEST_METHOD: `PUT` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:27:54.664662 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2858fa84-0c4b-47f6-8e25-9bc49c7e123d admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:27:54.664937 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2858fa84-0c4b-47f6-8e25-9bc49c7e123d admin admin] PATH_INFO: `/v3/projects/4c6bcfbb2f7d4eed80e06bdf7282b05d/users/5a93c64cbc134efcb1fd59dae6ecc2d4/roles/5c07cf5bfbd3427db18428aa50420962` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:27:54.678884 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2858fa84-0c4b-47f6-8e25-9bc49c7e123d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c6bcfbb2f7d4eed80e06bdf7282b05d, user_id=5a93c64cbc134efcb1fd59dae6ecc2d4, role_id=5c07cf5bfbd3427db18428aa50420962)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:27:54.681564 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2858fa84-0c4b-47f6-8e25-9bc49c7e123d admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:27:54.693573 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1200/2420] 10.222.0.70 () {60 vars in 1482 bytes} [Tue May 10 19:27:54 2022] PUT /identity/v3/projects/4c6bcfbb2f7d4eed80e06bdf7282b05d/users/5a93c64cbc134efcb1fd59dae6ecc2d4/roles/5c07cf5bfbd3427db18428aa50420962 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 19:27:54.704684 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636b52a6-85fd-481e-bde4-a543e00feb21 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:27:54.705004 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636b52a6-85fd-481e-bde4-a543e00feb21 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:27:54.705281 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636b52a6-85fd-481e-bde4-a543e00feb21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:27:54.731453 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-636b52a6-85fd-481e-bde4-a543e00feb21 None None] MFA Rules not processed for user `5a93c64cbc134efcb1fd59dae6ecc2d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:27:54.732686 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-636b52a6-85fd-481e-bde4-a543e00feb21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:27:54.803575 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1221/2421] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:27:54 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:27:54.808088 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2858fa84-0c4b-47f6-8e25-9bc49c7e123d admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:27:54.874046 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2858fa84-0c4b-47f6-8e25-9bc49c7e123d admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:27:54.881723 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e951e0-95c5-4b1e-8f4b-ecb8b4d431a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:27:54.882379 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e951e0-95c5-4b1e-8f4b-ecb8b4d431a2 admin admin] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:27:54.885319 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e951e0-95c5-4b1e-8f4b-ecb8b4d431a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:27:54.885598 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e951e0-95c5-4b1e-8f4b-ecb8b4d431a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:27:54.886551 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e951e0-95c5-4b1e-8f4b-ecb8b4d431a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:27:54.888464 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e951e0-95c5-4b1e-8f4b-ecb8b4d431a2 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:27:54.913279 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1201/2422] 10.222.0.70 () {60 vars in 1152 bytes} [Tue May 10 19:27:54 2022] POST /identity/v3/projects => generated 387 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 19:27:54.917445 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636b52a6-85fd-481e-bde4-a543e00feb21 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:27:54.928306 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636b52a6-85fd-481e-bde4-a543e00feb21 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:27:54.987383 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787b1208-6471-42a3-8cfb-bcdc7a2beca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:27:54.988058 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787b1208-6471-42a3-8cfb-bcdc7a2beca7 admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:27:54.988343 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787b1208-6471-42a3-8cfb-bcdc7a2beca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:27:54.988674 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787b1208-6471-42a3-8cfb-bcdc7a2beca7 admin admin] PATH_INFO: `/v3/users` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:27:54.989361 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787b1208-6471-42a3-8cfb-bcdc7a2beca7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:27:54.991336 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787b1208-6471-42a3-8cfb-bcdc7a2beca7 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:27:55.011875 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1222/2423] 10.222.0.70 () {60 vars in 1143 bytes} [Tue May 10 19:27:54 2022] POST /identity/v3/users => generated 294 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:27:55.016049 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e951e0-95c5-4b1e-8f4b-ecb8b4d431a2 admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:27:55.026145 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e951e0-95c5-4b1e-8f4b-ecb8b4d431a2 admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:27:55.030706 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f51f8b7-6c0c-47e0-83ae-a8e4f43f9579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:27:55.031356 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f51f8b7-6c0c-47e0-83ae-a8e4f43f9579 admin admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:27:55.031639 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f51f8b7-6c0c-47e0-83ae-a8e4f43f9579 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:27:55.031918 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f51f8b7-6c0c-47e0-83ae-a8e4f43f9579 admin admin] PATH_INFO: `/v3/roles` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:27:55.032667 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f51f8b7-6c0c-47e0-83ae-a8e4f43f9579 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:27:55.034284 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f51f8b7-6c0c-47e0-83ae-a8e4f43f9579 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:27:55.044343 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1202/2424] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:27:55 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:27:55.048024 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787b1208-6471-42a3-8cfb-bcdc7a2beca7 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:27:55.058098 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787b1208-6471-42a3-8cfb-bcdc7a2beca7 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:27:55.062697 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a503d5d-e44d-4bea-b6bd-14e3b4b77016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:27:55.063340 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a503d5d-e44d-4bea-b6bd-14e3b4b77016 admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:27:55.063630 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a503d5d-e44d-4bea-b6bd-14e3b4b77016 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:27:55.063907 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a503d5d-e44d-4bea-b6bd-14e3b4b77016 admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:27:55.064783 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a503d5d-e44d-4bea-b6bd-14e3b4b77016 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:27:55.066355 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a503d5d-e44d-4bea-b6bd-14e3b4b77016 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:27:55.076780 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1223/2425] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:27:55 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:27:55.080569 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f51f8b7-6c0c-47e0-83ae-a8e4f43f9579 admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:27:55.090116 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f51f8b7-6c0c-47e0-83ae-a8e4f43f9579 admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:27:55.094597 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0211a90e-716a-47c7-ae9e-fc00c753839a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:27:55.095453 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0211a90e-716a-47c7-ae9e-fc00c753839a admin admin] REQUEST_METHOD: `PUT` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:27:55.095731 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0211a90e-716a-47c7-ae9e-fc00c753839a admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:27:55.096003 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0211a90e-716a-47c7-ae9e-fc00c753839a admin admin] PATH_INFO: `/v3/projects/dd7a4350f08643299b13e51564a4ebec/users/ce4efae9a6ec44199ab05768ea7fecc6/roles/5c07cf5bfbd3427db18428aa50420962` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:27:55.110279 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0211a90e-716a-47c7-ae9e-fc00c753839a admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd7a4350f08643299b13e51564a4ebec, user_id=ce4efae9a6ec44199ab05768ea7fecc6, role_id=5c07cf5bfbd3427db18428aa50420962)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:27:55.112969 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0211a90e-716a-47c7-ae9e-fc00c753839a admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:27:55.125691 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1203/2426] 10.222.0.70 () {60 vars in 1482 bytes} [Tue May 10 19:27:55 2022] PUT /identity/v3/projects/dd7a4350f08643299b13e51564a4ebec/users/ce4efae9a6ec44199ab05768ea7fecc6/roles/5c07cf5bfbd3427db18428aa50420962 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:27:55.137134 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89f58ae-3142-4dab-a0f5-e735e3f25bf7 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:27:55.137412 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89f58ae-3142-4dab-a0f5-e735e3f25bf7 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:27:55.137689 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89f58ae-3142-4dab-a0f5-e735e3f25bf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:27:55.162741 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-e89f58ae-3142-4dab-a0f5-e735e3f25bf7 None None] MFA Rules not processed for user `ce4efae9a6ec44199ab05768ea7fecc6`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:27:55.163924 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-e89f58ae-3142-4dab-a0f5-e735e3f25bf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:27:55.225035 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1224/2427] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:27:55 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:27:55.229358 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0211a90e-716a-47c7-ae9e-fc00c753839a admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:27:55.302310 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0211a90e-716a-47c7-ae9e-fc00c753839a admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:27:55.307899 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ffd626-67a6-486b-9f39-d5a182a8cfda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:27:55.308701 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ffd626-67a6-486b-9f39-d5a182a8cfda admin admin] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:27:55.309110 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ffd626-67a6-486b-9f39-d5a182a8cfda admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:27:55.309491 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ffd626-67a6-486b-9f39-d5a182a8cfda admin admin] PATH_INFO: `/v3/projects` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:27:55.310296 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ffd626-67a6-486b-9f39-d5a182a8cfda admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:27:55.312309 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ffd626-67a6-486b-9f39-d5a182a8cfda admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:27:55.340070 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1204/2428] 10.222.0.70 () {60 vars in 1152 bytes} [Tue May 10 19:27:55 2022] POST /identity/v3/projects => generated 383 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:27:55.342299 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89f58ae-3142-4dab-a0f5-e735e3f25bf7 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:27:55.354029 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89f58ae-3142-4dab-a0f5-e735e3f25bf7 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:27:55.409767 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601dc875-defb-4b1c-ae4b-9894aac0fe0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:27:55.410439 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601dc875-defb-4b1c-ae4b-9894aac0fe0c admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:27:55.410720 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601dc875-defb-4b1c-ae4b-9894aac0fe0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:27:55.410992 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601dc875-defb-4b1c-ae4b-9894aac0fe0c admin admin] PATH_INFO: `/v3/users` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:27:55.411684 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601dc875-defb-4b1c-ae4b-9894aac0fe0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:27:55.413653 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601dc875-defb-4b1c-ae4b-9894aac0fe0c admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:27:55.435546 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1225/2429] 10.222.0.70 () {60 vars in 1143 bytes} [Tue May 10 19:27:55 2022] POST /identity/v3/users => generated 298 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:27:55.437056 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ffd626-67a6-486b-9f39-d5a182a8cfda admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:27:55.447341 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ffd626-67a6-486b-9f39-d5a182a8cfda admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:27:55.452788 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5841cf70-598f-483a-98e9-fd0dfeeddc4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:27:55.453448 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5841cf70-598f-483a-98e9-fd0dfeeddc4b admin admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:27:55.453849 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5841cf70-598f-483a-98e9-fd0dfeeddc4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:27:55.454134 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5841cf70-598f-483a-98e9-fd0dfeeddc4b admin admin] PATH_INFO: `/v3/roles` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:27:55.454852 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5841cf70-598f-483a-98e9-fd0dfeeddc4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:27:55.456579 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5841cf70-598f-483a-98e9-fd0dfeeddc4b admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:27:55.467596 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1205/2430] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:27:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 19:27:55.471474 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601dc875-defb-4b1c-ae4b-9894aac0fe0c admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:27:55.481740 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601dc875-defb-4b1c-ae4b-9894aac0fe0c admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:27:55.486243 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba7e276-314e-4bee-875d-9202babc3688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:27:55.487111 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba7e276-314e-4bee-875d-9202babc3688 admin admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:27:55.487389 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba7e276-314e-4bee-875d-9202babc3688 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:27:55.487658 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba7e276-314e-4bee-875d-9202babc3688 admin admin] PATH_INFO: `/v3/projects/e95286a432784794b983101104c9d8a9/users/596fceaddd3f48bcab7a20f9642e37eb/roles/634ba284303b4626b5a0402772c68f5c` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:27:55.502141 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba7e276-314e-4bee-875d-9202babc3688 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e95286a432784794b983101104c9d8a9, user_id=596fceaddd3f48bcab7a20f9642e37eb, role_id=634ba284303b4626b5a0402772c68f5c)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:27:55.504838 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba7e276-314e-4bee-875d-9202babc3688 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:27:55.517447 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1226/2431] 10.222.0.70 () {60 vars in 1482 bytes} [Tue May 10 19:27:55 2022] PUT /identity/v3/projects/e95286a432784794b983101104c9d8a9/users/596fceaddd3f48bcab7a20f9642e37eb/roles/634ba284303b4626b5a0402772c68f5c => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:27:55.521425 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5841cf70-598f-483a-98e9-fd0dfeeddc4b admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:27:55.531137 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5841cf70-598f-483a-98e9-fd0dfeeddc4b admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:27:55.587984 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b7fb82-5b92-40cb-9b8d-7c0a9af43ac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:27:55.588674 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b7fb82-5b92-40cb-9b8d-7c0a9af43ac4 admin admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:27:55.588992 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b7fb82-5b92-40cb-9b8d-7c0a9af43ac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:27:55.589267 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b7fb82-5b92-40cb-9b8d-7c0a9af43ac4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:27:55.589974 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b7fb82-5b92-40cb-9b8d-7c0a9af43ac4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:27:55.591600 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b7fb82-5b92-40cb-9b8d-7c0a9af43ac4 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:27:55.600932 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1206/2432] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:27:55 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:27:55.605548 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba7e276-314e-4bee-875d-9202babc3688 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:27:55.615857 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba7e276-314e-4bee-875d-9202babc3688 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:27:55.621159 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda677c9-4cb2-47d0-a4e3-5180240fe524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:27:55.622030 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda677c9-4cb2-47d0-a4e3-5180240fe524 admin admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:27:55.622319 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda677c9-4cb2-47d0-a4e3-5180240fe524 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:27:55.622590 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda677c9-4cb2-47d0-a4e3-5180240fe524 admin admin] PATH_INFO: `/v3/projects/e95286a432784794b983101104c9d8a9/users/596fceaddd3f48bcab7a20f9642e37eb/roles/634ba284303b4626b5a0402772c68f5c` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:27:55.624598 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda677c9-4cb2-47d0-a4e3-5180240fe524 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e95286a432784794b983101104c9d8a9, user_id=596fceaddd3f48bcab7a20f9642e37eb, role_id=634ba284303b4626b5a0402772c68f5c)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:27:55.627259 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda677c9-4cb2-47d0-a4e3-5180240fe524 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:27:55.637390 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1227/2433] 10.222.0.70 () {60 vars in 1482 bytes} [Tue May 10 19:27:55 2022] PUT /identity/v3/projects/e95286a432784794b983101104c9d8a9/users/596fceaddd3f48bcab7a20f9642e37eb/roles/634ba284303b4626b5a0402772c68f5c => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 19:27:55.649505 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72022315-2dcf-4f00-a19a-449e48237f6c None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:27:55.649884 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72022315-2dcf-4f00-a19a-449e48237f6c None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:27:55.650235 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72022315-2dcf-4f00-a19a-449e48237f6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:27:55.680654 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-72022315-2dcf-4f00-a19a-449e48237f6c None None] MFA Rules not processed for user `596fceaddd3f48bcab7a20f9642e37eb`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:27:55.682170 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-72022315-2dcf-4f00-a19a-449e48237f6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:27:55.751765 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1207/2434] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:27:55 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:27:55.767240 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda677c9-4cb2-47d0-a4e3-5180240fe524 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:27:55.768987 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-fda677c9-4cb2-47d0-a4e3-5180240fe524 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:27:55.833482 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda677c9-4cb2-47d0-a4e3-5180240fe524 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:27:55.837208 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55404d57-3c7b-4478-af28-72e3989d199f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15df2a8967aa43299c10e365f4200d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:27:55.838508 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55404d57-3c7b-4478-af28-72e3989d199f service cinder] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:27:55.838809 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55404d57-3c7b-4478-af28-72e3989d199f service cinder] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:27:55.839093 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55404d57-3c7b-4478-af28-72e3989d199f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:27:55.850277 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55404d57-3c7b-4478-af28-72e3989d199f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:27:55.851976 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55404d57-3c7b-4478-af28-72e3989d199f service cinder] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:27:55.863528 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1228/2435] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:27:55 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 19:27:56.371478 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72022315-2dcf-4f00-a19a-449e48237f6c None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:27:56.383277 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72022315-2dcf-4f00-a19a-449e48237f6c None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:27:56.387942 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567f1c46-6da1-4eb7-a4c0-b187fffed5cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15df2a8967aa43299c10e365f4200d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:27:56.388861 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567f1c46-6da1-4eb7-a4c0-b187fffed5cf service cinder] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:27:56.389143 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567f1c46-6da1-4eb7-a4c0-b187fffed5cf service cinder] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:27:56.389605 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567f1c46-6da1-4eb7-a4c0-b187fffed5cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:27:56.451463 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567f1c46-6da1-4eb7-a4c0-b187fffed5cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:27:56.452956 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567f1c46-6da1-4eb7-a4c0-b187fffed5cf service cinder] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:27:56.462015 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1208/2436] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:27:56 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:28:00.442594 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55404d57-3c7b-4478-af28-72e3989d199f service cinder] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:28:00.444280 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-55404d57-3c7b-4478-af28-72e3989d199f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:28:00.455681 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55404d57-3c7b-4478-af28-72e3989d199f service cinder] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:28:00.458782 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abe2ad8-bdb1-4f73-9570-afd46d013fd3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15df2a8967aa43299c10e365f4200d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:28:00.459420 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abe2ad8-bdb1-4f73-9570-afd46d013fd3 service cinder] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:00.459702 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abe2ad8-bdb1-4f73-9570-afd46d013fd3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:00.459972 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abe2ad8-bdb1-4f73-9570-afd46d013fd3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:00.517211 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abe2ad8-bdb1-4f73-9570-afd46d013fd3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:28:00.518672 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abe2ad8-bdb1-4f73-9570-afd46d013fd3 service cinder] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:28:00.528441 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1229/2437] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:28:00 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:28:02.601838 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567f1c46-6da1-4eb7-a4c0-b187fffed5cf service cinder] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:28:02.665452 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567f1c46-6da1-4eb7-a4c0-b187fffed5cf service cinder] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:28:02.669870 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6330397-e2e5-4614-afbb-59d3f38614f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:28:02.670737 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6330397-e2e5-4614-afbb-59d3f38614f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:02.671019 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6330397-e2e5-4614-afbb-59d3f38614f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:02.671290 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6330397-e2e5-4614-afbb-59d3f38614f6 admin admin] PATH_INFO: `/v3/users/5a93c64cbc134efcb1fd59dae6ecc2d4` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:02.672530 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6330397-e2e5-4614-afbb-59d3f38614f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a93c64cbc134efcb1fd59dae6ecc2d4)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:28:02.674444 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6330397-e2e5-4614-afbb-59d3f38614f6 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:28:02.722053 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-f6330397-e2e5-4614-afbb-59d3f38614f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a93c64cbc134efcb1fd59dae6ecc2d4'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:02.734043 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-f6330397-e2e5-4614-afbb-59d3f38614f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a93c64cbc134efcb1fd59dae6ecc2d4'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:02.740874 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-f6330397-e2e5-4614-afbb-59d3f38614f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a93c64cbc134efcb1fd59dae6ecc2d4'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:02.741518 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-f6330397-e2e5-4614-afbb-59d3f38614f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a93c64cbc134efcb1fd59dae6ecc2d4'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:02.749270 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-f6330397-e2e5-4614-afbb-59d3f38614f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a93c64cbc134efcb1fd59dae6ecc2d4'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:02.755077 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1209/2438] 10.222.0.70 () {58 vars in 1223 bytes} [Tue May 10 19:28:02 2022] DELETE /identity/v3/users/5a93c64cbc134efcb1fd59dae6ecc2d4 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:28:02.760089 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcc33ff-1971-469a-8ab0-a72374a9ef33 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:02.760580 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcc33ff-1971-469a-8ab0-a72374a9ef33 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:02.760695 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcc33ff-1971-469a-8ab0-a72374a9ef33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:02.777067 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-6dcc33ff-1971-469a-8ab0-a72374a9ef33 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:28:02.778238 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-6dcc33ff-1971-469a-8ab0-a72374a9ef33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:28:02.833938 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1230/2439] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:28:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:28:02.843534 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6330397-e2e5-4614-afbb-59d3f38614f6 admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:28:02.845004 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-f6330397-e2e5-4614-afbb-59d3f38614f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:28:02.901320 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6330397-e2e5-4614-afbb-59d3f38614f6 admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:28:02.904938 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c06eea7-b89f-4c88-8d91-e1c676bd88b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f1dc79540b48c0866478cc48cd8205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:28:02.905572 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c06eea7-b89f-4c88-8d91-e1c676bd88b2 service neutron] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:02.905855 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c06eea7-b89f-4c88-8d91-e1c676bd88b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:02.906130 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c06eea7-b89f-4c88-8d91-e1c676bd88b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:02.915256 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c06eea7-b89f-4c88-8d91-e1c676bd88b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:28:02.916714 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c06eea7-b89f-4c88-8d91-e1c676bd88b2 service neutron] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:28:02.925756 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1210/2440] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:28:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:28:03.187623 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcc33ff-1971-469a-8ab0-a72374a9ef33 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:28:03.189074 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-6dcc33ff-1971-469a-8ab0-a72374a9ef33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:28:03.201921 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcc33ff-1971-469a-8ab0-a72374a9ef33 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:28:03.206733 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dab178-3a15-43b5-88da-cfb6fd22afa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:28:03.208119 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dab178-3a15-43b5-88da-cfb6fd22afa4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:03.208794 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dab178-3a15-43b5-88da-cfb6fd22afa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:03.209071 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dab178-3a15-43b5-88da-cfb6fd22afa4 admin admin] PATH_INFO: `/v3/projects/4c6bcfbb2f7d4eed80e06bdf7282b05d` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:03.210389 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dab178-3a15-43b5-88da-cfb6fd22afa4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c6bcfbb2f7d4eed80e06bdf7282b05d)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:28:03.212772 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dab178-3a15-43b5-88da-cfb6fd22afa4 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:28:03.260079 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-45dab178-3a15-43b5-88da-cfb6fd22afa4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c6bcfbb2f7d4eed80e06bdf7282b05d', 'request_id': 'req-45dab178-3a15-43b5-88da-cfb6fd22afa4'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:03.265315 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-45dab178-3a15-43b5-88da-cfb6fd22afa4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c6bcfbb2f7d4eed80e06bdf7282b05d', 'request_id': 'req-45dab178-3a15-43b5-88da-cfb6fd22afa4'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:03.272166 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-45dab178-3a15-43b5-88da-cfb6fd22afa4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c6bcfbb2f7d4eed80e06bdf7282b05d', 'request_id': 'req-45dab178-3a15-43b5-88da-cfb6fd22afa4'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:03.283320 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-45dab178-3a15-43b5-88da-cfb6fd22afa4 admin admin] The token cache is being invalidate because project 4c6bcfbb2f7d4eed80e06bdf7282b05d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79994) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:28:03.283606 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-45dab178-3a15-43b5-88da-cfb6fd22afa4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:03.284229 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-45dab178-3a15-43b5-88da-cfb6fd22afa4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:03.285796 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1231/2441] 10.222.0.70 () {58 vars in 1232 bytes} [Tue May 10 19:28:03 2022] DELETE /identity/v3/projects/4c6bcfbb2f7d4eed80e06bdf7282b05d => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 19:28:03.289753 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c06eea7-b89f-4c88-8d91-e1c676bd88b2 service neutron] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:28:03.299681 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c06eea7-b89f-4c88-8d91-e1c676bd88b2 service neutron] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:28:03.355673 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78a319b-eb66-4828-847d-1daadcc0810e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:28:03.356593 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78a319b-eb66-4828-847d-1daadcc0810e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:03.356881 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78a319b-eb66-4828-847d-1daadcc0810e admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:03.357156 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78a319b-eb66-4828-847d-1daadcc0810e admin admin] PATH_INFO: `/v3/users/ce4efae9a6ec44199ab05768ea7fecc6` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:03.358352 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78a319b-eb66-4828-847d-1daadcc0810e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce4efae9a6ec44199ab05768ea7fecc6)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:28:03.360288 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78a319b-eb66-4828-847d-1daadcc0810e admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:28:03.386253 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784d1383-3df7-46c9-a891-b10e63f9fe1c None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:03.386545 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784d1383-3df7-46c9-a891-b10e63f9fe1c None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:03.386851 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784d1383-3df7-46c9-a891-b10e63f9fe1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:03.404913 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-784d1383-3df7-46c9-a891-b10e63f9fe1c None None] MFA Rules not processed for user `058e52f1bf0b4aba965d945815d4acb3`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:28:03.406100 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-784d1383-3df7-46c9-a891-b10e63f9fe1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:28:03.408845 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-d78a319b-eb66-4828-847d-1daadcc0810e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce4efae9a6ec44199ab05768ea7fecc6'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:03.420903 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-d78a319b-eb66-4828-847d-1daadcc0810e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce4efae9a6ec44199ab05768ea7fecc6'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:03.427546 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-d78a319b-eb66-4828-847d-1daadcc0810e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce4efae9a6ec44199ab05768ea7fecc6'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:03.428232 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-d78a319b-eb66-4828-847d-1daadcc0810e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce4efae9a6ec44199ab05768ea7fecc6'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:03.435606 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-d78a319b-eb66-4828-847d-1daadcc0810e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce4efae9a6ec44199ab05768ea7fecc6'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:03.441541 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1211/2442] 10.222.0.70 () {58 vars in 1223 bytes} [Tue May 10 19:28:03 2022] DELETE /identity/v3/users/ce4efae9a6ec44199ab05768ea7fecc6 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:28:03.461088 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1232/2443] 10.222.0.70 () {58 vars in 1009 bytes} [Tue May 10 19:28:03 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:28:03.474461 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78a319b-eb66-4828-847d-1daadcc0810e admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:28:03.475993 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-d78a319b-eb66-4828-847d-1daadcc0810e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:28:03.546422 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78a319b-eb66-4828-847d-1daadcc0810e admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:28:03.551556 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb83128-91a6-4223-80e7-6d4342c609af service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0454aa03fa31487ea1464b9d0008212c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:28:03.552209 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb83128-91a6-4223-80e7-6d4342c609af service swift] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:03.554028 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb83128-91a6-4223-80e7-6d4342c609af service swift] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:03.554028 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb83128-91a6-4223-80e7-6d4342c609af service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:03.618934 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb83128-91a6-4223-80e7-6d4342c609af service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:28:03.620558 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb83128-91a6-4223-80e7-6d4342c609af service swift] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:28:03.629253 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1212/2444] 10.222.0.70 () {60 vars in 1384 bytes} [Tue May 10 19:28:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 19:28:04.099970 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784d1383-3df7-46c9-a891-b10e63f9fe1c None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:28:04.101584 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-784d1383-3df7-46c9-a891-b10e63f9fe1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:28:04.124616 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784d1383-3df7-46c9-a891-b10e63f9fe1c None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:28:04.187343 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bc198f-4376-486a-9c6b-6878875a8629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:28:04.188282 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bc198f-4376-486a-9c6b-6878875a8629 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:04.188622 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bc198f-4376-486a-9c6b-6878875a8629 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:04.188898 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bc198f-4376-486a-9c6b-6878875a8629 admin admin] PATH_INFO: `/v3/projects/dd7a4350f08643299b13e51564a4ebec` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:04.190202 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bc198f-4376-486a-9c6b-6878875a8629 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd7a4350f08643299b13e51564a4ebec)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:28:04.192166 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bc198f-4376-486a-9c6b-6878875a8629 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:28:04.244714 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-a3bc198f-4376-486a-9c6b-6878875a8629 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd7a4350f08643299b13e51564a4ebec', 'request_id': 'req-a3bc198f-4376-486a-9c6b-6878875a8629'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:04.250800 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-a3bc198f-4376-486a-9c6b-6878875a8629 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd7a4350f08643299b13e51564a4ebec', 'request_id': 'req-a3bc198f-4376-486a-9c6b-6878875a8629'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:04.259468 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-a3bc198f-4376-486a-9c6b-6878875a8629 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd7a4350f08643299b13e51564a4ebec', 'request_id': 'req-a3bc198f-4376-486a-9c6b-6878875a8629'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:04.271243 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-a3bc198f-4376-486a-9c6b-6878875a8629 admin admin] The token cache is being invalidate because project dd7a4350f08643299b13e51564a4ebec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79994) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:28:04.271576 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-a3bc198f-4376-486a-9c6b-6878875a8629 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:04.272303 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-a3bc198f-4376-486a-9c6b-6878875a8629 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:04.274144 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1233/2445] 10.222.0.70 () {58 vars in 1232 bytes} [Tue May 10 19:28:04 2022] DELETE /identity/v3/projects/dd7a4350f08643299b13e51564a4ebec => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:28:04.278654 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb83128-91a6-4223-80e7-6d4342c609af service swift] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:28:04.290103 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb83128-91a6-4223-80e7-6d4342c609af service swift] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:28:04.382588 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8a559e-b261-4350-8733-f0b09dceb048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:28:04.384072 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8a559e-b261-4350-8733-f0b09dceb048 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:04.384360 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8a559e-b261-4350-8733-f0b09dceb048 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:04.387495 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8a559e-b261-4350-8733-f0b09dceb048 admin admin] PATH_INFO: `/v3/users/596fceaddd3f48bcab7a20f9642e37eb` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:04.389362 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8a559e-b261-4350-8733-f0b09dceb048 admin admin] RBAC: Authorizing `identity:delete_user(user_id=596fceaddd3f48bcab7a20f9642e37eb)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:28:04.391613 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8a559e-b261-4350-8733-f0b09dceb048 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:28:04.460949 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-eb8a559e-b261-4350-8733-f0b09dceb048 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '596fceaddd3f48bcab7a20f9642e37eb'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:04.480892 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-eb8a559e-b261-4350-8733-f0b09dceb048 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '596fceaddd3f48bcab7a20f9642e37eb'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:04.489053 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-eb8a559e-b261-4350-8733-f0b09dceb048 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '596fceaddd3f48bcab7a20f9642e37eb'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:04.490205 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-eb8a559e-b261-4350-8733-f0b09dceb048 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '596fceaddd3f48bcab7a20f9642e37eb'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:04.503293 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-eb8a559e-b261-4350-8733-f0b09dceb048 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '596fceaddd3f48bcab7a20f9642e37eb'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:04.513893 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1213/2446] 10.222.0.70 () {58 vars in 1223 bytes} [Tue May 10 19:28:04 2022] DELETE /identity/v3/users/596fceaddd3f48bcab7a20f9642e37eb => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:28:04.975704 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bc198f-4376-486a-9c6b-6878875a8629 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:28:04.977350 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-a3bc198f-4376-486a-9c6b-6878875a8629 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:28:05.000186 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bc198f-4376-486a-9c6b-6878875a8629 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:28:05.087578 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbaf46c-8d06-418f-9d33-20cf94292777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:28:05.089231 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbaf46c-8d06-418f-9d33-20cf94292777 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:05.089644 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbaf46c-8d06-418f-9d33-20cf94292777 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:05.089922 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbaf46c-8d06-418f-9d33-20cf94292777 admin admin] PATH_INFO: `/v3/projects/e95286a432784794b983101104c9d8a9` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:05.092092 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbaf46c-8d06-418f-9d33-20cf94292777 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e95286a432784794b983101104c9d8a9)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:28:05.103412 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbaf46c-8d06-418f-9d33-20cf94292777 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:28:05.196107 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-3bbaf46c-8d06-418f-9d33-20cf94292777 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e95286a432784794b983101104c9d8a9', 'request_id': 'req-3bbaf46c-8d06-418f-9d33-20cf94292777'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:05.202234 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-3bbaf46c-8d06-418f-9d33-20cf94292777 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e95286a432784794b983101104c9d8a9', 'request_id': 'req-3bbaf46c-8d06-418f-9d33-20cf94292777'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:05.221835 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-3bbaf46c-8d06-418f-9d33-20cf94292777 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e95286a432784794b983101104c9d8a9', 'request_id': 'req-3bbaf46c-8d06-418f-9d33-20cf94292777'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:05.235736 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-3bbaf46c-8d06-418f-9d33-20cf94292777 admin admin] The token cache is being invalidate because project e95286a432784794b983101104c9d8a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79994) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:28:05.236479 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-3bbaf46c-8d06-418f-9d33-20cf94292777 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:05.237575 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-3bbaf46c-8d06-418f-9d33-20cf94292777 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:05.249667 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b726a7-21cf-4b0b-a831-45b96fb1611a None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:05.250784 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b726a7-21cf-4b0b-a831-45b96fb1611a None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:05.251391 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b726a7-21cf-4b0b-a831-45b96fb1611a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:05.253546 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1234/2447] 10.222.0.70 () {58 vars in 1232 bytes} [Tue May 10 19:28:04 2022] DELETE /identity/v3/projects/e95286a432784794b983101104c9d8a9 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:28:05.271387 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-49b726a7-21cf-4b0b-a831-45b96fb1611a None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:28:05.272979 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-49b726a7-21cf-4b0b-a831-45b96fb1611a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:28:05.348896 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1214/2448] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:28:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:28:05.359262 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fc010e-37c1-4421-be8c-acbe93702e61 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:05.359549 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fc010e-37c1-4421-be8c-acbe93702e61 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:05.359833 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fc010e-37c1-4421-be8c-acbe93702e61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:05.382046 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-66fc010e-37c1-4421-be8c-acbe93702e61 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:28:05.383298 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-66fc010e-37c1-4421-be8c-acbe93702e61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:28:05.396390 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b726a7-21cf-4b0b-a831-45b96fb1611a None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:28:05.403443 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1235/2449] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:28:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:28:05.408794 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b726a7-21cf-4b0b-a831-45b96fb1611a None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:28:05.413558 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2dcd80-820f-404d-bcbd-64097a893ada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:28:05.414495 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2dcd80-820f-404d-bcbd-64097a893ada admin admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:05.415426 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2dcd80-820f-404d-bcbd-64097a893ada admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:05.415773 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2dcd80-820f-404d-bcbd-64097a893ada admin admin] PATH_INFO: `/v3/domains` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:05.416614 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2dcd80-820f-404d-bcbd-64097a893ada admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:28:05.416989 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2dcd80-820f-404d-bcbd-64097a893ada admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:28:05.418670 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2dcd80-820f-404d-bcbd-64097a893ada admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:28:05.432457 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1215/2450] 10.222.0.70 () {58 vars in 1152 bytes} [Tue May 10 19:28:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:28:05.436804 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fc010e-37c1-4421-be8c-acbe93702e61 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:28:05.450610 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fc010e-37c1-4421-be8c-acbe93702e61 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:28:05.455775 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79476285-87c6-4ea0-8e0e-9477935964f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:28:05.456688 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79476285-87c6-4ea0-8e0e-9477935964f8 admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:05.457140 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79476285-87c6-4ea0-8e0e-9477935964f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:05.457443 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79476285-87c6-4ea0-8e0e-9477935964f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:05.458376 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79476285-87c6-4ea0-8e0e-9477935964f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:28:05.462506 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79476285-87c6-4ea0-8e0e-9477935964f8 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:28:05.489944 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1236/2451] 10.222.0.70 () {60 vars in 1152 bytes} [Tue May 10 19:28:05 2022] POST /identity/v3/projects => generated 373 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:28:05.494603 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2dcd80-820f-404d-bcbd-64097a893ada admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:28:05.505214 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2dcd80-820f-404d-bcbd-64097a893ada admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:28:05.570473 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f5c6b7-0087-484f-a000-965f041d5190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:28:05.571223 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f5c6b7-0087-484f-a000-965f041d5190 admin admin] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:05.571515 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f5c6b7-0087-484f-a000-965f041d5190 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:05.571796 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f5c6b7-0087-484f-a000-965f041d5190 admin admin] PATH_INFO: `/v3/users` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:05.572550 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f5c6b7-0087-484f-a000-965f041d5190 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:28:05.574758 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f5c6b7-0087-484f-a000-965f041d5190 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:28:05.600105 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1216/2452] 10.222.0.70 () {60 vars in 1143 bytes} [Tue May 10 19:28:05 2022] POST /identity/v3/users => generated 287 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:28:05.601461 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79476285-87c6-4ea0-8e0e-9477935964f8 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:28:05.614127 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79476285-87c6-4ea0-8e0e-9477935964f8 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:28:05.619353 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79856650-15c6-400c-b3ef-3c26abba8506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:28:05.620031 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79856650-15c6-400c-b3ef-3c26abba8506 admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:05.620319 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79856650-15c6-400c-b3ef-3c26abba8506 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:05.620623 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79856650-15c6-400c-b3ef-3c26abba8506 admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:05.621400 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79856650-15c6-400c-b3ef-3c26abba8506 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:28:05.623046 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79856650-15c6-400c-b3ef-3c26abba8506 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:28:05.642442 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1237/2453] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:28:05 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:28:05.643904 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f5c6b7-0087-484f-a000-965f041d5190 admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:28:05.657062 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f5c6b7-0087-484f-a000-965f041d5190 admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:28:05.661976 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456ff6d5-2c1e-4f60-87c9-a8b836ec1d18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:28:05.662658 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456ff6d5-2c1e-4f60-87c9-a8b836ec1d18 admin admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:05.662946 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456ff6d5-2c1e-4f60-87c9-a8b836ec1d18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:05.663226 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456ff6d5-2c1e-4f60-87c9-a8b836ec1d18 admin admin] PATH_INFO: `/v3/roles` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:05.663973 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456ff6d5-2c1e-4f60-87c9-a8b836ec1d18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:28:05.666183 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456ff6d5-2c1e-4f60-87c9-a8b836ec1d18 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:28:05.679197 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1217/2454] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:28:05 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:28:05.681704 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79856650-15c6-400c-b3ef-3c26abba8506 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:28:05.692620 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79856650-15c6-400c-b3ef-3c26abba8506 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:28:05.697705 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dfd98a-d328-4729-9e59-680f334e696e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:28:05.698618 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dfd98a-d328-4729-9e59-680f334e696e admin admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:05.698904 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dfd98a-d328-4729-9e59-680f334e696e admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:05.699180 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dfd98a-d328-4729-9e59-680f334e696e admin admin] PATH_INFO: `/v3/projects/b016d2fe584e4361b0160b0cd38d9d9f/users/18afeb9f8e7b4efba24d49723a726059/roles/5c07cf5bfbd3427db18428aa50420962` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:05.726326 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dfd98a-d328-4729-9e59-680f334e696e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b016d2fe584e4361b0160b0cd38d9d9f, user_id=18afeb9f8e7b4efba24d49723a726059, role_id=5c07cf5bfbd3427db18428aa50420962)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:28:05.729604 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dfd98a-d328-4729-9e59-680f334e696e admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:28:05.746708 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1238/2455] 10.222.0.70 () {60 vars in 1482 bytes} [Tue May 10 19:28:05 2022] PUT /identity/v3/projects/b016d2fe584e4361b0160b0cd38d9d9f/users/18afeb9f8e7b4efba24d49723a726059/roles/5c07cf5bfbd3427db18428aa50420962 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:28:05.815697 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50283a9-e8ea-4711-b5a0-4c2cd6d47cb5 None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:05.815988 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50283a9-e8ea-4711-b5a0-4c2cd6d47cb5 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:05.816264 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50283a9-e8ea-4711-b5a0-4c2cd6d47cb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:05.847324 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-b50283a9-e8ea-4711-b5a0-4c2cd6d47cb5 None None] MFA Rules not processed for user `18afeb9f8e7b4efba24d49723a726059`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:28:05.848633 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-b50283a9-e8ea-4711-b5a0-4c2cd6d47cb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:28:05.927486 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1218/2456] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:28:05 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:28:05.939381 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dfd98a-d328-4729-9e59-680f334e696e admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:28:05.943366 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-75dfd98a-d328-4729-9e59-680f334e696e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:28:06.038915 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dfd98a-d328-4729-9e59-680f334e696e admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:28:06.043813 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c1833a-5dfb-41a3-94eb-438b4525e125 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15df2a8967aa43299c10e365f4200d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:28:06.045904 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c1833a-5dfb-41a3-94eb-438b4525e125 service cinder] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:06.046296 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c1833a-5dfb-41a3-94eb-438b4525e125 service cinder] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:06.046790 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c1833a-5dfb-41a3-94eb-438b4525e125 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:06.056326 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c1833a-5dfb-41a3-94eb-438b4525e125 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:28:06.058152 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c1833a-5dfb-41a3-94eb-438b4525e125 service cinder] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:28:06.068186 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1239/2457] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:28:05 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:28:09.252314 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50283a9-e8ea-4711-b5a0-4c2cd6d47cb5 None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:28:09.314498 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50283a9-e8ea-4711-b5a0-4c2cd6d47cb5 None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:28:09.322352 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8dce07-c765-4bae-9aa2-a153bf053ede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:28:09.323665 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8dce07-c765-4bae-9aa2-a153bf053ede admin admin] REQUEST_METHOD: `DELETE` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:09.323949 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8dce07-c765-4bae-9aa2-a153bf053ede admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:09.324220 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8dce07-c765-4bae-9aa2-a153bf053ede admin admin] PATH_INFO: `/v3/users/18afeb9f8e7b4efba24d49723a726059` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:09.325458 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8dce07-c765-4bae-9aa2-a153bf053ede admin admin] RBAC: Authorizing `identity:delete_user(user_id=18afeb9f8e7b4efba24d49723a726059)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:28:09.327381 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8dce07-c765-4bae-9aa2-a153bf053ede admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:28:09.410640 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-4f8dce07-c765-4bae-9aa2-a153bf053ede admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18afeb9f8e7b4efba24d49723a726059'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:09.423056 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-4f8dce07-c765-4bae-9aa2-a153bf053ede admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18afeb9f8e7b4efba24d49723a726059'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:09.429818 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-4f8dce07-c765-4bae-9aa2-a153bf053ede admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18afeb9f8e7b4efba24d49723a726059'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:09.430540 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-4f8dce07-c765-4bae-9aa2-a153bf053ede admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18afeb9f8e7b4efba24d49723a726059'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:09.439901 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-4f8dce07-c765-4bae-9aa2-a153bf053ede admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18afeb9f8e7b4efba24d49723a726059'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:09.446548 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1219/2458] 10.222.0.70 () {58 vars in 1223 bytes} [Tue May 10 19:28:09 2022] DELETE /identity/v3/users/18afeb9f8e7b4efba24d49723a726059 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 19:28:09.451808 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de50a5d8-a8ac-4d49-88dc-0fa8cda96640 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:09.452682 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de50a5d8-a8ac-4d49-88dc-0fa8cda96640 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:09.452682 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de50a5d8-a8ac-4d49-88dc-0fa8cda96640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:09.472844 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-de50a5d8-a8ac-4d49-88dc-0fa8cda96640 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:28:09.474064 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-de50a5d8-a8ac-4d49-88dc-0fa8cda96640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:28:09.538889 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1240/2459] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:28:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:28:09.545986 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8dce07-c765-4bae-9aa2-a153bf053ede admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:28:09.547425 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-4f8dce07-c765-4bae-9aa2-a153bf053ede admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:28:09.605741 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8dce07-c765-4bae-9aa2-a153bf053ede admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:28:09.611045 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59478b38-f91b-4311-949b-6fbd398550bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f1dc79540b48c0866478cc48cd8205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:28:09.611775 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59478b38-f91b-4311-949b-6fbd398550bb service neutron] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:09.612129 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59478b38-f91b-4311-949b-6fbd398550bb service neutron] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:09.612504 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59478b38-f91b-4311-949b-6fbd398550bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:09.623531 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59478b38-f91b-4311-949b-6fbd398550bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:28:09.625106 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59478b38-f91b-4311-949b-6fbd398550bb service neutron] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:28:09.637720 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1220/2460] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:28:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:28:10.050687 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de50a5d8-a8ac-4d49-88dc-0fa8cda96640 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:28:10.053415 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-de50a5d8-a8ac-4d49-88dc-0fa8cda96640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:28:10.076730 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de50a5d8-a8ac-4d49-88dc-0fa8cda96640 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:28:10.082296 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ece5b06-e814-473d-b16c-52d31b707dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:28:10.083176 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ece5b06-e814-473d-b16c-52d31b707dcf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:10.083553 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ece5b06-e814-473d-b16c-52d31b707dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:10.083720 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ece5b06-e814-473d-b16c-52d31b707dcf admin admin] PATH_INFO: `/v3/projects/b016d2fe584e4361b0160b0cd38d9d9f` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:10.085032 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ece5b06-e814-473d-b16c-52d31b707dcf admin admin] RBAC: Authorizing `identity:delete_project(project_id=b016d2fe584e4361b0160b0cd38d9d9f)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:28:10.087169 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ece5b06-e814-473d-b16c-52d31b707dcf admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:28:10.138716 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-3ece5b06-e814-473d-b16c-52d31b707dcf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b016d2fe584e4361b0160b0cd38d9d9f', 'request_id': 'req-3ece5b06-e814-473d-b16c-52d31b707dcf'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:10.144866 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-3ece5b06-e814-473d-b16c-52d31b707dcf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b016d2fe584e4361b0160b0cd38d9d9f', 'request_id': 'req-3ece5b06-e814-473d-b16c-52d31b707dcf'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:10.157001 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-3ece5b06-e814-473d-b16c-52d31b707dcf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b016d2fe584e4361b0160b0cd38d9d9f', 'request_id': 'req-3ece5b06-e814-473d-b16c-52d31b707dcf'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:10.170110 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-3ece5b06-e814-473d-b16c-52d31b707dcf admin admin] The token cache is being invalidate because project b016d2fe584e4361b0160b0cd38d9d9f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79994) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:28:10.170396 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-3ece5b06-e814-473d-b16c-52d31b707dcf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:10.171051 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-3ece5b06-e814-473d-b16c-52d31b707dcf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:10.172623 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1241/2461] 10.222.0.70 () {58 vars in 1232 bytes} [Tue May 10 19:28:10 2022] DELETE /identity/v3/projects/b016d2fe584e4361b0160b0cd38d9d9f => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:28:10.178230 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3c1386-ef10-4ac3-84b1-991520c721f3 None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:10.178510 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3c1386-ef10-4ac3-84b1-991520c721f3 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:10.178782 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3c1386-ef10-4ac3-84b1-991520c721f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:10.199319 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-df3c1386-ef10-4ac3-84b1-991520c721f3 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:28:10.200535 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-df3c1386-ef10-4ac3-84b1-991520c721f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:28:10.279240 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1221/2462] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:28:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:28:10.281004 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdb36ce-875f-4eb3-970c-24b33d7be7ba None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:10.281405 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdb36ce-875f-4eb3-970c-24b33d7be7ba None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:10.281911 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdb36ce-875f-4eb3-970c-24b33d7be7ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:10.305450 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-bbdb36ce-875f-4eb3-970c-24b33d7be7ba None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:28:10.306859 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-bbdb36ce-875f-4eb3-970c-24b33d7be7ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:28:10.315255 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1242/2463] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:28:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:28:10.319953 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3c1386-ef10-4ac3-84b1-991520c721f3 None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:28:10.333170 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3c1386-ef10-4ac3-84b1-991520c721f3 None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:28:10.339223 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dece438-57aa-49b3-bbae-aa6446ccf230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:28:10.340024 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dece438-57aa-49b3-bbae-aa6446ccf230 admin admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:10.340304 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dece438-57aa-49b3-bbae-aa6446ccf230 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:10.340636 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dece438-57aa-49b3-bbae-aa6446ccf230 admin admin] PATH_INFO: `/v3/domains` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:10.341357 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dece438-57aa-49b3-bbae-aa6446ccf230 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:28:10.341658 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dece438-57aa-49b3-bbae-aa6446ccf230 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:28:10.343402 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dece438-57aa-49b3-bbae-aa6446ccf230 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:28:10.359418 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1222/2464] 10.222.0.70 () {58 vars in 1152 bytes} [Tue May 10 19:28:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:28:10.363990 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdb36ce-875f-4eb3-970c-24b33d7be7ba None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:28:10.373634 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdb36ce-875f-4eb3-970c-24b33d7be7ba None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:28:10.380342 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bcf617-a2be-4661-9c07-55ecb9152ed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:28:10.381064 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bcf617-a2be-4661-9c07-55ecb9152ed1 admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:10.381342 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bcf617-a2be-4661-9c07-55ecb9152ed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:10.381612 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bcf617-a2be-4661-9c07-55ecb9152ed1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:10.382339 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bcf617-a2be-4661-9c07-55ecb9152ed1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:28:10.384824 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bcf617-a2be-4661-9c07-55ecb9152ed1 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:28:10.415744 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1243/2465] 10.222.0.70 () {60 vars in 1152 bytes} [Tue May 10 19:28:10 2022] POST /identity/v3/projects => generated 385 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:28:10.419819 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dece438-57aa-49b3-bbae-aa6446ccf230 admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:28:10.431434 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dece438-57aa-49b3-bbae-aa6446ccf230 admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:28:10.497571 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39e49b9-f78b-44b4-8a91-44c81dc3f59d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:28:10.498247 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39e49b9-f78b-44b4-8a91-44c81dc3f59d admin admin] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:10.498531 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39e49b9-f78b-44b4-8a91-44c81dc3f59d admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:10.498805 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39e49b9-f78b-44b4-8a91-44c81dc3f59d admin admin] PATH_INFO: `/v3/users` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:10.499502 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39e49b9-f78b-44b4-8a91-44c81dc3f59d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:28:10.501837 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39e49b9-f78b-44b4-8a91-44c81dc3f59d admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:28:10.522394 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1223/2466] 10.222.0.70 () {60 vars in 1143 bytes} [Tue May 10 19:28:10 2022] POST /identity/v3/users => generated 293 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:28:10.527465 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bcf617-a2be-4661-9c07-55ecb9152ed1 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:28:10.537859 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bcf617-a2be-4661-9c07-55ecb9152ed1 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:28:10.542526 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f50175-d1b8-447c-8ecf-3cd3e9f1f1fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:28:10.543184 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f50175-d1b8-447c-8ecf-3cd3e9f1f1fa admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:10.543463 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f50175-d1b8-447c-8ecf-3cd3e9f1f1fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:10.543734 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f50175-d1b8-447c-8ecf-3cd3e9f1f1fa admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:10.544475 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f50175-d1b8-447c-8ecf-3cd3e9f1f1fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:28:10.546060 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f50175-d1b8-447c-8ecf-3cd3e9f1f1fa admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:28:10.556958 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1244/2467] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:28:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:28:10.560800 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39e49b9-f78b-44b4-8a91-44c81dc3f59d admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:28:10.571262 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39e49b9-f78b-44b4-8a91-44c81dc3f59d admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:28:10.576719 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6a34a3-78e8-4848-99f6-67ead96cdb0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:28:10.577476 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6a34a3-78e8-4848-99f6-67ead96cdb0d admin admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:10.577757 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6a34a3-78e8-4848-99f6-67ead96cdb0d admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:10.578028 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6a34a3-78e8-4848-99f6-67ead96cdb0d admin admin] PATH_INFO: `/v3/roles` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:10.578752 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6a34a3-78e8-4848-99f6-67ead96cdb0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:28:10.580363 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6a34a3-78e8-4848-99f6-67ead96cdb0d admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:28:10.595014 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1224/2468] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:28:10 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:28:10.598951 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f50175-d1b8-447c-8ecf-3cd3e9f1f1fa admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:28:10.610015 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f50175-d1b8-447c-8ecf-3cd3e9f1f1fa admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:28:10.614839 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c723f5bb-c843-4cb2-9f83-d4d9876a1a42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:28:10.615846 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c723f5bb-c843-4cb2-9f83-d4d9876a1a42 admin admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:10.616135 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c723f5bb-c843-4cb2-9f83-d4d9876a1a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:10.616413 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c723f5bb-c843-4cb2-9f83-d4d9876a1a42 admin admin] PATH_INFO: `/v3/projects/555d298666ad42e299d07e0640290f7d/users/25c299ec4b7e4262a3be74d9b58d3707/roles/5c07cf5bfbd3427db18428aa50420962` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:10.636732 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c723f5bb-c843-4cb2-9f83-d4d9876a1a42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=555d298666ad42e299d07e0640290f7d, user_id=25c299ec4b7e4262a3be74d9b58d3707, role_id=5c07cf5bfbd3427db18428aa50420962)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:28:10.639373 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c723f5bb-c843-4cb2-9f83-d4d9876a1a42 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:28:10.653842 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1245/2469] 10.222.0.70 () {60 vars in 1482 bytes} [Tue May 10 19:28:10 2022] PUT /identity/v3/projects/555d298666ad42e299d07e0640290f7d/users/25c299ec4b7e4262a3be74d9b58d3707/roles/5c07cf5bfbd3427db18428aa50420962 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:28:10.665461 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43132596-333e-4b17-b073-553c0f36a1ec None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:10.665944 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43132596-333e-4b17-b073-553c0f36a1ec None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:10.666441 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43132596-333e-4b17-b073-553c0f36a1ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:10.699163 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-43132596-333e-4b17-b073-553c0f36a1ec None None] MFA Rules not processed for user `25c299ec4b7e4262a3be74d9b58d3707`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:28:10.700364 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-43132596-333e-4b17-b073-553c0f36a1ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:28:10.792872 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1225/2470] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:28:10 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:28:10.806670 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c723f5bb-c843-4cb2-9f83-d4d9876a1a42 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:28:10.808890 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-c723f5bb-c843-4cb2-9f83-d4d9876a1a42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:28:10.875173 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c723f5bb-c843-4cb2-9f83-d4d9876a1a42 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:28:10.878971 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c18dfa-0511-41bb-b319-ca81429c510d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15df2a8967aa43299c10e365f4200d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:28:10.879783 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c18dfa-0511-41bb-b319-ca81429c510d service cinder] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:10.880070 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c18dfa-0511-41bb-b319-ca81429c510d service cinder] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:10.880349 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c18dfa-0511-41bb-b319-ca81429c510d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:10.889942 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c18dfa-0511-41bb-b319-ca81429c510d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:28:10.891479 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c18dfa-0511-41bb-b319-ca81429c510d service cinder] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:28:10.901124 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1246/2471] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:28:10 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:28:13.551629 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43132596-333e-4b17-b073-553c0f36a1ec None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:28:13.614415 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43132596-333e-4b17-b073-553c0f36a1ec None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:28:13.618958 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a08d5a-eeb8-4619-acd0-0961f3f78382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:28:13.619853 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a08d5a-eeb8-4619-acd0-0961f3f78382 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:13.620132 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a08d5a-eeb8-4619-acd0-0961f3f78382 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:13.620437 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a08d5a-eeb8-4619-acd0-0961f3f78382 admin admin] PATH_INFO: `/v3/users/25c299ec4b7e4262a3be74d9b58d3707` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:13.622802 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a08d5a-eeb8-4619-acd0-0961f3f78382 admin admin] RBAC: Authorizing `identity:delete_user(user_id=25c299ec4b7e4262a3be74d9b58d3707)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:28:13.623663 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a08d5a-eeb8-4619-acd0-0961f3f78382 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:28:13.674485 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-35a08d5a-eeb8-4619-acd0-0961f3f78382 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25c299ec4b7e4262a3be74d9b58d3707'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:13.687882 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-35a08d5a-eeb8-4619-acd0-0961f3f78382 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25c299ec4b7e4262a3be74d9b58d3707'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:13.696356 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-35a08d5a-eeb8-4619-acd0-0961f3f78382 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25c299ec4b7e4262a3be74d9b58d3707'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:13.697078 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-35a08d5a-eeb8-4619-acd0-0961f3f78382 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25c299ec4b7e4262a3be74d9b58d3707'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:13.705476 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-35a08d5a-eeb8-4619-acd0-0961f3f78382 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25c299ec4b7e4262a3be74d9b58d3707'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:13.711399 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1226/2472] 10.222.0.70 () {58 vars in 1223 bytes} [Tue May 10 19:28:13 2022] DELETE /identity/v3/users/25c299ec4b7e4262a3be74d9b58d3707 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:28:13.715928 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbbfcbb-7a82-4350-a81a-636be3a8d316 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:13.716459 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbbfcbb-7a82-4350-a81a-636be3a8d316 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:13.716596 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbbfcbb-7a82-4350-a81a-636be3a8d316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:13.732833 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-3bbbfcbb-7a82-4350-a81a-636be3a8d316 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:28:13.734008 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-3bbbfcbb-7a82-4350-a81a-636be3a8d316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:28:13.790167 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1247/2473] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:28:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:28:13.799796 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a08d5a-eeb8-4619-acd0-0961f3f78382 admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:28:13.801288 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-35a08d5a-eeb8-4619-acd0-0961f3f78382 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:28:13.855642 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a08d5a-eeb8-4619-acd0-0961f3f78382 admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:28:13.859258 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ff6481-c220-4b09-9c31-6900d73e4df1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f1dc79540b48c0866478cc48cd8205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:28:13.859893 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ff6481-c220-4b09-9c31-6900d73e4df1 service neutron] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:13.860203 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ff6481-c220-4b09-9c31-6900d73e4df1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:13.860511 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ff6481-c220-4b09-9c31-6900d73e4df1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:13.869751 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ff6481-c220-4b09-9c31-6900d73e4df1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:28:13.871173 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ff6481-c220-4b09-9c31-6900d73e4df1 service neutron] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:28:13.880251 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1227/2474] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:28:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 19:28:14.150171 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbbfcbb-7a82-4350-a81a-636be3a8d316 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:28:14.151992 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-3bbbfcbb-7a82-4350-a81a-636be3a8d316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:28:14.164029 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbbfcbb-7a82-4350-a81a-636be3a8d316 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:28:14.169846 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb0a5e8-7c22-4acc-988c-ab00ee93b5a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:28:14.170737 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb0a5e8-7c22-4acc-988c-ab00ee93b5a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:14.171018 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb0a5e8-7c22-4acc-988c-ab00ee93b5a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:14.171294 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb0a5e8-7c22-4acc-988c-ab00ee93b5a4 admin admin] PATH_INFO: `/v3/projects/555d298666ad42e299d07e0640290f7d` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:14.173611 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb0a5e8-7c22-4acc-988c-ab00ee93b5a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=555d298666ad42e299d07e0640290f7d)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:28:14.175523 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb0a5e8-7c22-4acc-988c-ab00ee93b5a4 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:28:14.219910 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-5fb0a5e8-7c22-4acc-988c-ab00ee93b5a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '555d298666ad42e299d07e0640290f7d', 'request_id': 'req-5fb0a5e8-7c22-4acc-988c-ab00ee93b5a4'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:14.224935 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-5fb0a5e8-7c22-4acc-988c-ab00ee93b5a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '555d298666ad42e299d07e0640290f7d', 'request_id': 'req-5fb0a5e8-7c22-4acc-988c-ab00ee93b5a4'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:14.232044 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-5fb0a5e8-7c22-4acc-988c-ab00ee93b5a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '555d298666ad42e299d07e0640290f7d', 'request_id': 'req-5fb0a5e8-7c22-4acc-988c-ab00ee93b5a4'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:14.242536 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-5fb0a5e8-7c22-4acc-988c-ab00ee93b5a4 admin admin] The token cache is being invalidate because project 555d298666ad42e299d07e0640290f7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79994) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:28:14.242850 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-5fb0a5e8-7c22-4acc-988c-ab00ee93b5a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:14.243493 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-5fb0a5e8-7c22-4acc-988c-ab00ee93b5a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:14.245655 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1248/2475] 10.222.0.70 () {58 vars in 1232 bytes} [Tue May 10 19:28:14 2022] DELETE /identity/v3/projects/555d298666ad42e299d07e0640290f7d => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:28:20.155696 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0d477e-66fe-4873-9e33-10ad8b7fde07 None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:20.156179 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0d477e-66fe-4873-9e33-10ad8b7fde07 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:20.156678 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0d477e-66fe-4873-9e33-10ad8b7fde07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:20.179008 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-8f0d477e-66fe-4873-9e33-10ad8b7fde07 None None] MFA Rules not processed for user `058e52f1bf0b4aba965d945815d4acb3`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:28:20.180195 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-8f0d477e-66fe-4873-9e33-10ad8b7fde07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:28:20.232623 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1228/2476] 10.222.0.70 () {58 vars in 967 bytes} [Tue May 10 19:28:20 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:28:20.244709 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb0a5e8-7c22-4acc-988c-ab00ee93b5a4 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:28:20.246071 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-5fb0a5e8-7c22-4acc-988c-ab00ee93b5a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:28:20.311718 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb0a5e8-7c22-4acc-988c-ab00ee93b5a4 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:28:20.316731 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377407c2-6f3c-4216-ad9f-5c08780bdc77 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0454aa03fa31487ea1464b9d0008212c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:28:20.317369 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377407c2-6f3c-4216-ad9f-5c08780bdc77 service swift] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:20.317655 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377407c2-6f3c-4216-ad9f-5c08780bdc77 service swift] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:20.317932 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377407c2-6f3c-4216-ad9f-5c08780bdc77 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:20.326427 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377407c2-6f3c-4216-ad9f-5c08780bdc77 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:28:20.327997 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377407c2-6f3c-4216-ad9f-5c08780bdc77 service swift] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:28:20.335690 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1249/2477] 10.222.0.70 () {60 vars in 1384 bytes} [Tue May 10 19:28:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 19:28:20.437478 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0d477e-66fe-4873-9e33-10ad8b7fde07 None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:28:20.438944 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-8f0d477e-66fe-4873-9e33-10ad8b7fde07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:28:20.497386 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0d477e-66fe-4873-9e33-10ad8b7fde07 None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:28:20.502173 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6767c52c-81b8-4c1c-8d7b-52d0753504ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f1dc79540b48c0866478cc48cd8205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:28:20.502801 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6767c52c-81b8-4c1c-8d7b-52d0753504ad service neutron] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:20.503076 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6767c52c-81b8-4c1c-8d7b-52d0753504ad service neutron] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:20.503348 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6767c52c-81b8-4c1c-8d7b-52d0753504ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:20.505120 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-6767c52c-81b8-4c1c-8d7b-52d0753504ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:28:20.577872 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6767c52c-81b8-4c1c-8d7b-52d0753504ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:28:20.579472 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6767c52c-81b8-4c1c-8d7b-52d0753504ad service neutron] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:28:20.591941 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1229/2478] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:28:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:28:24.066169 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377407c2-6f3c-4216-ad9f-5c08780bdc77 service swift] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:28:24.067967 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-377407c2-6f3c-4216-ad9f-5c08780bdc77 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:28:24.087991 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377407c2-6f3c-4216-ad9f-5c08780bdc77 service swift] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:28:24.093235 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306c8cb8-e3c7-4518-9e19-d8c87f10a623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:28:24.093714 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306c8cb8-e3c7-4518-9e19-d8c87f10a623 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:24.094011 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306c8cb8-e3c7-4518-9e19-d8c87f10a623 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:24.094291 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306c8cb8-e3c7-4518-9e19-d8c87f10a623 admin admin] PATH_INFO: `/v3/users/a7188fbb905a4ef984d8d3eda8d443d9` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:24.095497 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306c8cb8-e3c7-4518-9e19-d8c87f10a623 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7188fbb905a4ef984d8d3eda8d443d9)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:28:24.097475 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306c8cb8-e3c7-4518-9e19-d8c87f10a623 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:28:24.156225 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-306c8cb8-e3c7-4518-9e19-d8c87f10a623 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7188fbb905a4ef984d8d3eda8d443d9'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:24.168318 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-306c8cb8-e3c7-4518-9e19-d8c87f10a623 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7188fbb905a4ef984d8d3eda8d443d9'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:24.169016 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-306c8cb8-e3c7-4518-9e19-d8c87f10a623 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7188fbb905a4ef984d8d3eda8d443d9'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:24.176568 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-306c8cb8-e3c7-4518-9e19-d8c87f10a623 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7188fbb905a4ef984d8d3eda8d443d9'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:24.184767 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-306c8cb8-e3c7-4518-9e19-d8c87f10a623 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7188fbb905a4ef984d8d3eda8d443d9'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:24.190593 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1250/2479] 10.222.0.70 () {58 vars in 1223 bytes} [Tue May 10 19:28:24 2022] DELETE /identity/v3/users/a7188fbb905a4ef984d8d3eda8d443d9 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:28:24.356873 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6767c52c-81b8-4c1c-8d7b-52d0753504ad service neutron] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:28:24.367540 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6767c52c-81b8-4c1c-8d7b-52d0753504ad service neutron] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:28:24.422780 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53c42d0-c306-48e4-befc-04bc1337eae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:28:24.423571 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53c42d0-c306-48e4-befc-04bc1337eae0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:24.423856 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53c42d0-c306-48e4-befc-04bc1337eae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:24.424131 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53c42d0-c306-48e4-befc-04bc1337eae0 admin admin] PATH_INFO: `/v3/projects/8c2669245ca948cfa795863fa7e43496` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:24.425342 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53c42d0-c306-48e4-befc-04bc1337eae0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c2669245ca948cfa795863fa7e43496)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:28:24.427255 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53c42d0-c306-48e4-befc-04bc1337eae0 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:28:24.476897 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-c53c42d0-c306-48e4-befc-04bc1337eae0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c2669245ca948cfa795863fa7e43496', 'request_id': 'req-c53c42d0-c306-48e4-befc-04bc1337eae0'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:24.482196 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-c53c42d0-c306-48e4-befc-04bc1337eae0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c2669245ca948cfa795863fa7e43496', 'request_id': 'req-c53c42d0-c306-48e4-befc-04bc1337eae0'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:24.490017 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-c53c42d0-c306-48e4-befc-04bc1337eae0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c2669245ca948cfa795863fa7e43496', 'request_id': 'req-c53c42d0-c306-48e4-befc-04bc1337eae0'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:24.502865 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-c53c42d0-c306-48e4-befc-04bc1337eae0 admin admin] The token cache is being invalidate because project 8c2669245ca948cfa795863fa7e43496 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79993) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:28:24.503261 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-c53c42d0-c306-48e4-befc-04bc1337eae0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:24.504136 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-c53c42d0-c306-48e4-befc-04bc1337eae0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:24.506288 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1230/2480] 10.222.0.70 () {58 vars in 1232 bytes} [Tue May 10 19:28:24 2022] DELETE /identity/v3/projects/8c2669245ca948cfa795863fa7e43496 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:28:24.511845 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53c3bc5-05c8-4da3-a5d4-90bcee53d05a None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:24.512193 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53c3bc5-05c8-4da3-a5d4-90bcee53d05a None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:24.512623 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53c3bc5-05c8-4da3-a5d4-90bcee53d05a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:24.533913 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-c53c3bc5-05c8-4da3-a5d4-90bcee53d05a None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:28:24.535098 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-c53c3bc5-05c8-4da3-a5d4-90bcee53d05a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:28:24.593573 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1251/2481] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:28:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:28:24.601336 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a5bf9f-0eef-424a-ad9e-d7614457e9c6 None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:24.601645 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a5bf9f-0eef-424a-ad9e-d7614457e9c6 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:24.602004 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a5bf9f-0eef-424a-ad9e-d7614457e9c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:24.620020 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-09a5bf9f-0eef-424a-ad9e-d7614457e9c6 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:28:24.621251 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-09a5bf9f-0eef-424a-ad9e-d7614457e9c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:28:24.629255 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1231/2482] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:28:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:28:24.633513 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53c3bc5-05c8-4da3-a5d4-90bcee53d05a None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:28:24.643515 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53c3bc5-05c8-4da3-a5d4-90bcee53d05a None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:28:24.648153 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff0798a-57c1-4e69-a705-f5be70e867a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:28:24.648843 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff0798a-57c1-4e69-a705-f5be70e867a8 admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:24.649128 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff0798a-57c1-4e69-a705-f5be70e867a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:24.649404 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff0798a-57c1-4e69-a705-f5be70e867a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:24.650710 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff0798a-57c1-4e69-a705-f5be70e867a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:28:24.651018 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff0798a-57c1-4e69-a705-f5be70e867a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:28:24.652636 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff0798a-57c1-4e69-a705-f5be70e867a8 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:28:24.663840 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1252/2483] 10.222.0.70 () {58 vars in 1152 bytes} [Tue May 10 19:28:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:28:24.668070 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a5bf9f-0eef-424a-ad9e-d7614457e9c6 None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:28:24.677436 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a5bf9f-0eef-424a-ad9e-d7614457e9c6 None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:28:24.682455 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbef563-2b70-48ef-97d7-8443e1718425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:28:24.683431 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbef563-2b70-48ef-97d7-8443e1718425 admin admin] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:24.684060 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbef563-2b70-48ef-97d7-8443e1718425 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:24.684292 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbef563-2b70-48ef-97d7-8443e1718425 admin admin] PATH_INFO: `/v3/projects` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:24.685204 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbef563-2b70-48ef-97d7-8443e1718425 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:28:24.687374 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbef563-2b70-48ef-97d7-8443e1718425 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:28:24.714280 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1232/2484] 10.222.0.70 () {60 vars in 1152 bytes} [Tue May 10 19:28:24 2022] POST /identity/v3/projects => generated 363 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:28:24.718107 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff0798a-57c1-4e69-a705-f5be70e867a8 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:28:24.727875 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff0798a-57c1-4e69-a705-f5be70e867a8 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:28:24.783584 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972ef91d-f8e1-40b0-8980-e9842dae9537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:28:24.784749 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972ef91d-f8e1-40b0-8980-e9842dae9537 admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:24.786955 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972ef91d-f8e1-40b0-8980-e9842dae9537 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:24.787299 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972ef91d-f8e1-40b0-8980-e9842dae9537 admin admin] PATH_INFO: `/v3/users` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:24.788084 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972ef91d-f8e1-40b0-8980-e9842dae9537 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:28:24.790173 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972ef91d-f8e1-40b0-8980-e9842dae9537 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:28:24.810846 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1253/2485] 10.222.0.70 () {60 vars in 1143 bytes} [Tue May 10 19:28:24 2022] POST /identity/v3/users => generated 282 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:28:24.814979 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbef563-2b70-48ef-97d7-8443e1718425 admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:28:24.826389 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbef563-2b70-48ef-97d7-8443e1718425 admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:28:24.831127 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aa51fd-d837-4c59-8979-00256e83b2c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:28:24.831791 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aa51fd-d837-4c59-8979-00256e83b2c6 admin admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:24.832076 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aa51fd-d837-4c59-8979-00256e83b2c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:24.832354 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aa51fd-d837-4c59-8979-00256e83b2c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:24.833099 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16aa51fd-d837-4c59-8979-00256e83b2c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:28:24.834873 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16aa51fd-d837-4c59-8979-00256e83b2c6 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:28:24.847430 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1233/2486] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:28:24 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:28:24.851630 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972ef91d-f8e1-40b0-8980-e9842dae9537 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:28:24.861770 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972ef91d-f8e1-40b0-8980-e9842dae9537 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:28:24.866596 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb7cded-5bfa-4ae0-9f80-c4489a4a46a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:28:24.867253 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb7cded-5bfa-4ae0-9f80-c4489a4a46a4 admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:24.867532 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb7cded-5bfa-4ae0-9f80-c4489a4a46a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:24.867808 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb7cded-5bfa-4ae0-9f80-c4489a4a46a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:24.869082 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb7cded-5bfa-4ae0-9f80-c4489a4a46a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:28:24.870680 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb7cded-5bfa-4ae0-9f80-c4489a4a46a4 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:28:24.880617 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1254/2487] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:28:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:28:24.885300 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aa51fd-d837-4c59-8979-00256e83b2c6 admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:28:24.895691 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aa51fd-d837-4c59-8979-00256e83b2c6 admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:28:24.901029 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c007792-0bd3-46d2-92ca-72b9b5428198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:28:24.901969 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c007792-0bd3-46d2-92ca-72b9b5428198 admin admin] REQUEST_METHOD: `PUT` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:24.902254 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c007792-0bd3-46d2-92ca-72b9b5428198 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:24.902527 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c007792-0bd3-46d2-92ca-72b9b5428198 admin admin] PATH_INFO: `/v3/projects/841bdc33137c4f26952f60aa95e113f0/users/92c60820bc6d4e90b3eb074aa90c2dfe/roles/5c07cf5bfbd3427db18428aa50420962` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:24.918052 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c007792-0bd3-46d2-92ca-72b9b5428198 admin admin] RBAC: Authorizing `identity:create_grant(project_id=841bdc33137c4f26952f60aa95e113f0, user_id=92c60820bc6d4e90b3eb074aa90c2dfe, role_id=5c07cf5bfbd3427db18428aa50420962)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:28:24.920985 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c007792-0bd3-46d2-92ca-72b9b5428198 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:28:24.933735 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1234/2488] 10.222.0.70 () {60 vars in 1482 bytes} [Tue May 10 19:28:24 2022] PUT /identity/v3/projects/841bdc33137c4f26952f60aa95e113f0/users/92c60820bc6d4e90b3eb074aa90c2dfe/roles/5c07cf5bfbd3427db18428aa50420962 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:28:24.944535 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb8fc73-fff4-4f16-8b73-ef5a267c493c None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:24.944831 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb8fc73-fff4-4f16-8b73-ef5a267c493c None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:24.945105 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb8fc73-fff4-4f16-8b73-ef5a267c493c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:24.973654 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-bfb8fc73-fff4-4f16-8b73-ef5a267c493c None None] MFA Rules not processed for user `92c60820bc6d4e90b3eb074aa90c2dfe`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:28:24.974862 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-bfb8fc73-fff4-4f16-8b73-ef5a267c493c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:28:25.038958 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1255/2489] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:28:24 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:28:25.044831 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c007792-0bd3-46d2-92ca-72b9b5428198 admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:28:25.112358 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c007792-0bd3-46d2-92ca-72b9b5428198 admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:28:25.117358 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c35687-98e0-4684-8be1-5bf442da274d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:28:25.118180 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c35687-98e0-4684-8be1-5bf442da274d admin admin] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:25.118489 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c35687-98e0-4684-8be1-5bf442da274d admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:25.118777 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c35687-98e0-4684-8be1-5bf442da274d admin admin] PATH_INFO: `/v3/projects` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:25.119474 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c35687-98e0-4684-8be1-5bf442da274d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:28:25.122261 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c35687-98e0-4684-8be1-5bf442da274d admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:28:25.162546 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1235/2490] 10.222.0.70 () {60 vars in 1152 bytes} [Tue May 10 19:28:25 2022] POST /identity/v3/projects => generated 365 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:28:25.167410 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb8fc73-fff4-4f16-8b73-ef5a267c493c None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:28:25.181820 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb8fc73-fff4-4f16-8b73-ef5a267c493c None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:28:25.262167 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c0cbaa-be7e-4fef-9704-87e03c0fe44b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:28:25.262869 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c0cbaa-be7e-4fef-9704-87e03c0fe44b admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:25.263842 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c0cbaa-be7e-4fef-9704-87e03c0fe44b admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:25.264331 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c0cbaa-be7e-4fef-9704-87e03c0fe44b admin admin] PATH_INFO: `/v3/users` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:25.266081 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c0cbaa-be7e-4fef-9704-87e03c0fe44b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:28:25.268780 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c0cbaa-be7e-4fef-9704-87e03c0fe44b admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:28:25.297664 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1256/2491] 10.222.0.70 () {60 vars in 1143 bytes} [Tue May 10 19:28:25 2022] POST /identity/v3/users => generated 289 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:28:25.301911 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c35687-98e0-4684-8be1-5bf442da274d admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:28:25.316085 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c35687-98e0-4684-8be1-5bf442da274d admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:28:25.324228 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f18646-1341-4bb3-adb7-a162f203e5aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:28:25.325275 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f18646-1341-4bb3-adb7-a162f203e5aa admin admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:25.325634 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f18646-1341-4bb3-adb7-a162f203e5aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:25.325983 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f18646-1341-4bb3-adb7-a162f203e5aa admin admin] PATH_INFO: `/v3/roles` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:25.326949 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f18646-1341-4bb3-adb7-a162f203e5aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:28:25.328763 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f18646-1341-4bb3-adb7-a162f203e5aa admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:28:25.342083 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1236/2492] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:28:25 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:28:25.346070 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c0cbaa-be7e-4fef-9704-87e03c0fe44b admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:28:25.359092 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c0cbaa-be7e-4fef-9704-87e03c0fe44b admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:28:25.366462 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0003405-543d-472e-9f3a-cdcf2334334d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:28:25.367803 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0003405-543d-472e-9f3a-cdcf2334334d admin admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:25.368179 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0003405-543d-472e-9f3a-cdcf2334334d admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:25.368697 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0003405-543d-472e-9f3a-cdcf2334334d admin admin] PATH_INFO: `/v3/projects/e6fe293d665245b490c0296f82887679/users/f23e76ca9f444ffc99a105497efa157e/roles/634ba284303b4626b5a0402772c68f5c` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:25.386837 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0003405-543d-472e-9f3a-cdcf2334334d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6fe293d665245b490c0296f82887679, user_id=f23e76ca9f444ffc99a105497efa157e, role_id=634ba284303b4626b5a0402772c68f5c)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:28:25.389539 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0003405-543d-472e-9f3a-cdcf2334334d admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:28:25.407996 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1257/2493] 10.222.0.70 () {60 vars in 1482 bytes} [Tue May 10 19:28:25 2022] PUT /identity/v3/projects/e6fe293d665245b490c0296f82887679/users/f23e76ca9f444ffc99a105497efa157e/roles/634ba284303b4626b5a0402772c68f5c => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 19:28:25.409973 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f18646-1341-4bb3-adb7-a162f203e5aa admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:28:25.420908 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f18646-1341-4bb3-adb7-a162f203e5aa admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:28:25.483352 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e1df6a-287b-4761-ad81-aefc21389f7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:28:25.484110 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e1df6a-287b-4761-ad81-aefc21389f7d admin admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:25.484513 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e1df6a-287b-4761-ad81-aefc21389f7d admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:25.484857 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e1df6a-287b-4761-ad81-aefc21389f7d admin admin] PATH_INFO: `/v3/roles` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:25.485642 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e1df6a-287b-4761-ad81-aefc21389f7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:28:25.487323 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e1df6a-287b-4761-ad81-aefc21389f7d admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:28:25.497826 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1237/2494] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:28:25 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:28:25.503301 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0003405-543d-472e-9f3a-cdcf2334334d admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:28:25.532448 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0003405-543d-472e-9f3a-cdcf2334334d admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:28:25.543024 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa44ee0-3f41-4610-ab4a-f9e98b2f3f2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:28:25.543945 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa44ee0-3f41-4610-ab4a-f9e98b2f3f2a admin admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:25.544250 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa44ee0-3f41-4610-ab4a-f9e98b2f3f2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:25.544503 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa44ee0-3f41-4610-ab4a-f9e98b2f3f2a admin admin] PATH_INFO: `/v3/projects/e6fe293d665245b490c0296f82887679/users/f23e76ca9f444ffc99a105497efa157e/roles/634ba284303b4626b5a0402772c68f5c` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:25.548371 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa44ee0-3f41-4610-ab4a-f9e98b2f3f2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6fe293d665245b490c0296f82887679, user_id=f23e76ca9f444ffc99a105497efa157e, role_id=634ba284303b4626b5a0402772c68f5c)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:28:25.551384 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa44ee0-3f41-4610-ab4a-f9e98b2f3f2a admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:28:25.568754 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1258/2495] 10.222.0.70 () {60 vars in 1482 bytes} [Tue May 10 19:28:25 2022] PUT /identity/v3/projects/e6fe293d665245b490c0296f82887679/users/f23e76ca9f444ffc99a105497efa157e/roles/634ba284303b4626b5a0402772c68f5c => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:28:25.578072 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f542a309-193f-4c02-bf86-efc338c738fe None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:25.578368 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f542a309-193f-4c02-bf86-efc338c738fe None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:25.578646 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f542a309-193f-4c02-bf86-efc338c738fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:25.608156 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-f542a309-193f-4c02-bf86-efc338c738fe None None] MFA Rules not processed for user `f23e76ca9f444ffc99a105497efa157e`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:28:25.609678 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-f542a309-193f-4c02-bf86-efc338c738fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:28:25.689039 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1238/2496] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:28:25 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:28:25.700555 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa44ee0-3f41-4610-ab4a-f9e98b2f3f2a admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:28:25.702423 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-1aa44ee0-3f41-4610-ab4a-f9e98b2f3f2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:28:25.762834 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa44ee0-3f41-4610-ab4a-f9e98b2f3f2a admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:28:25.767017 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c0ebff-ff88-487b-a38a-23a600636d79 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15df2a8967aa43299c10e365f4200d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:28:25.767414 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c0ebff-ff88-487b-a38a-23a600636d79 service cinder] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:25.767699 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c0ebff-ff88-487b-a38a-23a600636d79 service cinder] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:25.767978 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c0ebff-ff88-487b-a38a-23a600636d79 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:25.778945 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c0ebff-ff88-487b-a38a-23a600636d79 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:28:25.780399 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c0ebff-ff88-487b-a38a-23a600636d79 service cinder] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:28:25.791272 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1259/2497] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:28:25 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:28:26.232345 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f542a309-193f-4c02-bf86-efc338c738fe None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:28:26.300191 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f542a309-193f-4c02-bf86-efc338c738fe None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:28:26.305197 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd37ecd-f197-4996-ae8f-62cf76163bad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:28:26.306720 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd37ecd-f197-4996-ae8f-62cf76163bad admin admin] REQUEST_METHOD: `DELETE` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:26.307004 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd37ecd-f197-4996-ae8f-62cf76163bad admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:26.307277 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd37ecd-f197-4996-ae8f-62cf76163bad admin admin] PATH_INFO: `/v3/users/92c60820bc6d4e90b3eb074aa90c2dfe` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:26.308568 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd37ecd-f197-4996-ae8f-62cf76163bad admin admin] RBAC: Authorizing `identity:delete_user(user_id=92c60820bc6d4e90b3eb074aa90c2dfe)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:28:26.310528 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd37ecd-f197-4996-ae8f-62cf76163bad admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:28:26.360841 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-cbd37ecd-f197-4996-ae8f-62cf76163bad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92c60820bc6d4e90b3eb074aa90c2dfe'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:26.374095 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-cbd37ecd-f197-4996-ae8f-62cf76163bad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92c60820bc6d4e90b3eb074aa90c2dfe'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:26.380818 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-cbd37ecd-f197-4996-ae8f-62cf76163bad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92c60820bc6d4e90b3eb074aa90c2dfe'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:26.381560 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-cbd37ecd-f197-4996-ae8f-62cf76163bad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92c60820bc6d4e90b3eb074aa90c2dfe'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:26.390361 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-cbd37ecd-f197-4996-ae8f-62cf76163bad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92c60820bc6d4e90b3eb074aa90c2dfe'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:26.396786 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1239/2498] 10.222.0.70 () {58 vars in 1223 bytes} [Tue May 10 19:28:26 2022] DELETE /identity/v3/users/92c60820bc6d4e90b3eb074aa90c2dfe => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:28:26.401540 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266afe2c-a19e-4253-9d16-2c1bc07b7b1b None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:26.402055 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266afe2c-a19e-4253-9d16-2c1bc07b7b1b None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:26.402413 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266afe2c-a19e-4253-9d16-2c1bc07b7b1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:26.421498 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-266afe2c-a19e-4253-9d16-2c1bc07b7b1b None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:28:26.422793 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-266afe2c-a19e-4253-9d16-2c1bc07b7b1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:28:26.484191 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1260/2499] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:28:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:28:26.494699 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd37ecd-f197-4996-ae8f-62cf76163bad admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:28:26.496087 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-cbd37ecd-f197-4996-ae8f-62cf76163bad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:28:26.563261 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd37ecd-f197-4996-ae8f-62cf76163bad admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:28:26.567279 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b870929-4ed9-47d8-88e7-683ffc15bc9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f1dc79540b48c0866478cc48cd8205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:28:26.567958 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b870929-4ed9-47d8-88e7-683ffc15bc9f service neutron] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:26.568287 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b870929-4ed9-47d8-88e7-683ffc15bc9f service neutron] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:26.568868 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b870929-4ed9-47d8-88e7-683ffc15bc9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:26.578191 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b870929-4ed9-47d8-88e7-683ffc15bc9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:28:26.579638 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b870929-4ed9-47d8-88e7-683ffc15bc9f service neutron] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:28:26.589812 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1240/2500] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:28:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:28:26.879663 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266afe2c-a19e-4253-9d16-2c1bc07b7b1b None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:28:26.881844 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-266afe2c-a19e-4253-9d16-2c1bc07b7b1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:28:26.904917 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266afe2c-a19e-4253-9d16-2c1bc07b7b1b None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:28:26.909587 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61210200-e4c0-4856-bd21-eea69b6902fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:28:26.910476 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61210200-e4c0-4856-bd21-eea69b6902fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:26.910793 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61210200-e4c0-4856-bd21-eea69b6902fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:26.911048 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61210200-e4c0-4856-bd21-eea69b6902fd admin admin] PATH_INFO: `/v3/projects/841bdc33137c4f26952f60aa95e113f0` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:26.912267 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61210200-e4c0-4856-bd21-eea69b6902fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=841bdc33137c4f26952f60aa95e113f0)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:28:26.914368 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61210200-e4c0-4856-bd21-eea69b6902fd admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:28:26.973661 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-61210200-e4c0-4856-bd21-eea69b6902fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '841bdc33137c4f26952f60aa95e113f0', 'request_id': 'req-61210200-e4c0-4856-bd21-eea69b6902fd'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:26.982407 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-61210200-e4c0-4856-bd21-eea69b6902fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '841bdc33137c4f26952f60aa95e113f0', 'request_id': 'req-61210200-e4c0-4856-bd21-eea69b6902fd'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:26.990918 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-61210200-e4c0-4856-bd21-eea69b6902fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '841bdc33137c4f26952f60aa95e113f0', 'request_id': 'req-61210200-e4c0-4856-bd21-eea69b6902fd'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:27.007104 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-61210200-e4c0-4856-bd21-eea69b6902fd admin admin] The token cache is being invalidate because project 841bdc33137c4f26952f60aa95e113f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79994) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:28:27.007520 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-61210200-e4c0-4856-bd21-eea69b6902fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:27.008308 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-61210200-e4c0-4856-bd21-eea69b6902fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:27.011255 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1261/2501] 10.222.0.70 () {58 vars in 1232 bytes} [Tue May 10 19:28:26 2022] DELETE /identity/v3/projects/841bdc33137c4f26952f60aa95e113f0 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:28:27.015461 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b870929-4ed9-47d8-88e7-683ffc15bc9f service neutron] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:28:27.030563 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b870929-4ed9-47d8-88e7-683ffc15bc9f service neutron] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:28:27.092245 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d690fb99-e2d8-45a2-acb4-412613663d62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:28:27.093158 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d690fb99-e2d8-45a2-acb4-412613663d62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:27.093442 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d690fb99-e2d8-45a2-acb4-412613663d62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:27.093717 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d690fb99-e2d8-45a2-acb4-412613663d62 admin admin] PATH_INFO: `/v3/users/f23e76ca9f444ffc99a105497efa157e` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:27.094896 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d690fb99-e2d8-45a2-acb4-412613663d62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f23e76ca9f444ffc99a105497efa157e)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:28:27.096883 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d690fb99-e2d8-45a2-acb4-412613663d62 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:28:27.142713 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-d690fb99-e2d8-45a2-acb4-412613663d62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f23e76ca9f444ffc99a105497efa157e'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:27.153955 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-d690fb99-e2d8-45a2-acb4-412613663d62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f23e76ca9f444ffc99a105497efa157e'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:27.160464 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-d690fb99-e2d8-45a2-acb4-412613663d62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f23e76ca9f444ffc99a105497efa157e'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:27.161171 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-d690fb99-e2d8-45a2-acb4-412613663d62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f23e76ca9f444ffc99a105497efa157e'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:27.168798 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-d690fb99-e2d8-45a2-acb4-412613663d62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f23e76ca9f444ffc99a105497efa157e'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:27.174867 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1241/2502] 10.222.0.70 () {58 vars in 1223 bytes} [Tue May 10 19:28:27 2022] DELETE /identity/v3/users/f23e76ca9f444ffc99a105497efa157e => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:28:27.459590 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61210200-e4c0-4856-bd21-eea69b6902fd admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:28:27.461178 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-61210200-e4c0-4856-bd21-eea69b6902fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:28:27.477505 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61210200-e4c0-4856-bd21-eea69b6902fd admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:28:27.549789 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463787c1-e229-447f-b921-d8c649a8995f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:28:27.550659 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463787c1-e229-447f-b921-d8c649a8995f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:27.550939 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463787c1-e229-447f-b921-d8c649a8995f admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:27.551227 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463787c1-e229-447f-b921-d8c649a8995f admin admin] PATH_INFO: `/v3/projects/e6fe293d665245b490c0296f82887679` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:27.552448 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463787c1-e229-447f-b921-d8c649a8995f admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6fe293d665245b490c0296f82887679)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:28:27.554564 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463787c1-e229-447f-b921-d8c649a8995f admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:28:27.609440 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-463787c1-e229-447f-b921-d8c649a8995f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6fe293d665245b490c0296f82887679', 'request_id': 'req-463787c1-e229-447f-b921-d8c649a8995f'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:27.615236 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-463787c1-e229-447f-b921-d8c649a8995f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6fe293d665245b490c0296f82887679', 'request_id': 'req-463787c1-e229-447f-b921-d8c649a8995f'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:27.630257 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-463787c1-e229-447f-b921-d8c649a8995f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6fe293d665245b490c0296f82887679', 'request_id': 'req-463787c1-e229-447f-b921-d8c649a8995f'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:27.651591 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-463787c1-e229-447f-b921-d8c649a8995f admin admin] The token cache is being invalidate because project e6fe293d665245b490c0296f82887679 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79994) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:28:27.651875 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-463787c1-e229-447f-b921-d8c649a8995f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:27.652564 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-463787c1-e229-447f-b921-d8c649a8995f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:27.654115 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1262/2503] 10.222.0.70 () {58 vars in 1232 bytes} [Tue May 10 19:28:27 2022] DELETE /identity/v3/projects/e6fe293d665245b490c0296f82887679 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:28:27.659109 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4da3cf-571f-4311-ba7a-41f520f53340 None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:27.660227 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4da3cf-571f-4311-ba7a-41f520f53340 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:27.660754 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4da3cf-571f-4311-ba7a-41f520f53340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:27.684990 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-1f4da3cf-571f-4311-ba7a-41f520f53340 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:28:27.686214 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-1f4da3cf-571f-4311-ba7a-41f520f53340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:28:27.748410 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1242/2504] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:28:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:28:27.756819 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1fedac-0f8c-4d33-ae6d-94071639c10e None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:27.757336 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1fedac-0f8c-4d33-ae6d-94071639c10e None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:27.761153 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1fedac-0f8c-4d33-ae6d-94071639c10e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:27.786170 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-cb1fedac-0f8c-4d33-ae6d-94071639c10e None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:28:27.788131 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-cb1fedac-0f8c-4d33-ae6d-94071639c10e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:28:27.802909 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4da3cf-571f-4311-ba7a-41f520f53340 None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:28:27.803663 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1263/2505] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:28:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:28:27.820715 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4da3cf-571f-4311-ba7a-41f520f53340 None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:28:27.834508 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cb29b8-fe68-4ab0-ad63-2346276ee4c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:28:27.835297 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cb29b8-fe68-4ab0-ad63-2346276ee4c9 admin admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:27.835968 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cb29b8-fe68-4ab0-ad63-2346276ee4c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:27.835968 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cb29b8-fe68-4ab0-ad63-2346276ee4c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:27.838031 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cb29b8-fe68-4ab0-ad63-2346276ee4c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:28:27.838437 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cb29b8-fe68-4ab0-ad63-2346276ee4c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:28:27.840205 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cb29b8-fe68-4ab0-ad63-2346276ee4c9 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:28:27.854528 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1243/2506] 10.222.0.70 () {58 vars in 1152 bytes} [Tue May 10 19:28:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:28:27.859321 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1fedac-0f8c-4d33-ae6d-94071639c10e None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:28:27.872124 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1fedac-0f8c-4d33-ae6d-94071639c10e None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:28:27.878288 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb301f5-897e-464d-9e39-da6c3cd8f83a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:28:27.879121 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb301f5-897e-464d-9e39-da6c3cd8f83a admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:27.879473 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb301f5-897e-464d-9e39-da6c3cd8f83a admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:27.879831 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb301f5-897e-464d-9e39-da6c3cd8f83a admin admin] PATH_INFO: `/v3/projects` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:27.880631 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb301f5-897e-464d-9e39-da6c3cd8f83a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:28:27.882605 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb301f5-897e-464d-9e39-da6c3cd8f83a admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:28:27.923211 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1264/2507] 10.222.0.70 () {60 vars in 1152 bytes} [Tue May 10 19:28:27 2022] POST /identity/v3/projects => generated 385 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:28:27.924396 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cb29b8-fe68-4ab0-ad63-2346276ee4c9 admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:28:27.935522 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cb29b8-fe68-4ab0-ad63-2346276ee4c9 admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:28:28.014590 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197ea2c7-51dd-4e45-bcee-3f7dbd92cc33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:28:28.015511 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197ea2c7-51dd-4e45-bcee-3f7dbd92cc33 admin admin] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:28.015966 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197ea2c7-51dd-4e45-bcee-3f7dbd92cc33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:28.016445 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197ea2c7-51dd-4e45-bcee-3f7dbd92cc33 admin admin] PATH_INFO: `/v3/users` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:28.017307 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197ea2c7-51dd-4e45-bcee-3f7dbd92cc33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:28:28.019452 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197ea2c7-51dd-4e45-bcee-3f7dbd92cc33 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:28:28.042293 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1244/2508] 10.222.0.70 () {60 vars in 1143 bytes} [Tue May 10 19:28:27 2022] POST /identity/v3/users => generated 293 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:28:28.048305 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb301f5-897e-464d-9e39-da6c3cd8f83a admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:28:28.062642 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb301f5-897e-464d-9e39-da6c3cd8f83a admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:28:28.067726 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ec4376-486f-474a-bf11-14fbad0a98ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:28:28.068860 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ec4376-486f-474a-bf11-14fbad0a98ef admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:28.069146 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ec4376-486f-474a-bf11-14fbad0a98ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:28.069423 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ec4376-486f-474a-bf11-14fbad0a98ef admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:28.070169 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ec4376-486f-474a-bf11-14fbad0a98ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:28:28.073199 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ec4376-486f-474a-bf11-14fbad0a98ef admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:28:28.092565 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1265/2509] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:28:28 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:28:28.093744 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197ea2c7-51dd-4e45-bcee-3f7dbd92cc33 admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:28:28.104631 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197ea2c7-51dd-4e45-bcee-3f7dbd92cc33 admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:28:28.109678 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed4a38b-8df0-4f4d-b94d-e3aa11fd4f16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:28:28.110441 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed4a38b-8df0-4f4d-b94d-e3aa11fd4f16 admin admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:28.110729 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed4a38b-8df0-4f4d-b94d-e3aa11fd4f16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:28.111005 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed4a38b-8df0-4f4d-b94d-e3aa11fd4f16 admin admin] PATH_INFO: `/v3/roles` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:28.111726 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed4a38b-8df0-4f4d-b94d-e3aa11fd4f16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:28:28.113354 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed4a38b-8df0-4f4d-b94d-e3aa11fd4f16 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:28:28.123806 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1245/2510] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:28:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:28:28.128160 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ec4376-486f-474a-bf11-14fbad0a98ef admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:28:28.138057 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ec4376-486f-474a-bf11-14fbad0a98ef admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:28:28.142674 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb97d06e-1d87-422d-bc7d-fb105f3902d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:28:28.143560 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb97d06e-1d87-422d-bc7d-fb105f3902d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:28.143839 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb97d06e-1d87-422d-bc7d-fb105f3902d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:28.144113 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb97d06e-1d87-422d-bc7d-fb105f3902d0 admin admin] PATH_INFO: `/v3/projects/297d556cbabb4d0b8408984e0a079c55/users/f0a4b000bbf74dfaa3140a40759a9b31/roles/5c07cf5bfbd3427db18428aa50420962` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:28.159139 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb97d06e-1d87-422d-bc7d-fb105f3902d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=297d556cbabb4d0b8408984e0a079c55, user_id=f0a4b000bbf74dfaa3140a40759a9b31, role_id=5c07cf5bfbd3427db18428aa50420962)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:28:28.161861 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb97d06e-1d87-422d-bc7d-fb105f3902d0 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:28:28.176530 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1266/2511] 10.222.0.70 () {60 vars in 1482 bytes} [Tue May 10 19:28:28 2022] PUT /identity/v3/projects/297d556cbabb4d0b8408984e0a079c55/users/f0a4b000bbf74dfaa3140a40759a9b31/roles/5c07cf5bfbd3427db18428aa50420962 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:28:28.187654 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e82b75-275f-4c5b-b2cf-b08c14a5a055 None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:28.187948 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e82b75-275f-4c5b-b2cf-b08c14a5a055 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:28.188221 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e82b75-275f-4c5b-b2cf-b08c14a5a055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:28.215351 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-63e82b75-275f-4c5b-b2cf-b08c14a5a055 None None] MFA Rules not processed for user `f0a4b000bbf74dfaa3140a40759a9b31`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:28:28.217973 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-63e82b75-275f-4c5b-b2cf-b08c14a5a055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:28:28.283006 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1246/2512] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:28:28 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:28:28.287356 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb97d06e-1d87-422d-bc7d-fb105f3902d0 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:28:28.355686 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb97d06e-1d87-422d-bc7d-fb105f3902d0 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:28:28.360539 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f207b7bf-c076-441e-ab46-62d58a739f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:28:28.361201 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f207b7bf-c076-441e-ab46-62d58a739f05 admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:28.361481 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f207b7bf-c076-441e-ab46-62d58a739f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:28.361756 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f207b7bf-c076-441e-ab46-62d58a739f05 admin admin] PATH_INFO: `/v3/projects` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:28.362451 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f207b7bf-c076-441e-ab46-62d58a739f05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:28:28.364437 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f207b7bf-c076-441e-ab46-62d58a739f05 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:28:28.389025 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1267/2513] 10.222.0.70 () {60 vars in 1152 bytes} [Tue May 10 19:28:28 2022] POST /identity/v3/projects => generated 387 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:28:28.393048 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e82b75-275f-4c5b-b2cf-b08c14a5a055 None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:28:28.403467 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e82b75-275f-4c5b-b2cf-b08c14a5a055 None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:28:28.458706 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6f6914-bdde-4d61-9d45-e085bf976e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:28:28.459381 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6f6914-bdde-4d61-9d45-e085bf976e2f admin admin] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:28.459669 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6f6914-bdde-4d61-9d45-e085bf976e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:28.459942 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6f6914-bdde-4d61-9d45-e085bf976e2f admin admin] PATH_INFO: `/v3/users` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:28.460663 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6f6914-bdde-4d61-9d45-e085bf976e2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:28:28.462611 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6f6914-bdde-4d61-9d45-e085bf976e2f admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:28:28.481853 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1247/2514] 10.222.0.70 () {60 vars in 1143 bytes} [Tue May 10 19:28:28 2022] POST /identity/v3/users => generated 300 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:28:28.486067 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f207b7bf-c076-441e-ab46-62d58a739f05 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:28:28.497682 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f207b7bf-c076-441e-ab46-62d58a739f05 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:28:28.502859 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f57f30-af0b-405e-a3d4-41330a701c9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:28:28.503520 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f57f30-af0b-405e-a3d4-41330a701c9c admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:28.503805 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f57f30-af0b-405e-a3d4-41330a701c9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:28.504081 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f57f30-af0b-405e-a3d4-41330a701c9c admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:28.504844 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f57f30-af0b-405e-a3d4-41330a701c9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:28:28.506433 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f57f30-af0b-405e-a3d4-41330a701c9c admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:28:28.517732 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1268/2515] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:28:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:28:28.522116 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6f6914-bdde-4d61-9d45-e085bf976e2f admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:28:28.532302 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6f6914-bdde-4d61-9d45-e085bf976e2f admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:28:28.536964 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296a200d-02b8-4ba3-8b18-aa565717d048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:28:28.537845 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296a200d-02b8-4ba3-8b18-aa565717d048 admin admin] REQUEST_METHOD: `PUT` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:28.538129 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296a200d-02b8-4ba3-8b18-aa565717d048 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:28.538405 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296a200d-02b8-4ba3-8b18-aa565717d048 admin admin] PATH_INFO: `/v3/projects/00504f6add3240148279650ac7b0b189/users/ca70b284c1ad4ff89722c167b72606a8/roles/634ba284303b4626b5a0402772c68f5c` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:28.553369 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296a200d-02b8-4ba3-8b18-aa565717d048 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00504f6add3240148279650ac7b0b189, user_id=ca70b284c1ad4ff89722c167b72606a8, role_id=634ba284303b4626b5a0402772c68f5c)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:28:28.556609 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296a200d-02b8-4ba3-8b18-aa565717d048 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:28:28.569214 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1248/2516] 10.222.0.70 () {60 vars in 1482 bytes} [Tue May 10 19:28:28 2022] PUT /identity/v3/projects/00504f6add3240148279650ac7b0b189/users/ca70b284c1ad4ff89722c167b72606a8/roles/634ba284303b4626b5a0402772c68f5c => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:28:28.573674 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f57f30-af0b-405e-a3d4-41330a701c9c admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:28:28.583454 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f57f30-af0b-405e-a3d4-41330a701c9c admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:28:28.647673 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f283f0d-5c7d-414a-9802-1999c6c2c266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:28:28.648476 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f283f0d-5c7d-414a-9802-1999c6c2c266 admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:28.648699 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f283f0d-5c7d-414a-9802-1999c6c2c266 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:28.648931 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f283f0d-5c7d-414a-9802-1999c6c2c266 admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:28.650160 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f283f0d-5c7d-414a-9802-1999c6c2c266 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:28:28.651757 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f283f0d-5c7d-414a-9802-1999c6c2c266 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:28:28.661523 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1269/2517] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:28:28 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:28:28.666509 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296a200d-02b8-4ba3-8b18-aa565717d048 admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:28:28.678265 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296a200d-02b8-4ba3-8b18-aa565717d048 admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:28:28.683055 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f10760-c97b-4c2d-9330-30cefddc3acd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:28:28.683935 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f10760-c97b-4c2d-9330-30cefddc3acd admin admin] REQUEST_METHOD: `PUT` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:28.684248 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f10760-c97b-4c2d-9330-30cefddc3acd admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:28.684564 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f10760-c97b-4c2d-9330-30cefddc3acd admin admin] PATH_INFO: `/v3/projects/00504f6add3240148279650ac7b0b189/users/ca70b284c1ad4ff89722c167b72606a8/roles/634ba284303b4626b5a0402772c68f5c` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:28.686579 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f10760-c97b-4c2d-9330-30cefddc3acd admin admin] RBAC: Authorizing `identity:create_grant(project_id=00504f6add3240148279650ac7b0b189, user_id=ca70b284c1ad4ff89722c167b72606a8, role_id=634ba284303b4626b5a0402772c68f5c)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:28:28.689262 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f10760-c97b-4c2d-9330-30cefddc3acd admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:28:28.699900 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1249/2518] 10.222.0.70 () {60 vars in 1482 bytes} [Tue May 10 19:28:28 2022] PUT /identity/v3/projects/00504f6add3240148279650ac7b0b189/users/ca70b284c1ad4ff89722c167b72606a8/roles/634ba284303b4626b5a0402772c68f5c => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:28:28.709868 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f43620-cc62-436d-a1a3-e9faf54051c8 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:28.710155 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f43620-cc62-436d-a1a3-e9faf54051c8 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:28.710433 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f43620-cc62-436d-a1a3-e9faf54051c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:28.736572 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-f3f43620-cc62-436d-a1a3-e9faf54051c8 None None] MFA Rules not processed for user `ca70b284c1ad4ff89722c167b72606a8`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:28:28.737758 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-f3f43620-cc62-436d-a1a3-e9faf54051c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:28:28.801962 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1270/2519] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:28:28 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:28:28.812853 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f10760-c97b-4c2d-9330-30cefddc3acd admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:28:28.814576 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-45f10760-c97b-4c2d-9330-30cefddc3acd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:28:28.869174 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f10760-c97b-4c2d-9330-30cefddc3acd admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:28:28.872739 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94bb734-6fed-4b0c-a9c5-d0498436b3ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15df2a8967aa43299c10e365f4200d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:28:28.873369 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94bb734-6fed-4b0c-a9c5-d0498436b3ed service cinder] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:28.873654 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94bb734-6fed-4b0c-a9c5-d0498436b3ed service cinder] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:28.873925 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94bb734-6fed-4b0c-a9c5-d0498436b3ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:28.885198 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94bb734-6fed-4b0c-a9c5-d0498436b3ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:28:28.886778 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94bb734-6fed-4b0c-a9c5-d0498436b3ed service cinder] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:28:28.896595 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1250/2520] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:28:28 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:28:28.924721 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f43620-cc62-436d-a1a3-e9faf54051c8 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:28:28.985536 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f43620-cc62-436d-a1a3-e9faf54051c8 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:28:28.990111 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096815cd-e5ce-4109-bc49-2fd9064154eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:28:28.990984 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096815cd-e5ce-4109-bc49-2fd9064154eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:28.991270 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096815cd-e5ce-4109-bc49-2fd9064154eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:28.991544 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096815cd-e5ce-4109-bc49-2fd9064154eb admin admin] PATH_INFO: `/v3/users/f0a4b000bbf74dfaa3140a40759a9b31` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:28.992827 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096815cd-e5ce-4109-bc49-2fd9064154eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0a4b000bbf74dfaa3140a40759a9b31)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:28:28.994746 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096815cd-e5ce-4109-bc49-2fd9064154eb admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:28:29.039667 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-096815cd-e5ce-4109-bc49-2fd9064154eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0a4b000bbf74dfaa3140a40759a9b31'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:29.051270 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-096815cd-e5ce-4109-bc49-2fd9064154eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0a4b000bbf74dfaa3140a40759a9b31'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:29.051954 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-096815cd-e5ce-4109-bc49-2fd9064154eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0a4b000bbf74dfaa3140a40759a9b31'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:29.059442 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-096815cd-e5ce-4109-bc49-2fd9064154eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0a4b000bbf74dfaa3140a40759a9b31'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:29.066045 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-096815cd-e5ce-4109-bc49-2fd9064154eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0a4b000bbf74dfaa3140a40759a9b31'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:29.072616 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1271/2521] 10.222.0.70 () {58 vars in 1223 bytes} [Tue May 10 19:28:28 2022] DELETE /identity/v3/users/f0a4b000bbf74dfaa3140a40759a9b31 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:28:29.077218 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdbea84-2b51-41a1-80f8-a1f6e8beff69 None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:29.077513 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdbea84-2b51-41a1-80f8-a1f6e8beff69 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:29.077796 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdbea84-2b51-41a1-80f8-a1f6e8beff69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:29.096137 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-3fdbea84-2b51-41a1-80f8-a1f6e8beff69 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:28:29.097393 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-3fdbea84-2b51-41a1-80f8-a1f6e8beff69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:28:29.155038 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1251/2522] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:28:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:28:29.164667 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096815cd-e5ce-4109-bc49-2fd9064154eb admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:28:29.166087 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-096815cd-e5ce-4109-bc49-2fd9064154eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:28:29.220183 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096815cd-e5ce-4109-bc49-2fd9064154eb admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:28:29.223841 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea82017-4bcf-4394-987f-0198e0fb82ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f1dc79540b48c0866478cc48cd8205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:28:29.224500 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea82017-4bcf-4394-987f-0198e0fb82ed service neutron] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:29.224782 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea82017-4bcf-4394-987f-0198e0fb82ed service neutron] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:29.225050 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea82017-4bcf-4394-987f-0198e0fb82ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:29.233670 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea82017-4bcf-4394-987f-0198e0fb82ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:28:29.235090 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea82017-4bcf-4394-987f-0198e0fb82ed service neutron] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:28:29.244173 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1272/2523] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:28:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:28:29.523712 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdbea84-2b51-41a1-80f8-a1f6e8beff69 None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:28:29.525915 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-3fdbea84-2b51-41a1-80f8-a1f6e8beff69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:28:29.542671 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdbea84-2b51-41a1-80f8-a1f6e8beff69 None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:28:29.549114 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab662c6b-bb60-44e4-a216-669e8ce1f27d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:28:29.550093 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab662c6b-bb60-44e4-a216-669e8ce1f27d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:29.550441 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab662c6b-bb60-44e4-a216-669e8ce1f27d admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:29.550770 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab662c6b-bb60-44e4-a216-669e8ce1f27d admin admin] PATH_INFO: `/v3/projects/297d556cbabb4d0b8408984e0a079c55` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:29.552188 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab662c6b-bb60-44e4-a216-669e8ce1f27d admin admin] RBAC: Authorizing `identity:delete_project(project_id=297d556cbabb4d0b8408984e0a079c55)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:28:29.554420 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab662c6b-bb60-44e4-a216-669e8ce1f27d admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:28:29.602809 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-ab662c6b-bb60-44e4-a216-669e8ce1f27d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '297d556cbabb4d0b8408984e0a079c55', 'request_id': 'req-ab662c6b-bb60-44e4-a216-669e8ce1f27d'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:29.609182 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-ab662c6b-bb60-44e4-a216-669e8ce1f27d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '297d556cbabb4d0b8408984e0a079c55', 'request_id': 'req-ab662c6b-bb60-44e4-a216-669e8ce1f27d'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:29.617375 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-ab662c6b-bb60-44e4-a216-669e8ce1f27d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '297d556cbabb4d0b8408984e0a079c55', 'request_id': 'req-ab662c6b-bb60-44e4-a216-669e8ce1f27d'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:29.629266 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-ab662c6b-bb60-44e4-a216-669e8ce1f27d admin admin] The token cache is being invalidate because project 297d556cbabb4d0b8408984e0a079c55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79993) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:28:29.629556 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-ab662c6b-bb60-44e4-a216-669e8ce1f27d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:29.630203 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-ab662c6b-bb60-44e4-a216-669e8ce1f27d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:29.631762 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1252/2524] 10.222.0.70 () {58 vars in 1232 bytes} [Tue May 10 19:28:29 2022] DELETE /identity/v3/projects/297d556cbabb4d0b8408984e0a079c55 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:28:29.636354 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea82017-4bcf-4394-987f-0198e0fb82ed service neutron] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:28:29.646074 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea82017-4bcf-4394-987f-0198e0fb82ed service neutron] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:28:29.701052 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1986e1-df72-4017-97cc-8e2f07f85129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:28:29.701929 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1986e1-df72-4017-97cc-8e2f07f85129 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:29.702213 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1986e1-df72-4017-97cc-8e2f07f85129 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:29.702491 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1986e1-df72-4017-97cc-8e2f07f85129 admin admin] PATH_INFO: `/v3/users/ca70b284c1ad4ff89722c167b72606a8` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:29.703674 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1986e1-df72-4017-97cc-8e2f07f85129 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca70b284c1ad4ff89722c167b72606a8)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:28:29.705620 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1986e1-df72-4017-97cc-8e2f07f85129 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:28:29.750980 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-cb1986e1-df72-4017-97cc-8e2f07f85129 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca70b284c1ad4ff89722c167b72606a8'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:29.762780 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-cb1986e1-df72-4017-97cc-8e2f07f85129 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca70b284c1ad4ff89722c167b72606a8'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:29.763444 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-cb1986e1-df72-4017-97cc-8e2f07f85129 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca70b284c1ad4ff89722c167b72606a8'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:29.771868 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-cb1986e1-df72-4017-97cc-8e2f07f85129 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca70b284c1ad4ff89722c167b72606a8'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:29.779264 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-cb1986e1-df72-4017-97cc-8e2f07f85129 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca70b284c1ad4ff89722c167b72606a8'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:29.785011 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1273/2525] 10.222.0.70 () {58 vars in 1223 bytes} [Tue May 10 19:28:29 2022] DELETE /identity/v3/users/ca70b284c1ad4ff89722c167b72606a8 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:28:30.057464 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab662c6b-bb60-44e4-a216-669e8ce1f27d admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:28:30.059018 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-ab662c6b-bb60-44e4-a216-669e8ce1f27d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:28:30.074799 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab662c6b-bb60-44e4-a216-669e8ce1f27d admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:28:30.132143 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199e0425-34b4-4590-bfb0-c24e41512c55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:28:30.132958 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199e0425-34b4-4590-bfb0-c24e41512c55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:30.133246 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199e0425-34b4-4590-bfb0-c24e41512c55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:30.133523 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199e0425-34b4-4590-bfb0-c24e41512c55 admin admin] PATH_INFO: `/v3/projects/00504f6add3240148279650ac7b0b189` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:30.135273 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199e0425-34b4-4590-bfb0-c24e41512c55 admin admin] RBAC: Authorizing `identity:delete_project(project_id=00504f6add3240148279650ac7b0b189)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:28:30.137221 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199e0425-34b4-4590-bfb0-c24e41512c55 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:28:30.182945 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-199e0425-34b4-4590-bfb0-c24e41512c55 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00504f6add3240148279650ac7b0b189', 'request_id': 'req-199e0425-34b4-4590-bfb0-c24e41512c55'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:30.188163 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-199e0425-34b4-4590-bfb0-c24e41512c55 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00504f6add3240148279650ac7b0b189', 'request_id': 'req-199e0425-34b4-4590-bfb0-c24e41512c55'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:30.196318 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-199e0425-34b4-4590-bfb0-c24e41512c55 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00504f6add3240148279650ac7b0b189', 'request_id': 'req-199e0425-34b4-4590-bfb0-c24e41512c55'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:30.207731 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-199e0425-34b4-4590-bfb0-c24e41512c55 admin admin] The token cache is being invalidate because project 00504f6add3240148279650ac7b0b189 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79993) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:28:30.208018 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-199e0425-34b4-4590-bfb0-c24e41512c55 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:30.208678 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-199e0425-34b4-4590-bfb0-c24e41512c55 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:30.210323 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1253/2526] 10.222.0.70 () {58 vars in 1232 bytes} [Tue May 10 19:28:30 2022] DELETE /identity/v3/projects/00504f6add3240148279650ac7b0b189 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:28:30.215338 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae4b553-7c2e-4955-b93a-3cd7e9670eaf None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:30.215627 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae4b553-7c2e-4955-b93a-3cd7e9670eaf None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:30.215913 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae4b553-7c2e-4955-b93a-3cd7e9670eaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:30.233042 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-bae4b553-7c2e-4955-b93a-3cd7e9670eaf None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:28:30.234251 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-bae4b553-7c2e-4955-b93a-3cd7e9670eaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:28:30.296374 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1274/2527] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:28:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:28:30.304647 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1795d485-c2ba-4023-a6f3-23a98f2d038e None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:30.304935 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1795d485-c2ba-4023-a6f3-23a98f2d038e None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:30.305213 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1795d485-c2ba-4023-a6f3-23a98f2d038e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:30.324310 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-1795d485-c2ba-4023-a6f3-23a98f2d038e None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:28:30.325524 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-1795d485-c2ba-4023-a6f3-23a98f2d038e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:28:30.333233 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1254/2528] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:28:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:28:30.337327 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae4b553-7c2e-4955-b93a-3cd7e9670eaf None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:28:30.346873 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae4b553-7c2e-4955-b93a-3cd7e9670eaf None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:28:30.351492 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac5ba0a-03a3-4868-8096-e9163245cf42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:28:30.352148 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac5ba0a-03a3-4868-8096-e9163245cf42 admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:30.352463 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac5ba0a-03a3-4868-8096-e9163245cf42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:30.352735 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac5ba0a-03a3-4868-8096-e9163245cf42 admin admin] PATH_INFO: `/v3/domains` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:30.353453 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac5ba0a-03a3-4868-8096-e9163245cf42 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:28:30.353763 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac5ba0a-03a3-4868-8096-e9163245cf42 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:28:30.355346 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac5ba0a-03a3-4868-8096-e9163245cf42 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:28:30.366517 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1275/2529] 10.222.0.70 () {58 vars in 1152 bytes} [Tue May 10 19:28:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:28:30.371248 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1795d485-c2ba-4023-a6f3-23a98f2d038e None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:28:30.380271 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1795d485-c2ba-4023-a6f3-23a98f2d038e None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:28:30.385036 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc7078d-4192-4203-97cb-40d88b13eef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:28:30.385621 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc7078d-4192-4203-97cb-40d88b13eef9 admin admin] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:30.385901 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc7078d-4192-4203-97cb-40d88b13eef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:30.386174 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc7078d-4192-4203-97cb-40d88b13eef9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:30.386865 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc7078d-4192-4203-97cb-40d88b13eef9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:28:30.389281 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc7078d-4192-4203-97cb-40d88b13eef9 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:28:30.413489 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1255/2530] 10.222.0.70 () {60 vars in 1152 bytes} [Tue May 10 19:28:30 2022] POST /identity/v3/projects => generated 401 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:28:30.417567 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac5ba0a-03a3-4868-8096-e9163245cf42 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:28:30.428503 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac5ba0a-03a3-4868-8096-e9163245cf42 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:28:30.483161 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6597cd32-0b25-4002-b4ce-18d5c8e33eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:28:30.483834 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6597cd32-0b25-4002-b4ce-18d5c8e33eaf admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:30.484127 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6597cd32-0b25-4002-b4ce-18d5c8e33eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:30.484390 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6597cd32-0b25-4002-b4ce-18d5c8e33eaf admin admin] PATH_INFO: `/v3/users` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:30.485110 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6597cd32-0b25-4002-b4ce-18d5c8e33eaf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:28:30.487017 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6597cd32-0b25-4002-b4ce-18d5c8e33eaf admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:28:30.506606 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1276/2531] 10.222.0.70 () {60 vars in 1143 bytes} [Tue May 10 19:28:30 2022] POST /identity/v3/users => generated 301 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:28:30.510768 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc7078d-4192-4203-97cb-40d88b13eef9 admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:28:30.520838 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc7078d-4192-4203-97cb-40d88b13eef9 admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:28:30.525546 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dd9737-87da-4af9-bb44-52842ff8fe30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:28:30.526191 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dd9737-87da-4af9-bb44-52842ff8fe30 admin admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:30.526473 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dd9737-87da-4af9-bb44-52842ff8fe30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:30.526756 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dd9737-87da-4af9-bb44-52842ff8fe30 admin admin] PATH_INFO: `/v3/roles` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:30.527461 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dd9737-87da-4af9-bb44-52842ff8fe30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:28:30.529087 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dd9737-87da-4af9-bb44-52842ff8fe30 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:28:30.539078 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1256/2532] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:28:30 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:28:30.543515 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6597cd32-0b25-4002-b4ce-18d5c8e33eaf admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:28:30.553327 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6597cd32-0b25-4002-b4ce-18d5c8e33eaf admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:28:30.558677 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f878c2c-468b-4171-b486-2d32019987b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:28:30.559325 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f878c2c-468b-4171-b486-2d32019987b3 admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:30.559667 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f878c2c-468b-4171-b486-2d32019987b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:30.559957 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f878c2c-468b-4171-b486-2d32019987b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:30.560796 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f878c2c-468b-4171-b486-2d32019987b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:28:30.562517 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f878c2c-468b-4171-b486-2d32019987b3 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:28:30.572950 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1277/2533] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:28:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:28:30.577281 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dd9737-87da-4af9-bb44-52842ff8fe30 admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:28:30.587341 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dd9737-87da-4af9-bb44-52842ff8fe30 admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:28:30.591916 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23007f2b-490b-4433-84ea-743671f38bd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:28:30.592829 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23007f2b-490b-4433-84ea-743671f38bd0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:30.593116 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23007f2b-490b-4433-84ea-743671f38bd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:30.593393 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23007f2b-490b-4433-84ea-743671f38bd0 admin admin] PATH_INFO: `/v3/projects/7c82fc1f9f454cae9b66fe8c6a64bd0f/users/2c2da2a4371a44b7a06970d77b907a53/roles/5c07cf5bfbd3427db18428aa50420962` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:30.608792 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23007f2b-490b-4433-84ea-743671f38bd0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c82fc1f9f454cae9b66fe8c6a64bd0f, user_id=2c2da2a4371a44b7a06970d77b907a53, role_id=5c07cf5bfbd3427db18428aa50420962)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:28:30.611558 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23007f2b-490b-4433-84ea-743671f38bd0 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:28:30.625090 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1257/2534] 10.222.0.70 () {60 vars in 1482 bytes} [Tue May 10 19:28:30 2022] PUT /identity/v3/projects/7c82fc1f9f454cae9b66fe8c6a64bd0f/users/2c2da2a4371a44b7a06970d77b907a53/roles/5c07cf5bfbd3427db18428aa50420962 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:28:30.636296 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8449760c-338c-4942-896e-808dcaddf772 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:30.636569 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8449760c-338c-4942-896e-808dcaddf772 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:30.637115 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8449760c-338c-4942-896e-808dcaddf772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:30.663259 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-8449760c-338c-4942-896e-808dcaddf772 None None] MFA Rules not processed for user `2c2da2a4371a44b7a06970d77b907a53`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:28:30.664496 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-8449760c-338c-4942-896e-808dcaddf772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:28:30.732483 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1278/2535] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:28:30 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:28:30.737019 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23007f2b-490b-4433-84ea-743671f38bd0 admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:28:30.798662 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23007f2b-490b-4433-84ea-743671f38bd0 admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:28:30.803315 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc26f00-0756-4516-87e1-76c43299515c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:28:30.803981 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc26f00-0756-4516-87e1-76c43299515c admin admin] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:30.804261 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc26f00-0756-4516-87e1-76c43299515c admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:30.804568 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc26f00-0756-4516-87e1-76c43299515c admin admin] PATH_INFO: `/v3/projects` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:30.805248 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc26f00-0756-4516-87e1-76c43299515c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:28:30.807827 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc26f00-0756-4516-87e1-76c43299515c admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:28:30.833545 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1258/2536] 10.222.0.70 () {60 vars in 1152 bytes} [Tue May 10 19:28:30 2022] POST /identity/v3/projects => generated 401 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:28:30.838017 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8449760c-338c-4942-896e-808dcaddf772 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:28:30.848867 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8449760c-338c-4942-896e-808dcaddf772 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:28:30.905017 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e21619c-bd2c-49fd-8671-fa58be8b5391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:28:30.905603 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e21619c-bd2c-49fd-8671-fa58be8b5391 admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:30.905887 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e21619c-bd2c-49fd-8671-fa58be8b5391 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:30.906165 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e21619c-bd2c-49fd-8671-fa58be8b5391 admin admin] PATH_INFO: `/v3/users` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:30.906854 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e21619c-bd2c-49fd-8671-fa58be8b5391 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:28:30.908797 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e21619c-bd2c-49fd-8671-fa58be8b5391 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:28:30.932475 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1279/2537] 10.222.0.70 () {60 vars in 1143 bytes} [Tue May 10 19:28:30 2022] POST /identity/v3/users => generated 307 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:28:30.933700 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc26f00-0756-4516-87e1-76c43299515c admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:28:30.943919 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc26f00-0756-4516-87e1-76c43299515c admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:28:30.948534 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebf77ad-e399-4cfe-ae8c-6a5afd613ab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:28:30.949200 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebf77ad-e399-4cfe-ae8c-6a5afd613ab2 admin admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:30.949482 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebf77ad-e399-4cfe-ae8c-6a5afd613ab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:30.949756 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebf77ad-e399-4cfe-ae8c-6a5afd613ab2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:30.950472 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebf77ad-e399-4cfe-ae8c-6a5afd613ab2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:28:30.952064 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebf77ad-e399-4cfe-ae8c-6a5afd613ab2 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:28:30.963251 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1259/2538] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:28:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:28:30.967366 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e21619c-bd2c-49fd-8671-fa58be8b5391 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:28:30.977549 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e21619c-bd2c-49fd-8671-fa58be8b5391 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:28:30.982993 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef68ec5-5e28-40aa-9492-e9eff1d87adb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:28:30.983883 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef68ec5-5e28-40aa-9492-e9eff1d87adb admin admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:30.984177 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef68ec5-5e28-40aa-9492-e9eff1d87adb admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:30.984483 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef68ec5-5e28-40aa-9492-e9eff1d87adb admin admin] PATH_INFO: `/v3/projects/e442ad85bbdf4905a3fe1d81f42e361c/users/fe0e1c6404a24004bcfacb279e158961/roles/634ba284303b4626b5a0402772c68f5c` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:30.998808 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef68ec5-5e28-40aa-9492-e9eff1d87adb admin admin] RBAC: Authorizing `identity:create_grant(project_id=e442ad85bbdf4905a3fe1d81f42e361c, user_id=fe0e1c6404a24004bcfacb279e158961, role_id=634ba284303b4626b5a0402772c68f5c)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:28:31.001519 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef68ec5-5e28-40aa-9492-e9eff1d87adb admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:28:31.014639 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1280/2539] 10.222.0.70 () {60 vars in 1482 bytes} [Tue May 10 19:28:30 2022] PUT /identity/v3/projects/e442ad85bbdf4905a3fe1d81f42e361c/users/fe0e1c6404a24004bcfacb279e158961/roles/634ba284303b4626b5a0402772c68f5c => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:28:31.018724 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebf77ad-e399-4cfe-ae8c-6a5afd613ab2 admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:28:31.029086 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebf77ad-e399-4cfe-ae8c-6a5afd613ab2 admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:28:31.086581 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cd4d16-cd99-48ad-8adf-dcf6e29aa67e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:28:31.087331 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cd4d16-cd99-48ad-8adf-dcf6e29aa67e admin admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:31.087520 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cd4d16-cd99-48ad-8adf-dcf6e29aa67e admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:31.087819 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cd4d16-cd99-48ad-8adf-dcf6e29aa67e admin admin] PATH_INFO: `/v3/roles` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:31.088612 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cd4d16-cd99-48ad-8adf-dcf6e29aa67e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:28:31.090269 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cd4d16-cd99-48ad-8adf-dcf6e29aa67e admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:28:31.100064 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1260/2540] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:28:31 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:28:31.104246 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef68ec5-5e28-40aa-9492-e9eff1d87adb admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:28:31.115326 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef68ec5-5e28-40aa-9492-e9eff1d87adb admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:28:31.120630 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c310aa07-4995-4460-93a8-3e8a6391042b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:28:31.121505 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c310aa07-4995-4460-93a8-3e8a6391042b admin admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:31.121783 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c310aa07-4995-4460-93a8-3e8a6391042b admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:31.122054 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c310aa07-4995-4460-93a8-3e8a6391042b admin admin] PATH_INFO: `/v3/projects/e442ad85bbdf4905a3fe1d81f42e361c/users/fe0e1c6404a24004bcfacb279e158961/roles/634ba284303b4626b5a0402772c68f5c` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:31.123995 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c310aa07-4995-4460-93a8-3e8a6391042b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e442ad85bbdf4905a3fe1d81f42e361c, user_id=fe0e1c6404a24004bcfacb279e158961, role_id=634ba284303b4626b5a0402772c68f5c)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:28:31.126652 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c310aa07-4995-4460-93a8-3e8a6391042b admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:28:31.137118 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1281/2541] 10.222.0.70 () {60 vars in 1482 bytes} [Tue May 10 19:28:31 2022] PUT /identity/v3/projects/e442ad85bbdf4905a3fe1d81f42e361c/users/fe0e1c6404a24004bcfacb279e158961/roles/634ba284303b4626b5a0402772c68f5c => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 19:28:31.147057 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9eef3d-0d50-4c91-897c-e08f748e1a92 None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:31.147344 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9eef3d-0d50-4c91-897c-e08f748e1a92 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:31.147619 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9eef3d-0d50-4c91-897c-e08f748e1a92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:31.173038 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-df9eef3d-0d50-4c91-897c-e08f748e1a92 None None] MFA Rules not processed for user `fe0e1c6404a24004bcfacb279e158961`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:28:31.174159 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-df9eef3d-0d50-4c91-897c-e08f748e1a92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:28:31.238878 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1261/2542] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:28:31 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:28:31.249952 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c310aa07-4995-4460-93a8-3e8a6391042b admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:28:31.251617 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-c310aa07-4995-4460-93a8-3e8a6391042b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:28:31.309909 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c310aa07-4995-4460-93a8-3e8a6391042b admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:28:31.313304 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99fd279-cdc4-454b-9185-1bde4579aadd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15df2a8967aa43299c10e365f4200d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:28:31.313950 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99fd279-cdc4-454b-9185-1bde4579aadd service cinder] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:31.314248 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99fd279-cdc4-454b-9185-1bde4579aadd service cinder] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:31.314494 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99fd279-cdc4-454b-9185-1bde4579aadd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:31.329606 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99fd279-cdc4-454b-9185-1bde4579aadd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:28:31.331040 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99fd279-cdc4-454b-9185-1bde4579aadd service cinder] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:28:31.340465 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1282/2543] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:28:31 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:28:31.417145 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9eef3d-0d50-4c91-897c-e08f748e1a92 None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:28:31.426690 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9eef3d-0d50-4c91-897c-e08f748e1a92 None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:28:31.430372 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c0998f-6cb0-4026-94f6-bf1e1925b0ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15df2a8967aa43299c10e365f4200d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:28:31.431085 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c0998f-6cb0-4026-94f6-bf1e1925b0ee service cinder] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:31.431371 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c0998f-6cb0-4026-94f6-bf1e1925b0ee service cinder] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:31.431649 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c0998f-6cb0-4026-94f6-bf1e1925b0ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:31.497449 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c0998f-6cb0-4026-94f6-bf1e1925b0ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:28:31.499086 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c0998f-6cb0-4026-94f6-bf1e1925b0ee service cinder] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:28:31.512351 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1262/2544] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:28:31 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:28:33.053049 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0dc68d-e369-4b60-98c5-24eedeb71be1 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:33.053591 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0dc68d-e369-4b60-98c5-24eedeb71be1 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:33.053815 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0dc68d-e369-4b60-98c5-24eedeb71be1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:33.074279 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-9b0dc68d-e369-4b60-98c5-24eedeb71be1 None None] MFA Rules not processed for user `058e52f1bf0b4aba965d945815d4acb3`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:28:33.075681 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-9b0dc68d-e369-4b60-98c5-24eedeb71be1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:28:33.160182 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1283/2545] 10.222.0.70 () {58 vars in 967 bytes} [Tue May 10 19:28:33 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:28:33.174172 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c0998f-6cb0-4026-94f6-bf1e1925b0ee service cinder] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:28:33.175907 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-46c0998f-6cb0-4026-94f6-bf1e1925b0ee service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:28:33.256938 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c0998f-6cb0-4026-94f6-bf1e1925b0ee service cinder] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:28:33.263916 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af2dfe1-8e55-4667-9b93-e152400d3038 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0454aa03fa31487ea1464b9d0008212c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:28:33.264614 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af2dfe1-8e55-4667-9b93-e152400d3038 service swift] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:33.264900 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af2dfe1-8e55-4667-9b93-e152400d3038 service swift] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:33.265185 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af2dfe1-8e55-4667-9b93-e152400d3038 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:33.276909 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af2dfe1-8e55-4667-9b93-e152400d3038 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:28:33.278513 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af2dfe1-8e55-4667-9b93-e152400d3038 service swift] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:28:33.287204 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1263/2546] 10.222.0.70 () {60 vars in 1384 bytes} [Tue May 10 19:28:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 19:28:35.654289 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0dc68d-e369-4b60-98c5-24eedeb71be1 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:28:35.721370 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0dc68d-e369-4b60-98c5-24eedeb71be1 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:28:35.726650 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad7396f-1dfd-483f-8153-27b4d323dde2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:28:35.728178 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad7396f-1dfd-483f-8153-27b4d323dde2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:35.728729 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad7396f-1dfd-483f-8153-27b4d323dde2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:35.729230 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad7396f-1dfd-483f-8153-27b4d323dde2 admin admin] PATH_INFO: `/v3/users/2c2da2a4371a44b7a06970d77b907a53` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:35.730868 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad7396f-1dfd-483f-8153-27b4d323dde2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c2da2a4371a44b7a06970d77b907a53)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:28:35.732847 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad7396f-1dfd-483f-8153-27b4d323dde2 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:28:35.790981 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-3ad7396f-1dfd-483f-8153-27b4d323dde2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c2da2a4371a44b7a06970d77b907a53'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:35.803836 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-3ad7396f-1dfd-483f-8153-27b4d323dde2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c2da2a4371a44b7a06970d77b907a53'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:35.804700 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-3ad7396f-1dfd-483f-8153-27b4d323dde2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c2da2a4371a44b7a06970d77b907a53'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:35.812275 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-3ad7396f-1dfd-483f-8153-27b4d323dde2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c2da2a4371a44b7a06970d77b907a53'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:35.819251 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-3ad7396f-1dfd-483f-8153-27b4d323dde2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c2da2a4371a44b7a06970d77b907a53'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:35.826049 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1284/2547] 10.222.0.70 () {58 vars in 1223 bytes} [Tue May 10 19:28:35 2022] DELETE /identity/v3/users/2c2da2a4371a44b7a06970d77b907a53 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:28:35.830435 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7968a4f-be70-4c79-bf54-fa87e44aba3a None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:35.830934 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7968a4f-be70-4c79-bf54-fa87e44aba3a None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:35.831038 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7968a4f-be70-4c79-bf54-fa87e44aba3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:35.849743 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-b7968a4f-be70-4c79-bf54-fa87e44aba3a None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:28:35.851018 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-b7968a4f-be70-4c79-bf54-fa87e44aba3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:28:35.909406 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1264/2548] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:28:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:28:35.919592 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad7396f-1dfd-483f-8153-27b4d323dde2 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:28:35.921015 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-3ad7396f-1dfd-483f-8153-27b4d323dde2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:28:35.980448 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad7396f-1dfd-483f-8153-27b4d323dde2 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:28:35.984005 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8f658f-5f07-45a0-8d0e-e9ff1607077a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f1dc79540b48c0866478cc48cd8205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:28:35.984687 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8f658f-5f07-45a0-8d0e-e9ff1607077a service neutron] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:35.984970 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8f658f-5f07-45a0-8d0e-e9ff1607077a service neutron] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:35.985245 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8f658f-5f07-45a0-8d0e-e9ff1607077a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:35.995003 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8f658f-5f07-45a0-8d0e-e9ff1607077a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:28:35.996512 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8f658f-5f07-45a0-8d0e-e9ff1607077a service neutron] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:28:36.007397 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1285/2549] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:28:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:28:36.518483 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7968a4f-be70-4c79-bf54-fa87e44aba3a None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:28:36.520013 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-b7968a4f-be70-4c79-bf54-fa87e44aba3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:28:36.532805 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7968a4f-be70-4c79-bf54-fa87e44aba3a None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:28:36.537726 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac8a23c-e50f-4084-a7b4-d52cb0bb3917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:28:36.538656 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac8a23c-e50f-4084-a7b4-d52cb0bb3917 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:36.539001 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac8a23c-e50f-4084-a7b4-d52cb0bb3917 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:36.539337 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac8a23c-e50f-4084-a7b4-d52cb0bb3917 admin admin] PATH_INFO: `/v3/projects/7c82fc1f9f454cae9b66fe8c6a64bd0f` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:36.541108 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac8a23c-e50f-4084-a7b4-d52cb0bb3917 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c82fc1f9f454cae9b66fe8c6a64bd0f)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:28:36.543168 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac8a23c-e50f-4084-a7b4-d52cb0bb3917 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:28:36.619928 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-bac8a23c-e50f-4084-a7b4-d52cb0bb3917 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c82fc1f9f454cae9b66fe8c6a64bd0f', 'request_id': 'req-bac8a23c-e50f-4084-a7b4-d52cb0bb3917'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:36.628659 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-bac8a23c-e50f-4084-a7b4-d52cb0bb3917 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c82fc1f9f454cae9b66fe8c6a64bd0f', 'request_id': 'req-bac8a23c-e50f-4084-a7b4-d52cb0bb3917'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:36.639081 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-bac8a23c-e50f-4084-a7b4-d52cb0bb3917 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c82fc1f9f454cae9b66fe8c6a64bd0f', 'request_id': 'req-bac8a23c-e50f-4084-a7b4-d52cb0bb3917'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:36.653714 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-bac8a23c-e50f-4084-a7b4-d52cb0bb3917 admin admin] The token cache is being invalidate because project 7c82fc1f9f454cae9b66fe8c6a64bd0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79993) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:28:36.655183 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-bac8a23c-e50f-4084-a7b4-d52cb0bb3917 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:36.656771 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-bac8a23c-e50f-4084-a7b4-d52cb0bb3917 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:36.658450 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1265/2550] 10.222.0.70 () {58 vars in 1232 bytes} [Tue May 10 19:28:36 2022] DELETE /identity/v3/projects/7c82fc1f9f454cae9b66fe8c6a64bd0f => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:28:36.662427 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8f658f-5f07-45a0-8d0e-e9ff1607077a service neutron] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:28:36.672265 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8f658f-5f07-45a0-8d0e-e9ff1607077a service neutron] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:28:36.736989 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7408771b-d147-47a6-b0d4-a1d989dd024c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:28:36.738718 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7408771b-d147-47a6-b0d4-a1d989dd024c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:36.739309 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7408771b-d147-47a6-b0d4-a1d989dd024c admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:36.739746 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7408771b-d147-47a6-b0d4-a1d989dd024c admin admin] PATH_INFO: `/v3/users/fe0e1c6404a24004bcfacb279e158961` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:36.741870 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7408771b-d147-47a6-b0d4-a1d989dd024c admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe0e1c6404a24004bcfacb279e158961)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:28:36.744010 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7408771b-d147-47a6-b0d4-a1d989dd024c admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:28:36.831870 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-7408771b-d147-47a6-b0d4-a1d989dd024c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe0e1c6404a24004bcfacb279e158961'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:36.851471 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-7408771b-d147-47a6-b0d4-a1d989dd024c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe0e1c6404a24004bcfacb279e158961'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:36.852979 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-7408771b-d147-47a6-b0d4-a1d989dd024c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe0e1c6404a24004bcfacb279e158961'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:36.862328 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-7408771b-d147-47a6-b0d4-a1d989dd024c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe0e1c6404a24004bcfacb279e158961'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:36.871584 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-7408771b-d147-47a6-b0d4-a1d989dd024c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe0e1c6404a24004bcfacb279e158961'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:36.879950 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1286/2551] 10.222.0.70 () {58 vars in 1223 bytes} [Tue May 10 19:28:36 2022] DELETE /identity/v3/users/fe0e1c6404a24004bcfacb279e158961 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:28:37.186853 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac8a23c-e50f-4084-a7b4-d52cb0bb3917 admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:28:37.188406 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-bac8a23c-e50f-4084-a7b4-d52cb0bb3917 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:28:37.202469 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac8a23c-e50f-4084-a7b4-d52cb0bb3917 admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:28:37.259127 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f006a2-8a29-4a9d-bc6f-195b0354d0c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:28:37.259989 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f006a2-8a29-4a9d-bc6f-195b0354d0c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:37.260297 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f006a2-8a29-4a9d-bc6f-195b0354d0c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:37.260616 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f006a2-8a29-4a9d-bc6f-195b0354d0c9 admin admin] PATH_INFO: `/v3/projects/e442ad85bbdf4905a3fe1d81f42e361c` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:37.261788 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f006a2-8a29-4a9d-bc6f-195b0354d0c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e442ad85bbdf4905a3fe1d81f42e361c)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:28:37.263673 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f006a2-8a29-4a9d-bc6f-195b0354d0c9 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:28:37.323177 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-75f006a2-8a29-4a9d-bc6f-195b0354d0c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e442ad85bbdf4905a3fe1d81f42e361c', 'request_id': 'req-75f006a2-8a29-4a9d-bc6f-195b0354d0c9'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:37.328859 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-75f006a2-8a29-4a9d-bc6f-195b0354d0c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e442ad85bbdf4905a3fe1d81f42e361c', 'request_id': 'req-75f006a2-8a29-4a9d-bc6f-195b0354d0c9'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:37.338202 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-75f006a2-8a29-4a9d-bc6f-195b0354d0c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e442ad85bbdf4905a3fe1d81f42e361c', 'request_id': 'req-75f006a2-8a29-4a9d-bc6f-195b0354d0c9'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:37.351093 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-75f006a2-8a29-4a9d-bc6f-195b0354d0c9 admin admin] The token cache is being invalidate because project e442ad85bbdf4905a3fe1d81f42e361c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79993) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:28:37.351468 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-75f006a2-8a29-4a9d-bc6f-195b0354d0c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:37.352164 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-75f006a2-8a29-4a9d-bc6f-195b0354d0c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:37.353754 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1266/2552] 10.222.0.70 () {58 vars in 1232 bytes} [Tue May 10 19:28:37 2022] DELETE /identity/v3/projects/e442ad85bbdf4905a3fe1d81f42e361c => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:28:37.358725 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55a8bf3-1bc7-4f61-87ca-e12a3ad299e6 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:37.359253 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55a8bf3-1bc7-4f61-87ca-e12a3ad299e6 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:37.359737 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55a8bf3-1bc7-4f61-87ca-e12a3ad299e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:37.377372 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-c55a8bf3-1bc7-4f61-87ca-e12a3ad299e6 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:28:37.378562 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-c55a8bf3-1bc7-4f61-87ca-e12a3ad299e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:28:37.436391 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1287/2553] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:28:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:28:37.445618 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aef257-a70f-4b04-95d9-07f1f352dcb4 None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:37.446523 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aef257-a70f-4b04-95d9-07f1f352dcb4 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:37.446878 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aef257-a70f-4b04-95d9-07f1f352dcb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:37.465861 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-37aef257-a70f-4b04-95d9-07f1f352dcb4 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:28:37.467043 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-37aef257-a70f-4b04-95d9-07f1f352dcb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:28:37.474847 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1267/2554] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:28:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:28:37.479033 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55a8bf3-1bc7-4f61-87ca-e12a3ad299e6 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:28:37.488573 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55a8bf3-1bc7-4f61-87ca-e12a3ad299e6 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:28:37.493220 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a2ccbc-c3e2-442d-80e7-816a92babaf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:28:37.493866 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a2ccbc-c3e2-442d-80e7-816a92babaf0 admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:37.494149 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a2ccbc-c3e2-442d-80e7-816a92babaf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:37.494423 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a2ccbc-c3e2-442d-80e7-816a92babaf0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:37.495136 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a2ccbc-c3e2-442d-80e7-816a92babaf0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:28:37.495443 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a2ccbc-c3e2-442d-80e7-816a92babaf0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:28:37.497062 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a2ccbc-c3e2-442d-80e7-816a92babaf0 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:28:37.508250 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1288/2555] 10.222.0.70 () {58 vars in 1152 bytes} [Tue May 10 19:28:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:28:37.512986 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aef257-a70f-4b04-95d9-07f1f352dcb4 None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:28:37.522153 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aef257-a70f-4b04-95d9-07f1f352dcb4 None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:28:37.527558 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1823c943-a4b6-46f4-acaa-d5d9c0171254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:28:37.528216 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1823c943-a4b6-46f4-acaa-d5d9c0171254 admin admin] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:37.528531 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1823c943-a4b6-46f4-acaa-d5d9c0171254 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:37.528806 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1823c943-a4b6-46f4-acaa-d5d9c0171254 admin admin] PATH_INFO: `/v3/projects` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:37.529488 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1823c943-a4b6-46f4-acaa-d5d9c0171254 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:28:37.531377 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1823c943-a4b6-46f4-acaa-d5d9c0171254 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:28:37.559180 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1268/2556] 10.222.0.70 () {60 vars in 1152 bytes} [Tue May 10 19:28:37 2022] POST /identity/v3/projects => generated 383 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:28:37.560689 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a2ccbc-c3e2-442d-80e7-816a92babaf0 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:28:37.570680 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a2ccbc-c3e2-442d-80e7-816a92babaf0 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:28:37.626110 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e97e173-6abf-488c-bca7-7b6a3a0c237c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:28:37.626786 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e97e173-6abf-488c-bca7-7b6a3a0c237c admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:37.627070 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e97e173-6abf-488c-bca7-7b6a3a0c237c admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:37.627346 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e97e173-6abf-488c-bca7-7b6a3a0c237c admin admin] PATH_INFO: `/v3/users` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:37.628041 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e97e173-6abf-488c-bca7-7b6a3a0c237c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:28:37.630006 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e97e173-6abf-488c-bca7-7b6a3a0c237c admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:28:37.650438 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1289/2557] 10.222.0.70 () {60 vars in 1143 bytes} [Tue May 10 19:28:37 2022] POST /identity/v3/users => generated 292 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 19:28:37.654539 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1823c943-a4b6-46f4-acaa-d5d9c0171254 admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:28:37.664972 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1823c943-a4b6-46f4-acaa-d5d9c0171254 admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:28:37.669709 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8fbed9-3462-45d8-b424-06cf3318cd6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:28:37.670379 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8fbed9-3462-45d8-b424-06cf3318cd6a admin admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:37.670683 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8fbed9-3462-45d8-b424-06cf3318cd6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:37.670959 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8fbed9-3462-45d8-b424-06cf3318cd6a admin admin] PATH_INFO: `/v3/roles` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:37.671680 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8fbed9-3462-45d8-b424-06cf3318cd6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:28:37.673341 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8fbed9-3462-45d8-b424-06cf3318cd6a admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:28:37.684233 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1269/2558] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:28:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:28:37.689003 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e97e173-6abf-488c-bca7-7b6a3a0c237c admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:28:37.699762 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e97e173-6abf-488c-bca7-7b6a3a0c237c admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:28:37.704972 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767c6b75-00ff-4b5e-8577-1eb30562d65c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:28:37.705638 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767c6b75-00ff-4b5e-8577-1eb30562d65c admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:37.705921 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767c6b75-00ff-4b5e-8577-1eb30562d65c admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:37.706196 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767c6b75-00ff-4b5e-8577-1eb30562d65c admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:37.706914 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767c6b75-00ff-4b5e-8577-1eb30562d65c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:28:37.708550 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767c6b75-00ff-4b5e-8577-1eb30562d65c admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:28:37.719221 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1290/2559] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:28:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:28:37.723031 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8fbed9-3462-45d8-b424-06cf3318cd6a admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:28:37.733595 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8fbed9-3462-45d8-b424-06cf3318cd6a admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:28:37.738200 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4750b21-36cd-4cfa-ad7d-543c2b8f49b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:28:37.739078 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4750b21-36cd-4cfa-ad7d-543c2b8f49b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:37.739363 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4750b21-36cd-4cfa-ad7d-543c2b8f49b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:37.739646 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4750b21-36cd-4cfa-ad7d-543c2b8f49b9 admin admin] PATH_INFO: `/v3/projects/7719fcfac1de4004be5d911f4b8646ca/users/1701f5a7411041bd874c05c7aa704436/roles/5c07cf5bfbd3427db18428aa50420962` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:37.754661 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4750b21-36cd-4cfa-ad7d-543c2b8f49b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7719fcfac1de4004be5d911f4b8646ca, user_id=1701f5a7411041bd874c05c7aa704436, role_id=5c07cf5bfbd3427db18428aa50420962)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:28:37.757382 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4750b21-36cd-4cfa-ad7d-543c2b8f49b9 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:28:37.770902 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1270/2560] 10.222.0.70 () {60 vars in 1482 bytes} [Tue May 10 19:28:37 2022] PUT /identity/v3/projects/7719fcfac1de4004be5d911f4b8646ca/users/1701f5a7411041bd874c05c7aa704436/roles/5c07cf5bfbd3427db18428aa50420962 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:28:37.781328 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c31cc59-2d07-451e-8d98-68cf2fe9347c None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:37.781625 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c31cc59-2d07-451e-8d98-68cf2fe9347c None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:37.781905 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c31cc59-2d07-451e-8d98-68cf2fe9347c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:37.808014 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-7c31cc59-2d07-451e-8d98-68cf2fe9347c None None] MFA Rules not processed for user `1701f5a7411041bd874c05c7aa704436`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:28:37.809262 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-7c31cc59-2d07-451e-8d98-68cf2fe9347c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:28:37.871034 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1291/2561] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:28:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:28:37.875617 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4750b21-36cd-4cfa-ad7d-543c2b8f49b9 admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:28:37.937194 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4750b21-36cd-4cfa-ad7d-543c2b8f49b9 admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:28:37.941852 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad773db1-b689-47bb-85ce-4aba015586fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:28:37.942528 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad773db1-b689-47bb-85ce-4aba015586fc admin admin] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:37.942816 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad773db1-b689-47bb-85ce-4aba015586fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:37.943095 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad773db1-b689-47bb-85ce-4aba015586fc admin admin] PATH_INFO: `/v3/projects` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:37.944081 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad773db1-b689-47bb-85ce-4aba015586fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:28:37.946100 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad773db1-b689-47bb-85ce-4aba015586fc admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:28:37.975144 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1271/2562] 10.222.0.70 () {60 vars in 1152 bytes} [Tue May 10 19:28:37 2022] POST /identity/v3/projects => generated 383 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:28:37.980098 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c31cc59-2d07-451e-8d98-68cf2fe9347c None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:28:37.996948 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c31cc59-2d07-451e-8d98-68cf2fe9347c None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:28:38.079852 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d5b87c-3a21-40e5-96cb-7f0944548484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:28:38.080992 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d5b87c-3a21-40e5-96cb-7f0944548484 admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:38.081356 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d5b87c-3a21-40e5-96cb-7f0944548484 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:38.081707 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d5b87c-3a21-40e5-96cb-7f0944548484 admin admin] PATH_INFO: `/v3/users` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:38.082494 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d5b87c-3a21-40e5-96cb-7f0944548484 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:28:38.084617 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d5b87c-3a21-40e5-96cb-7f0944548484 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:28:38.116515 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1292/2563] 10.222.0.70 () {60 vars in 1143 bytes} [Tue May 10 19:28:37 2022] POST /identity/v3/users => generated 298 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 19:28:38.118558 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad773db1-b689-47bb-85ce-4aba015586fc admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:28:38.129142 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad773db1-b689-47bb-85ce-4aba015586fc admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:28:38.140031 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51daaac-88ef-4382-8cb7-913700359bae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:28:38.140933 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51daaac-88ef-4382-8cb7-913700359bae admin admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:38.141323 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51daaac-88ef-4382-8cb7-913700359bae admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:38.141725 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51daaac-88ef-4382-8cb7-913700359bae admin admin] PATH_INFO: `/v3/roles` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:38.142660 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51daaac-88ef-4382-8cb7-913700359bae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:28:38.144612 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51daaac-88ef-4382-8cb7-913700359bae admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:28:38.156995 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1272/2564] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:28:38 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:28:38.161039 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d5b87c-3a21-40e5-96cb-7f0944548484 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:28:38.172039 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d5b87c-3a21-40e5-96cb-7f0944548484 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:28:38.177141 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110fb236-1eac-486c-a8b9-77c2153a9eb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:28:38.178450 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110fb236-1eac-486c-a8b9-77c2153a9eb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:38.178834 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110fb236-1eac-486c-a8b9-77c2153a9eb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:38.179222 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110fb236-1eac-486c-a8b9-77c2153a9eb4 admin admin] PATH_INFO: `/v3/projects/bf7adf67be2d429cac824134a12824fe/users/5405efa3078747d381070a443d5a04ba/roles/634ba284303b4626b5a0402772c68f5c` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:38.198933 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110fb236-1eac-486c-a8b9-77c2153a9eb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf7adf67be2d429cac824134a12824fe, user_id=5405efa3078747d381070a443d5a04ba, role_id=634ba284303b4626b5a0402772c68f5c)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:28:38.202348 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110fb236-1eac-486c-a8b9-77c2153a9eb4 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:28:38.216556 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1293/2565] 10.222.0.70 () {60 vars in 1482 bytes} [Tue May 10 19:28:38 2022] PUT /identity/v3/projects/bf7adf67be2d429cac824134a12824fe/users/5405efa3078747d381070a443d5a04ba/roles/634ba284303b4626b5a0402772c68f5c => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:28:38.220675 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51daaac-88ef-4382-8cb7-913700359bae admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:28:38.232572 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51daaac-88ef-4382-8cb7-913700359bae admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:28:38.286978 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ce5367-6482-4c8b-a829-9f83f34ce271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:28:38.287507 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ce5367-6482-4c8b-a829-9f83f34ce271 admin admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:38.287839 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ce5367-6482-4c8b-a829-9f83f34ce271 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:38.288111 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ce5367-6482-4c8b-a829-9f83f34ce271 admin admin] PATH_INFO: `/v3/roles` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:38.288860 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ce5367-6482-4c8b-a829-9f83f34ce271 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:28:38.290529 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ce5367-6482-4c8b-a829-9f83f34ce271 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:28:38.300569 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1273/2566] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:28:38 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 19:28:38.304757 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110fb236-1eac-486c-a8b9-77c2153a9eb4 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:28:38.314703 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110fb236-1eac-486c-a8b9-77c2153a9eb4 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:28:38.319528 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0622ee-f559-44a3-b2a2-189117fa880c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:28:38.320399 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0622ee-f559-44a3-b2a2-189117fa880c admin admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:38.320710 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0622ee-f559-44a3-b2a2-189117fa880c admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:38.321513 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0622ee-f559-44a3-b2a2-189117fa880c admin admin] PATH_INFO: `/v3/projects/bf7adf67be2d429cac824134a12824fe/users/5405efa3078747d381070a443d5a04ba/roles/634ba284303b4626b5a0402772c68f5c` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:38.323508 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0622ee-f559-44a3-b2a2-189117fa880c admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf7adf67be2d429cac824134a12824fe, user_id=5405efa3078747d381070a443d5a04ba, role_id=634ba284303b4626b5a0402772c68f5c)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:28:38.326134 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0622ee-f559-44a3-b2a2-189117fa880c admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:28:38.340454 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1294/2567] 10.222.0.70 () {60 vars in 1482 bytes} [Tue May 10 19:28:38 2022] PUT /identity/v3/projects/bf7adf67be2d429cac824134a12824fe/users/5405efa3078747d381070a443d5a04ba/roles/634ba284303b4626b5a0402772c68f5c => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 19:28:38.347188 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c097c61-f232-4db9-afb1-122a6305c3f5 None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:38.347478 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c097c61-f232-4db9-afb1-122a6305c3f5 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:38.347778 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c097c61-f232-4db9-afb1-122a6305c3f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:38.374852 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-5c097c61-f232-4db9-afb1-122a6305c3f5 None None] MFA Rules not processed for user `5405efa3078747d381070a443d5a04ba`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:28:38.376165 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-5c097c61-f232-4db9-afb1-122a6305c3f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:28:38.448149 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1274/2568] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:28:38 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:28:38.459487 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0622ee-f559-44a3-b2a2-189117fa880c admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:28:38.461221 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-fa0622ee-f559-44a3-b2a2-189117fa880c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:28:38.527127 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0622ee-f559-44a3-b2a2-189117fa880c admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:28:38.530950 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533e5a24-c455-4ba3-ba2e-0cfd2dafb979 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15df2a8967aa43299c10e365f4200d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:28:38.531616 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533e5a24-c455-4ba3-ba2e-0cfd2dafb979 service cinder] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:38.531899 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533e5a24-c455-4ba3-ba2e-0cfd2dafb979 service cinder] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:38.532252 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533e5a24-c455-4ba3-ba2e-0cfd2dafb979 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:38.543369 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533e5a24-c455-4ba3-ba2e-0cfd2dafb979 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:28:38.544858 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533e5a24-c455-4ba3-ba2e-0cfd2dafb979 service cinder] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:28:38.555959 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1295/2569] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:28:38 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:28:38.630236 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c097c61-f232-4db9-afb1-122a6305c3f5 None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:28:38.641798 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c097c61-f232-4db9-afb1-122a6305c3f5 None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:28:38.645713 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99e5e34-73ee-4663-a93c-d65cd8955934 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15df2a8967aa43299c10e365f4200d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:28:38.646384 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99e5e34-73ee-4663-a93c-d65cd8955934 service cinder] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:38.646672 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99e5e34-73ee-4663-a93c-d65cd8955934 service cinder] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:38.646951 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99e5e34-73ee-4663-a93c-d65cd8955934 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:38.709068 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99e5e34-73ee-4663-a93c-d65cd8955934 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:28:38.710616 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99e5e34-73ee-4663-a93c-d65cd8955934 service cinder] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:28:38.728475 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1275/2570] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:28:38 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:28:39.030192 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533e5a24-c455-4ba3-ba2e-0cfd2dafb979 service cinder] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:28:39.107538 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533e5a24-c455-4ba3-ba2e-0cfd2dafb979 service cinder] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:28:39.112588 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7b974b-3807-4c11-8a9b-e4a5c54071ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:28:39.113472 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7b974b-3807-4c11-8a9b-e4a5c54071ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:39.114145 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7b974b-3807-4c11-8a9b-e4a5c54071ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:39.114145 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7b974b-3807-4c11-8a9b-e4a5c54071ca admin admin] PATH_INFO: `/v3/users/1701f5a7411041bd874c05c7aa704436` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:39.115213 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7b974b-3807-4c11-8a9b-e4a5c54071ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=1701f5a7411041bd874c05c7aa704436)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:28:39.117462 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7b974b-3807-4c11-8a9b-e4a5c54071ca admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:28:39.170607 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-da7b974b-3807-4c11-8a9b-e4a5c54071ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1701f5a7411041bd874c05c7aa704436'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:39.185483 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-da7b974b-3807-4c11-8a9b-e4a5c54071ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1701f5a7411041bd874c05c7aa704436'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:39.186218 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-da7b974b-3807-4c11-8a9b-e4a5c54071ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1701f5a7411041bd874c05c7aa704436'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:39.195342 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-da7b974b-3807-4c11-8a9b-e4a5c54071ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1701f5a7411041bd874c05c7aa704436'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:39.202864 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-da7b974b-3807-4c11-8a9b-e4a5c54071ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1701f5a7411041bd874c05c7aa704436'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:39.210055 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1296/2571] 10.222.0.70 () {58 vars in 1223 bytes} [Tue May 10 19:28:39 2022] DELETE /identity/v3/users/1701f5a7411041bd874c05c7aa704436 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:28:39.215029 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a5e618-3cc6-4de0-857a-73f2ecb00d7a None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:39.215321 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a5e618-3cc6-4de0-857a-73f2ecb00d7a None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:39.215598 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a5e618-3cc6-4de0-857a-73f2ecb00d7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:39.234364 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-a7a5e618-3cc6-4de0-857a-73f2ecb00d7a None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:28:39.235683 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-a7a5e618-3cc6-4de0-857a-73f2ecb00d7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:28:39.306105 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1276/2572] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:28:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:28:39.315577 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7b974b-3807-4c11-8a9b-e4a5c54071ca admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:28:39.317290 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-da7b974b-3807-4c11-8a9b-e4a5c54071ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:28:39.381012 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7b974b-3807-4c11-8a9b-e4a5c54071ca admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:28:39.385084 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a28744a-d794-4245-9ac3-879688645a00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f1dc79540b48c0866478cc48cd8205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:28:39.385698 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a28744a-d794-4245-9ac3-879688645a00 service neutron] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:39.385975 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a28744a-d794-4245-9ac3-879688645a00 service neutron] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:39.386250 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a28744a-d794-4245-9ac3-879688645a00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:39.396598 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a28744a-d794-4245-9ac3-879688645a00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:28:39.398066 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a28744a-d794-4245-9ac3-879688645a00 service neutron] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:28:39.416947 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1297/2573] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:28:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 19:28:39.842228 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a5e618-3cc6-4de0-857a-73f2ecb00d7a None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:28:39.843908 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-a7a5e618-3cc6-4de0-857a-73f2ecb00d7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:28:39.860663 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a5e618-3cc6-4de0-857a-73f2ecb00d7a None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:28:39.865870 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47f7345-0cd6-4c4a-9c13-bc21ed97e3b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:28:39.866811 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47f7345-0cd6-4c4a-9c13-bc21ed97e3b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:39.867164 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47f7345-0cd6-4c4a-9c13-bc21ed97e3b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:39.867510 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47f7345-0cd6-4c4a-9c13-bc21ed97e3b1 admin admin] PATH_INFO: `/v3/projects/7719fcfac1de4004be5d911f4b8646ca` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:39.870448 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47f7345-0cd6-4c4a-9c13-bc21ed97e3b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7719fcfac1de4004be5d911f4b8646ca)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:28:39.873009 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47f7345-0cd6-4c4a-9c13-bc21ed97e3b1 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:28:39.939177 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-d47f7345-0cd6-4c4a-9c13-bc21ed97e3b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7719fcfac1de4004be5d911f4b8646ca', 'request_id': 'req-d47f7345-0cd6-4c4a-9c13-bc21ed97e3b1'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:39.958181 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-d47f7345-0cd6-4c4a-9c13-bc21ed97e3b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7719fcfac1de4004be5d911f4b8646ca', 'request_id': 'req-d47f7345-0cd6-4c4a-9c13-bc21ed97e3b1'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:39.984800 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-d47f7345-0cd6-4c4a-9c13-bc21ed97e3b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7719fcfac1de4004be5d911f4b8646ca', 'request_id': 'req-d47f7345-0cd6-4c4a-9c13-bc21ed97e3b1'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:40.021678 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-d47f7345-0cd6-4c4a-9c13-bc21ed97e3b1 admin admin] The token cache is being invalidate because project 7719fcfac1de4004be5d911f4b8646ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79993) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:28:40.023351 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-d47f7345-0cd6-4c4a-9c13-bc21ed97e3b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:40.025313 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-d47f7345-0cd6-4c4a-9c13-bc21ed97e3b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:40.030182 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1277/2574] 10.222.0.70 () {58 vars in 1232 bytes} [Tue May 10 19:28:39 2022] DELETE /identity/v3/projects/7719fcfac1de4004be5d911f4b8646ca => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:28:40.032846 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a28744a-d794-4245-9ac3-879688645a00 service neutron] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:28:40.048909 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a28744a-d794-4245-9ac3-879688645a00 service neutron] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:28:40.151386 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4e8bf9-6409-4704-87b4-393c558245d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:28:40.152546 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4e8bf9-6409-4704-87b4-393c558245d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:40.153148 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4e8bf9-6409-4704-87b4-393c558245d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:40.153576 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4e8bf9-6409-4704-87b4-393c558245d1 admin admin] PATH_INFO: `/v3/users/5405efa3078747d381070a443d5a04ba` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:40.154988 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4e8bf9-6409-4704-87b4-393c558245d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5405efa3078747d381070a443d5a04ba)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:28:40.157768 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4e8bf9-6409-4704-87b4-393c558245d1 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:28:40.234794 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-0b4e8bf9-6409-4704-87b4-393c558245d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5405efa3078747d381070a443d5a04ba'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:40.254330 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-0b4e8bf9-6409-4704-87b4-393c558245d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5405efa3078747d381070a443d5a04ba'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:40.255947 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-0b4e8bf9-6409-4704-87b4-393c558245d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5405efa3078747d381070a443d5a04ba'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:40.265424 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-0b4e8bf9-6409-4704-87b4-393c558245d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5405efa3078747d381070a443d5a04ba'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:40.272886 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-0b4e8bf9-6409-4704-87b4-393c558245d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5405efa3078747d381070a443d5a04ba'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:40.279083 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1298/2575] 10.222.0.70 () {58 vars in 1223 bytes} [Tue May 10 19:28:40 2022] DELETE /identity/v3/users/5405efa3078747d381070a443d5a04ba => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 19:28:40.624243 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47f7345-0cd6-4c4a-9c13-bc21ed97e3b1 admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:28:40.625783 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-d47f7345-0cd6-4c4a-9c13-bc21ed97e3b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:28:40.642632 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47f7345-0cd6-4c4a-9c13-bc21ed97e3b1 admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:28:40.712836 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4bdbe6-5039-4372-87cb-1d96bb0b62b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:28:40.714076 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4bdbe6-5039-4372-87cb-1d96bb0b62b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:40.714543 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4bdbe6-5039-4372-87cb-1d96bb0b62b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:40.714967 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4bdbe6-5039-4372-87cb-1d96bb0b62b7 admin admin] PATH_INFO: `/v3/projects/bf7adf67be2d429cac824134a12824fe` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:40.716880 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4bdbe6-5039-4372-87cb-1d96bb0b62b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf7adf67be2d429cac824134a12824fe)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:28:40.719591 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4bdbe6-5039-4372-87cb-1d96bb0b62b7 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:28:40.741934 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4e8bf9-6409-4704-87b4-393c558245d1 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:28:40.744254 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-0b4e8bf9-6409-4704-87b4-393c558245d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:28:40.759252 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4e8bf9-6409-4704-87b4-393c558245d1 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:28:40.775819 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-ae4bdbe6-5039-4372-87cb-1d96bb0b62b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf7adf67be2d429cac824134a12824fe', 'request_id': 'req-ae4bdbe6-5039-4372-87cb-1d96bb0b62b7'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:40.782010 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-ae4bdbe6-5039-4372-87cb-1d96bb0b62b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf7adf67be2d429cac824134a12824fe', 'request_id': 'req-ae4bdbe6-5039-4372-87cb-1d96bb0b62b7'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:40.791254 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-ae4bdbe6-5039-4372-87cb-1d96bb0b62b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf7adf67be2d429cac824134a12824fe', 'request_id': 'req-ae4bdbe6-5039-4372-87cb-1d96bb0b62b7'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:40.802203 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-ae4bdbe6-5039-4372-87cb-1d96bb0b62b7 admin admin] The token cache is being invalidate because project bf7adf67be2d429cac824134a12824fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79993) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:28:40.802514 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-ae4bdbe6-5039-4372-87cb-1d96bb0b62b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:40.803143 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-ae4bdbe6-5039-4372-87cb-1d96bb0b62b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:40.804712 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1278/2576] 10.222.0.70 () {58 vars in 1232 bytes} [Tue May 10 19:28:40 2022] DELETE /identity/v3/projects/bf7adf67be2d429cac824134a12824fe => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:28:40.809273 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed875c37-3f7e-4386-855b-709eaad403a0 None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:40.809555 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed875c37-3f7e-4386-855b-709eaad403a0 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:40.809830 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed875c37-3f7e-4386-855b-709eaad403a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:40.823462 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dcd217-f6b0-4e0c-8b79-b7d138205f6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:28:40.824482 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dcd217-f6b0-4e0c-8b79-b7d138205f6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:40.824837 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dcd217-f6b0-4e0c-8b79-b7d138205f6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:40.825179 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dcd217-f6b0-4e0c-8b79-b7d138205f6b admin admin] PATH_INFO: `/v3/users/440240e16b394209885d8a1523a8d4fe` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:40.826470 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dcd217-f6b0-4e0c-8b79-b7d138205f6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=440240e16b394209885d8a1523a8d4fe)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:28:40.827783 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-ed875c37-3f7e-4386-855b-709eaad403a0 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:28:40.828565 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dcd217-f6b0-4e0c-8b79-b7d138205f6b admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:28:40.828996 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-ed875c37-3f7e-4386-855b-709eaad403a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:28:40.837645 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1279/2577] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:28:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:28:40.846471 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8681bc-1363-4b5c-a1cd-cf2c333849c3 None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:40.846751 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8681bc-1363-4b5c-a1cd-cf2c333849c3 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:40.847023 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8681bc-1363-4b5c-a1cd-cf2c333849c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:40.865321 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-ec8681bc-1363-4b5c-a1cd-cf2c333849c3 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:28:40.866482 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-ec8681bc-1363-4b5c-a1cd-cf2c333849c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:28:40.874658 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-76dcd217-f6b0-4e0c-8b79-b7d138205f6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '440240e16b394209885d8a1523a8d4fe'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:40.875043 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1280/2578] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:28:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:28:40.879191 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8681bc-1363-4b5c-a1cd-cf2c333849c3 None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:28:40.886575 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-76dcd217-f6b0-4e0c-8b79-b7d138205f6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '440240e16b394209885d8a1523a8d4fe'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:40.887250 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-76dcd217-f6b0-4e0c-8b79-b7d138205f6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '440240e16b394209885d8a1523a8d4fe'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:40.888786 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8681bc-1363-4b5c-a1cd-cf2c333849c3 None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:28:40.893531 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533ff080-9779-4063-9aee-814eb5af675c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:28:40.894162 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-76dcd217-f6b0-4e0c-8b79-b7d138205f6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '440240e16b394209885d8a1523a8d4fe'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:40.894299 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533ff080-9779-4063-9aee-814eb5af675c admin admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:40.894530 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533ff080-9779-4063-9aee-814eb5af675c admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:40.894721 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533ff080-9779-4063-9aee-814eb5af675c admin admin] PATH_INFO: `/v3/domains` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:40.895469 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533ff080-9779-4063-9aee-814eb5af675c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:28:40.895773 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533ff080-9779-4063-9aee-814eb5af675c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:28:40.897408 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533ff080-9779-4063-9aee-814eb5af675c admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:28:40.901030 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-76dcd217-f6b0-4e0c-8b79-b7d138205f6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '440240e16b394209885d8a1523a8d4fe'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:40.907410 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1299/2579] 10.222.0.70 () {58 vars in 1223 bytes} [Tue May 10 19:28:40 2022] DELETE /identity/v3/users/440240e16b394209885d8a1523a8d4fe => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 19:28:40.909158 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1281/2580] 10.222.0.70 () {58 vars in 1152 bytes} [Tue May 10 19:28:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:28:40.914373 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dcd217-f6b0-4e0c-8b79-b7d138205f6b admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:28:40.915771 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-76dcd217-f6b0-4e0c-8b79-b7d138205f6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:28:40.980872 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dcd217-f6b0-4e0c-8b79-b7d138205f6b admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:28:40.985847 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606ed9d8-d1c3-4275-9cc8-c7f485dc856c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:28:40.986519 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606ed9d8-d1c3-4275-9cc8-c7f485dc856c admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:40.986804 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606ed9d8-d1c3-4275-9cc8-c7f485dc856c admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:40.987080 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606ed9d8-d1c3-4275-9cc8-c7f485dc856c admin admin] PATH_INFO: `/v3/projects` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:40.987775 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606ed9d8-d1c3-4275-9cc8-c7f485dc856c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:28:40.989753 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606ed9d8-d1c3-4275-9cc8-c7f485dc856c admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:28:41.018653 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1300/2581] 10.222.0.70 () {60 vars in 1152 bytes} [Tue May 10 19:28:40 2022] POST /identity/v3/projects => generated 361 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:28:41.023096 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533ff080-9779-4063-9aee-814eb5af675c admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:28:41.033521 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533ff080-9779-4063-9aee-814eb5af675c admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:28:41.091863 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606ed9d8-d1c3-4275-9cc8-c7f485dc856c admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:28:41.093868 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-606ed9d8-d1c3-4275-9cc8-c7f485dc856c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:28:41.099370 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67693fae-0448-4f97-818d-c3572b4c8048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:28:41.100286 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67693fae-0448-4f97-818d-c3572b4c8048 admin admin] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:41.100614 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67693fae-0448-4f97-818d-c3572b4c8048 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:41.100889 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67693fae-0448-4f97-818d-c3572b4c8048 admin admin] PATH_INFO: `/v3/users` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:41.101637 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67693fae-0448-4f97-818d-c3572b4c8048 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:28:41.103656 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67693fae-0448-4f97-818d-c3572b4c8048 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:28:41.106901 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606ed9d8-d1c3-4275-9cc8-c7f485dc856c admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:28:41.112334 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7f1308-97f1-46de-8411-a5fee04fbf9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:28:41.113376 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7f1308-97f1-46de-8411-a5fee04fbf9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:41.118312 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7f1308-97f1-46de-8411-a5fee04fbf9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:41.127329 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1282/2582] 10.222.0.70 () {60 vars in 1143 bytes} [Tue May 10 19:28:41 2022] POST /identity/v3/users => generated 281 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:28:41.130422 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7f1308-97f1-46de-8411-a5fee04fbf9e admin admin] PATH_INFO: `/v3/projects/fb8f2405eb7a484da3d99929e2e78ddb` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:41.131428 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67693fae-0448-4f97-818d-c3572b4c8048 admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:28:41.132722 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7f1308-97f1-46de-8411-a5fee04fbf9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb8f2405eb7a484da3d99929e2e78ddb)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:28:41.135800 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7f1308-97f1-46de-8411-a5fee04fbf9e admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:28:41.143893 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67693fae-0448-4f97-818d-c3572b4c8048 admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:28:41.149108 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3d57cb-5948-4f85-9b1e-9b1f5a41391f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:28:41.150621 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3d57cb-5948-4f85-9b1e-9b1f5a41391f admin admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:41.151004 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3d57cb-5948-4f85-9b1e-9b1f5a41391f admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:41.151373 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3d57cb-5948-4f85-9b1e-9b1f5a41391f admin admin] PATH_INFO: `/v3/roles` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:41.152242 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3d57cb-5948-4f85-9b1e-9b1f5a41391f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:28:41.154074 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3d57cb-5948-4f85-9b1e-9b1f5a41391f admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:28:41.166102 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1283/2583] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:28:41 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:28:41.170147 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3d57cb-5948-4f85-9b1e-9b1f5a41391f admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:28:41.180705 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3d57cb-5948-4f85-9b1e-9b1f5a41391f admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:28:41.183793 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-5e7f1308-97f1-46de-8411-a5fee04fbf9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb8f2405eb7a484da3d99929e2e78ddb', 'request_id': 'req-5e7f1308-97f1-46de-8411-a5fee04fbf9e'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:41.191764 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-5e7f1308-97f1-46de-8411-a5fee04fbf9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb8f2405eb7a484da3d99929e2e78ddb', 'request_id': 'req-5e7f1308-97f1-46de-8411-a5fee04fbf9e'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:41.201601 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-5e7f1308-97f1-46de-8411-a5fee04fbf9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb8f2405eb7a484da3d99929e2e78ddb', 'request_id': 'req-5e7f1308-97f1-46de-8411-a5fee04fbf9e'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:41.215090 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-5e7f1308-97f1-46de-8411-a5fee04fbf9e admin admin] The token cache is being invalidate because project fb8f2405eb7a484da3d99929e2e78ddb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79994) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:28:41.215526 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-5e7f1308-97f1-46de-8411-a5fee04fbf9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:41.216198 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-5e7f1308-97f1-46de-8411-a5fee04fbf9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:41.217772 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1301/2584] 10.222.0.70 () {58 vars in 1232 bytes} [Tue May 10 19:28:41 2022] DELETE /identity/v3/projects/fb8f2405eb7a484da3d99929e2e78ddb => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:28:41.221698 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7f1308-97f1-46de-8411-a5fee04fbf9e admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:28:41.223181 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-5e7f1308-97f1-46de-8411-a5fee04fbf9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:28:41.244718 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f17d47-50aa-444a-9f10-7cc2cd9c7925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:28:41.245400 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f17d47-50aa-444a-9f10-7cc2cd9c7925 admin admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:41.245680 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f17d47-50aa-444a-9f10-7cc2cd9c7925 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:41.246326 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f17d47-50aa-444a-9f10-7cc2cd9c7925 admin admin] PATH_INFO: `/v3/roles` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:41.246803 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f17d47-50aa-444a-9f10-7cc2cd9c7925 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:28:41.248384 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f17d47-50aa-444a-9f10-7cc2cd9c7925 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:28:41.259490 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1284/2585] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:28:41 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 19:28:41.263922 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f17d47-50aa-444a-9f10-7cc2cd9c7925 admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:28:41.265787 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-69f17d47-50aa-444a-9f10-7cc2cd9c7925 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:28:41.278764 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f17d47-50aa-444a-9f10-7cc2cd9c7925 admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:28:41.283367 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2306f883-70a9-40c4-8c71-0000aed53d5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:28:41.284261 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2306f883-70a9-40c4-8c71-0000aed53d5f admin admin] REQUEST_METHOD: `PUT` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:41.284592 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2306f883-70a9-40c4-8c71-0000aed53d5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:41.284849 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2306f883-70a9-40c4-8c71-0000aed53d5f admin admin] PATH_INFO: `/v3/projects/73e08c3845e2444f81162e193aa07367/users/3cf6e57ddeb24ee3855f83dab2a3d5af/roles/5c07cf5bfbd3427db18428aa50420962` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:41.295709 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7f1308-97f1-46de-8411-a5fee04fbf9e admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:28:41.299589 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2306f883-70a9-40c4-8c71-0000aed53d5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=73e08c3845e2444f81162e193aa07367, user_id=3cf6e57ddeb24ee3855f83dab2a3d5af, role_id=5c07cf5bfbd3427db18428aa50420962)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:28:41.301513 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f48bc41-1e15-4988-8ab3-152e5d88e26b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:28:41.302251 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2306f883-70a9-40c4-8c71-0000aed53d5f admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:28:41.302853 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f48bc41-1e15-4988-8ab3-152e5d88e26b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:41.303315 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f48bc41-1e15-4988-8ab3-152e5d88e26b admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:41.303716 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f48bc41-1e15-4988-8ab3-152e5d88e26b admin admin] PATH_INFO: `/v3/users/12774cb15e944dc8b64bb14c70e7a872` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:41.305281 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f48bc41-1e15-4988-8ab3-152e5d88e26b admin admin] RBAC: Authorizing `identity:delete_user(user_id=12774cb15e944dc8b64bb14c70e7a872)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:28:41.307211 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f48bc41-1e15-4988-8ab3-152e5d88e26b admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:28:41.316614 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1285/2586] 10.222.0.70 () {60 vars in 1482 bytes} [Tue May 10 19:28:41 2022] PUT /identity/v3/projects/73e08c3845e2444f81162e193aa07367/users/3cf6e57ddeb24ee3855f83dab2a3d5af/roles/5c07cf5bfbd3427db18428aa50420962 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 19:28:41.328589 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff8474b-d640-4d24-84bd-cea0ab1d68ef None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:41.328900 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff8474b-d640-4d24-84bd-cea0ab1d68ef None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:41.329152 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff8474b-d640-4d24-84bd-cea0ab1d68ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:41.359265 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-5ff8474b-d640-4d24-84bd-cea0ab1d68ef None None] MFA Rules not processed for user `3cf6e57ddeb24ee3855f83dab2a3d5af`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:28:41.360486 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-5ff8474b-d640-4d24-84bd-cea0ab1d68ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:28:41.367634 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-3f48bc41-1e15-4988-8ab3-152e5d88e26b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12774cb15e944dc8b64bb14c70e7a872'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:41.380979 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-3f48bc41-1e15-4988-8ab3-152e5d88e26b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12774cb15e944dc8b64bb14c70e7a872'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:41.381804 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-3f48bc41-1e15-4988-8ab3-152e5d88e26b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12774cb15e944dc8b64bb14c70e7a872'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:41.392943 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-3f48bc41-1e15-4988-8ab3-152e5d88e26b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12774cb15e944dc8b64bb14c70e7a872'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:41.400310 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-3f48bc41-1e15-4988-8ab3-152e5d88e26b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12774cb15e944dc8b64bb14c70e7a872'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:41.416686 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1302/2587] 10.222.0.70 () {58 vars in 1223 bytes} [Tue May 10 19:28:41 2022] DELETE /identity/v3/users/12774cb15e944dc8b64bb14c70e7a872 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 19:28:41.428373 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1286/2588] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:28:41 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:28:41.459937 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f48bc41-1e15-4988-8ab3-152e5d88e26b admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:28:41.461423 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-3f48bc41-1e15-4988-8ab3-152e5d88e26b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:28:41.520016 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f48bc41-1e15-4988-8ab3-152e5d88e26b admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:28:41.523820 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8c38d3-51d5-47c2-9cfa-9481a6b80a0a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15df2a8967aa43299c10e365f4200d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:28:41.524617 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8c38d3-51d5-47c2-9cfa-9481a6b80a0a service cinder] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:41.524904 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8c38d3-51d5-47c2-9cfa-9481a6b80a0a service cinder] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:41.525180 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8c38d3-51d5-47c2-9cfa-9481a6b80a0a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:41.582303 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8c38d3-51d5-47c2-9cfa-9481a6b80a0a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:28:41.583742 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8c38d3-51d5-47c2-9cfa-9481a6b80a0a service cinder] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:28:41.591461 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff8474b-d640-4d24-84bd-cea0ab1d68ef None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:28:41.592989 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1303/2589] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:28:41 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:28:41.594984 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-5ff8474b-d640-4d24-84bd-cea0ab1d68ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:28:41.608108 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8c38d3-51d5-47c2-9cfa-9481a6b80a0a service cinder] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:28:41.609597 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-2d8c38d3-51d5-47c2-9cfa-9481a6b80a0a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:28:41.671616 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8c38d3-51d5-47c2-9cfa-9481a6b80a0a service cinder] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:28:41.671884 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff8474b-d640-4d24-84bd-cea0ab1d68ef None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:28:41.676321 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c359ee-2795-4255-b07e-5eedeb78640c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:28:41.676503 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0dea78-177d-42b8-a863-db0018e170f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:28:41.677278 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0dea78-177d-42b8-a863-db0018e170f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:41.677416 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c359ee-2795-4255-b07e-5eedeb78640c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:41.677564 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0dea78-177d-42b8-a863-db0018e170f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:41.677838 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0dea78-177d-42b8-a863-db0018e170f3 admin admin] PATH_INFO: `/v3/projects/c341256c33c245a6ab12863a9e53a7c0` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:41.677938 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c359ee-2795-4255-b07e-5eedeb78640c admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:41.678239 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c359ee-2795-4255-b07e-5eedeb78640c admin admin] PATH_INFO: `/v3/users/3cf6e57ddeb24ee3855f83dab2a3d5af` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:41.679015 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0dea78-177d-42b8-a863-db0018e170f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c341256c33c245a6ab12863a9e53a7c0)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:28:41.679567 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c359ee-2795-4255-b07e-5eedeb78640c admin admin] RBAC: Authorizing `identity:delete_user(user_id=3cf6e57ddeb24ee3855f83dab2a3d5af)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:28:41.681523 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0dea78-177d-42b8-a863-db0018e170f3 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:28:41.682066 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c359ee-2795-4255-b07e-5eedeb78640c admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:28:41.726940 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-e0c359ee-2795-4255-b07e-5eedeb78640c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3cf6e57ddeb24ee3855f83dab2a3d5af'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:41.727702 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-ca0dea78-177d-42b8-a863-db0018e170f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c341256c33c245a6ab12863a9e53a7c0', 'request_id': 'req-ca0dea78-177d-42b8-a863-db0018e170f3'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:41.732850 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-ca0dea78-177d-42b8-a863-db0018e170f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c341256c33c245a6ab12863a9e53a7c0', 'request_id': 'req-ca0dea78-177d-42b8-a863-db0018e170f3'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:41.739539 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-e0c359ee-2795-4255-b07e-5eedeb78640c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3cf6e57ddeb24ee3855f83dab2a3d5af'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:41.740327 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-ca0dea78-177d-42b8-a863-db0018e170f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c341256c33c245a6ab12863a9e53a7c0', 'request_id': 'req-ca0dea78-177d-42b8-a863-db0018e170f3'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:41.740469 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-e0c359ee-2795-4255-b07e-5eedeb78640c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3cf6e57ddeb24ee3855f83dab2a3d5af'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:41.747576 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-e0c359ee-2795-4255-b07e-5eedeb78640c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3cf6e57ddeb24ee3855f83dab2a3d5af'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:41.751131 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-ca0dea78-177d-42b8-a863-db0018e170f3 admin admin] The token cache is being invalidate because project c341256c33c245a6ab12863a9e53a7c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79993) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:28:41.751417 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-ca0dea78-177d-42b8-a863-db0018e170f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:41.752046 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-ca0dea78-177d-42b8-a863-db0018e170f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:41.753602 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1287/2590] 10.222.0.70 () {58 vars in 1232 bytes} [Tue May 10 19:28:41 2022] DELETE /identity/v3/projects/c341256c33c245a6ab12863a9e53a7c0 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:28:41.754985 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-e0c359ee-2795-4255-b07e-5eedeb78640c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3cf6e57ddeb24ee3855f83dab2a3d5af'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:41.761641 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1304/2591] 10.222.0.70 () {58 vars in 1223 bytes} [Tue May 10 19:28:41 2022] DELETE /identity/v3/users/3cf6e57ddeb24ee3855f83dab2a3d5af => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 19:28:41.766734 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fb1580-4d6c-4fce-83bf-e47676eb52e0 None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:41.766997 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fb1580-4d6c-4fce-83bf-e47676eb52e0 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:41.767260 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fb1580-4d6c-4fce-83bf-e47676eb52e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:41.786625 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-50fb1580-4d6c-4fce-83bf-e47676eb52e0 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:28:41.787871 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-50fb1580-4d6c-4fce-83bf-e47676eb52e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:28:41.856897 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1288/2592] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:28:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:28:41.867384 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c359ee-2795-4255-b07e-5eedeb78640c admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:28:41.869066 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-e0c359ee-2795-4255-b07e-5eedeb78640c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:28:41.933486 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c359ee-2795-4255-b07e-5eedeb78640c admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:28:41.937242 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd69e175-40c6-4eb5-8128-e73a47559818 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f1dc79540b48c0866478cc48cd8205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:28:41.937905 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd69e175-40c6-4eb5-8128-e73a47559818 service neutron] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:41.938190 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd69e175-40c6-4eb5-8128-e73a47559818 service neutron] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:41.938466 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd69e175-40c6-4eb5-8128-e73a47559818 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:41.949835 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd69e175-40c6-4eb5-8128-e73a47559818 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:28:41.951330 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd69e175-40c6-4eb5-8128-e73a47559818 service neutron] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:28:41.962820 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1305/2593] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:28:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:28:42.235785 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fb1580-4d6c-4fce-83bf-e47676eb52e0 None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:28:42.237235 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-50fb1580-4d6c-4fce-83bf-e47676eb52e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:28:42.249667 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fb1580-4d6c-4fce-83bf-e47676eb52e0 None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:28:42.254609 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6c3f8a-c9b7-477e-a3c7-532a1f6b7e79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:28:42.255477 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6c3f8a-c9b7-477e-a3c7-532a1f6b7e79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:42.255766 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6c3f8a-c9b7-477e-a3c7-532a1f6b7e79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:42.256711 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6c3f8a-c9b7-477e-a3c7-532a1f6b7e79 admin admin] PATH_INFO: `/v3/projects/73e08c3845e2444f81162e193aa07367` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:42.257906 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6c3f8a-c9b7-477e-a3c7-532a1f6b7e79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=73e08c3845e2444f81162e193aa07367)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:28:42.264187 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6c3f8a-c9b7-477e-a3c7-532a1f6b7e79 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:28:42.312125 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-9c6c3f8a-c9b7-477e-a3c7-532a1f6b7e79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73e08c3845e2444f81162e193aa07367', 'request_id': 'req-9c6c3f8a-c9b7-477e-a3c7-532a1f6b7e79'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:42.317584 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-9c6c3f8a-c9b7-477e-a3c7-532a1f6b7e79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73e08c3845e2444f81162e193aa07367', 'request_id': 'req-9c6c3f8a-c9b7-477e-a3c7-532a1f6b7e79'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:42.326030 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-9c6c3f8a-c9b7-477e-a3c7-532a1f6b7e79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73e08c3845e2444f81162e193aa07367', 'request_id': 'req-9c6c3f8a-c9b7-477e-a3c7-532a1f6b7e79'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:42.336710 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-9c6c3f8a-c9b7-477e-a3c7-532a1f6b7e79 admin admin] The token cache is being invalidate because project 73e08c3845e2444f81162e193aa07367 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79993) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:28:42.336996 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-9c6c3f8a-c9b7-477e-a3c7-532a1f6b7e79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:42.337611 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-9c6c3f8a-c9b7-477e-a3c7-532a1f6b7e79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:42.339138 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1289/2594] 10.222.0.70 () {58 vars in 1232 bytes} [Tue May 10 19:28:42 2022] DELETE /identity/v3/projects/73e08c3845e2444f81162e193aa07367 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:28:42.344024 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8671f7-12ae-415a-84ce-a851e0022de0 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:42.344537 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8671f7-12ae-415a-84ce-a851e0022de0 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:42.344746 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8671f7-12ae-415a-84ce-a851e0022de0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:42.361754 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-3b8671f7-12ae-415a-84ce-a851e0022de0 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:28:42.363055 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-3b8671f7-12ae-415a-84ce-a851e0022de0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:28:42.418397 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1306/2595] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:28:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:28:42.425993 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e5fc6e-4e42-4fc0-b374-7615ebc9faac None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:42.426283 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e5fc6e-4e42-4fc0-b374-7615ebc9faac None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:42.426562 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e5fc6e-4e42-4fc0-b374-7615ebc9faac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:42.449661 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-33e5fc6e-4e42-4fc0-b374-7615ebc9faac None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:28:42.450883 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-33e5fc6e-4e42-4fc0-b374-7615ebc9faac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:28:42.459174 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1290/2596] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:28:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:28:42.464737 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8671f7-12ae-415a-84ce-a851e0022de0 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:28:42.474230 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8671f7-12ae-415a-84ce-a851e0022de0 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:28:42.479400 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4de9a3-6f07-4ebd-81d5-1ed4a3ceea8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:28:42.480057 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4de9a3-6f07-4ebd-81d5-1ed4a3ceea8d admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:42.480340 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4de9a3-6f07-4ebd-81d5-1ed4a3ceea8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:42.480643 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4de9a3-6f07-4ebd-81d5-1ed4a3ceea8d admin admin] PATH_INFO: `/v3/domains` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:42.481393 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4de9a3-6f07-4ebd-81d5-1ed4a3ceea8d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:28:42.481699 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4de9a3-6f07-4ebd-81d5-1ed4a3ceea8d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:28:42.483275 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4de9a3-6f07-4ebd-81d5-1ed4a3ceea8d admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:28:42.495378 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1307/2597] 10.222.0.70 () {58 vars in 1152 bytes} [Tue May 10 19:28:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:28:42.499671 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e5fc6e-4e42-4fc0-b374-7615ebc9faac None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:28:42.511909 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e5fc6e-4e42-4fc0-b374-7615ebc9faac None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:28:42.517027 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1430a4ca-6c3b-435e-8f6c-79de9ae69333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:28:42.517684 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1430a4ca-6c3b-435e-8f6c-79de9ae69333 admin admin] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:42.517967 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1430a4ca-6c3b-435e-8f6c-79de9ae69333 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:42.518363 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1430a4ca-6c3b-435e-8f6c-79de9ae69333 admin admin] PATH_INFO: `/v3/projects` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:42.522763 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1430a4ca-6c3b-435e-8f6c-79de9ae69333 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:28:42.524716 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1430a4ca-6c3b-435e-8f6c-79de9ae69333 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:28:42.554229 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1291/2598] 10.222.0.70 () {60 vars in 1152 bytes} [Tue May 10 19:28:42 2022] POST /identity/v3/projects => generated 365 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:28:42.556298 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4de9a3-6f07-4ebd-81d5-1ed4a3ceea8d admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:28:42.566864 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4de9a3-6f07-4ebd-81d5-1ed4a3ceea8d admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:28:42.621939 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dec66c-9915-4775-9271-f2d862f7904e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:28:42.622614 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dec66c-9915-4775-9271-f2d862f7904e admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:42.622899 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dec66c-9915-4775-9271-f2d862f7904e admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:42.623176 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dec66c-9915-4775-9271-f2d862f7904e admin admin] PATH_INFO: `/v3/users` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:42.623859 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dec66c-9915-4775-9271-f2d862f7904e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:28:42.625794 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dec66c-9915-4775-9271-f2d862f7904e admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:28:42.644345 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1308/2599] 10.222.0.70 () {60 vars in 1143 bytes} [Tue May 10 19:28:42 2022] POST /identity/v3/users => generated 283 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:28:42.648591 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1430a4ca-6c3b-435e-8f6c-79de9ae69333 admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:28:42.658512 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1430a4ca-6c3b-435e-8f6c-79de9ae69333 admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:28:42.663165 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910bf29b-9f99-487d-a1a2-cb18f6feb80c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:28:42.663817 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910bf29b-9f99-487d-a1a2-cb18f6feb80c admin admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:42.664103 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910bf29b-9f99-487d-a1a2-cb18f6feb80c admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:42.664377 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910bf29b-9f99-487d-a1a2-cb18f6feb80c admin admin] PATH_INFO: `/v3/roles` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:42.665660 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910bf29b-9f99-487d-a1a2-cb18f6feb80c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:28:42.667252 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910bf29b-9f99-487d-a1a2-cb18f6feb80c admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:28:42.677295 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1292/2600] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:28:42 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:28:42.681616 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dec66c-9915-4775-9271-f2d862f7904e admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:28:42.693045 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dec66c-9915-4775-9271-f2d862f7904e admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:28:42.698197 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f30a719-7358-4db9-864b-84ad363cc529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:28:42.698885 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f30a719-7358-4db9-864b-84ad363cc529 admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:42.699173 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f30a719-7358-4db9-864b-84ad363cc529 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:42.699454 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f30a719-7358-4db9-864b-84ad363cc529 admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:42.700177 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f30a719-7358-4db9-864b-84ad363cc529 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:28:42.701826 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f30a719-7358-4db9-864b-84ad363cc529 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:28:42.712731 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1309/2601] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:28:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:28:42.716911 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910bf29b-9f99-487d-a1a2-cb18f6feb80c admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:28:42.726774 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910bf29b-9f99-487d-a1a2-cb18f6feb80c admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:28:42.731828 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7808e6-f99b-40ce-91fa-2a26a41caf32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:28:42.732733 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7808e6-f99b-40ce-91fa-2a26a41caf32 admin admin] REQUEST_METHOD: `PUT` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:42.733019 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7808e6-f99b-40ce-91fa-2a26a41caf32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:42.733294 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7808e6-f99b-40ce-91fa-2a26a41caf32 admin admin] PATH_INFO: `/v3/projects/83c453b6f1684a95a669ce73001ba24b/users/73e514644a8a421ab7b5388babac2850/roles/5c07cf5bfbd3427db18428aa50420962` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:42.747681 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7808e6-f99b-40ce-91fa-2a26a41caf32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83c453b6f1684a95a669ce73001ba24b, user_id=73e514644a8a421ab7b5388babac2850, role_id=5c07cf5bfbd3427db18428aa50420962)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:28:42.750341 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7808e6-f99b-40ce-91fa-2a26a41caf32 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:28:42.762758 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1293/2602] 10.222.0.70 () {60 vars in 1482 bytes} [Tue May 10 19:28:42 2022] PUT /identity/v3/projects/83c453b6f1684a95a669ce73001ba24b/users/73e514644a8a421ab7b5388babac2850/roles/5c07cf5bfbd3427db18428aa50420962 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:28:42.773812 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2919ba5e-8d33-4298-9b25-58fa978e5a44 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:42.774106 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2919ba5e-8d33-4298-9b25-58fa978e5a44 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:42.774387 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2919ba5e-8d33-4298-9b25-58fa978e5a44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:42.800707 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-2919ba5e-8d33-4298-9b25-58fa978e5a44 None None] MFA Rules not processed for user `73e514644a8a421ab7b5388babac2850`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:28:42.801905 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-2919ba5e-8d33-4298-9b25-58fa978e5a44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:28:42.863924 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1310/2603] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:28:42 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:28:42.874795 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7808e6-f99b-40ce-91fa-2a26a41caf32 admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:28:42.876463 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-0c7808e6-f99b-40ce-91fa-2a26a41caf32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:28:42.931859 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7808e6-f99b-40ce-91fa-2a26a41caf32 admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:28:42.935378 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a9fa9f-40aa-4631-ac2a-d494498244a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15df2a8967aa43299c10e365f4200d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:28:42.936015 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a9fa9f-40aa-4631-ac2a-d494498244a1 service cinder] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:42.936320 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a9fa9f-40aa-4631-ac2a-d494498244a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:42.936630 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a9fa9f-40aa-4631-ac2a-d494498244a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:42.946669 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a9fa9f-40aa-4631-ac2a-d494498244a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:28:42.948297 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a9fa9f-40aa-4631-ac2a-d494498244a1 service cinder] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:28:42.959063 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1294/2604] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:28:42 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:28:49.071788 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2919ba5e-8d33-4298-9b25-58fa978e5a44 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:28:49.073191 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-2919ba5e-8d33-4298-9b25-58fa978e5a44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:28:49.126765 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2919ba5e-8d33-4298-9b25-58fa978e5a44 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:28:49.130333 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237bb4bb-930f-4dee-bbdf-e7bfa97db535 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f1dc79540b48c0866478cc48cd8205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:28:49.130977 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237bb4bb-930f-4dee-bbdf-e7bfa97db535 service neutron] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:49.131260 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237bb4bb-930f-4dee-bbdf-e7bfa97db535 service neutron] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:49.131535 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237bb4bb-930f-4dee-bbdf-e7bfa97db535 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:49.133850 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-237bb4bb-930f-4dee-bbdf-e7bfa97db535 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:28:49.195106 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237bb4bb-930f-4dee-bbdf-e7bfa97db535 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:28:49.197233 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237bb4bb-930f-4dee-bbdf-e7bfa97db535 service neutron] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:28:49.206972 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1311/2605] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:28:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:28:52.825029 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a9fa9f-40aa-4631-ac2a-d494498244a1 service cinder] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:28:52.826663 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-89a9fa9f-40aa-4631-ac2a-d494498244a1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:28:52.841489 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a9fa9f-40aa-4631-ac2a-d494498244a1 service cinder] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:28:52.847283 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8114e1-300c-427c-b332-477a56570c0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:28:52.848238 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8114e1-300c-427c-b332-477a56570c0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:52.848623 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8114e1-300c-427c-b332-477a56570c0d admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:52.848972 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8114e1-300c-427c-b332-477a56570c0d admin admin] PATH_INFO: `/v3/users/db6fd87ab33946808f4153585fc1d07a` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:52.850223 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8114e1-300c-427c-b332-477a56570c0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=db6fd87ab33946808f4153585fc1d07a)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:28:52.860448 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8114e1-300c-427c-b332-477a56570c0d admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:28:52.906833 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-dd8114e1-300c-427c-b332-477a56570c0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db6fd87ab33946808f4153585fc1d07a'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:52.918269 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-dd8114e1-300c-427c-b332-477a56570c0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db6fd87ab33946808f4153585fc1d07a'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:52.924881 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-dd8114e1-300c-427c-b332-477a56570c0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db6fd87ab33946808f4153585fc1d07a'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:52.925593 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-dd8114e1-300c-427c-b332-477a56570c0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db6fd87ab33946808f4153585fc1d07a'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:52.934045 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-dd8114e1-300c-427c-b332-477a56570c0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db6fd87ab33946808f4153585fc1d07a'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:52.940112 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1295/2606] 10.222.0.70 () {58 vars in 1223 bytes} [Tue May 10 19:28:52 2022] DELETE /identity/v3/users/db6fd87ab33946808f4153585fc1d07a => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:28:53.112931 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237bb4bb-930f-4dee-bbdf-e7bfa97db535 service neutron] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:28:53.131313 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237bb4bb-930f-4dee-bbdf-e7bfa97db535 service neutron] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:28:53.185996 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791587ef-2efb-4134-a163-5a575b34277f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:28:53.186854 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791587ef-2efb-4134-a163-5a575b34277f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:53.187130 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791587ef-2efb-4134-a163-5a575b34277f admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:53.187398 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791587ef-2efb-4134-a163-5a575b34277f admin admin] PATH_INFO: `/v3/projects/758b8f4f3d1c4242822940f17246d98f` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:53.188593 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791587ef-2efb-4134-a163-5a575b34277f admin admin] RBAC: Authorizing `identity:delete_project(project_id=758b8f4f3d1c4242822940f17246d98f)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:28:53.190496 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791587ef-2efb-4134-a163-5a575b34277f admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:28:53.234423 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-791587ef-2efb-4134-a163-5a575b34277f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '758b8f4f3d1c4242822940f17246d98f', 'request_id': 'req-791587ef-2efb-4134-a163-5a575b34277f'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:53.240018 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-791587ef-2efb-4134-a163-5a575b34277f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '758b8f4f3d1c4242822940f17246d98f', 'request_id': 'req-791587ef-2efb-4134-a163-5a575b34277f'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:53.249107 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-791587ef-2efb-4134-a163-5a575b34277f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '758b8f4f3d1c4242822940f17246d98f', 'request_id': 'req-791587ef-2efb-4134-a163-5a575b34277f'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:53.262162 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-791587ef-2efb-4134-a163-5a575b34277f admin admin] The token cache is being invalidate because project 758b8f4f3d1c4242822940f17246d98f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79994) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:28:53.262499 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-791587ef-2efb-4134-a163-5a575b34277f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:53.263160 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-791587ef-2efb-4134-a163-5a575b34277f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:53.264770 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1312/2607] 10.222.0.70 () {58 vars in 1232 bytes} [Tue May 10 19:28:53 2022] DELETE /identity/v3/projects/758b8f4f3d1c4242822940f17246d98f => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:28:53.270385 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a7930e-d2bf-4a8e-bc27-510783359f3a None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:53.270814 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a7930e-d2bf-4a8e-bc27-510783359f3a None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:53.271154 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a7930e-d2bf-4a8e-bc27-510783359f3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:53.290244 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-73a7930e-d2bf-4a8e-bc27-510783359f3a None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:28:53.291001 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-73a7930e-d2bf-4a8e-bc27-510783359f3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:28:53.295181 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791587ef-2efb-4134-a163-5a575b34277f admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:28:53.296560 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-791587ef-2efb-4134-a163-5a575b34277f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:28:53.352340 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1296/2608] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:28:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:28:53.361690 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116c8d99-22ee-46a9-8970-3d6539290e85 None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:53.361989 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116c8d99-22ee-46a9-8970-3d6539290e85 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:53.362295 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116c8d99-22ee-46a9-8970-3d6539290e85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:53.366594 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791587ef-2efb-4134-a163-5a575b34277f admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:28:53.371606 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa4c76d-2609-44ee-b6fa-e100031b15d5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b95d3824f34cfcada6915ee57a7e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:28:53.372252 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa4c76d-2609-44ee-b6fa-e100031b15d5 service placement] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:53.372568 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa4c76d-2609-44ee-b6fa-e100031b15d5 service placement] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:53.372848 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa4c76d-2609-44ee-b6fa-e100031b15d5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:53.374607 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-0fa4c76d-2609-44ee-b6fa-e100031b15d5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:28:53.380215 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-116c8d99-22ee-46a9-8970-3d6539290e85 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:28:53.381484 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-116c8d99-22ee-46a9-8970-3d6539290e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:28:53.386200 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa4c76d-2609-44ee-b6fa-e100031b15d5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:28:53.387886 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa4c76d-2609-44ee-b6fa-e100031b15d5 service placement] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:28:53.389714 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1297/2609] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:28:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:28:53.393590 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116c8d99-22ee-46a9-8970-3d6539290e85 None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:28:53.401213 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1313/2610] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:28:53 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 19:28:53.402940 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116c8d99-22ee-46a9-8970-3d6539290e85 None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:28:53.407705 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50259bca-4fc9-43bb-8efb-63f6d57ecc54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:28:53.408365 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50259bca-4fc9-43bb-8efb-63f6d57ecc54 admin admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:53.408704 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50259bca-4fc9-43bb-8efb-63f6d57ecc54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:53.408987 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50259bca-4fc9-43bb-8efb-63f6d57ecc54 admin admin] PATH_INFO: `/v3/domains` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:53.409714 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50259bca-4fc9-43bb-8efb-63f6d57ecc54 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:28:53.410022 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50259bca-4fc9-43bb-8efb-63f6d57ecc54 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:28:53.411645 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50259bca-4fc9-43bb-8efb-63f6d57ecc54 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:28:53.424107 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1298/2611] 10.222.0.70 () {58 vars in 1152 bytes} [Tue May 10 19:28:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:28:53.428442 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa4c76d-2609-44ee-b6fa-e100031b15d5 service placement] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:28:53.438488 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa4c76d-2609-44ee-b6fa-e100031b15d5 service placement] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:28:53.443369 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdbd550-c1cd-4b0d-aaf9-dbfa15f8d1bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:28:53.444018 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdbd550-c1cd-4b0d-aaf9-dbfa15f8d1bb admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:53.444298 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdbd550-c1cd-4b0d-aaf9-dbfa15f8d1bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:53.444614 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdbd550-c1cd-4b0d-aaf9-dbfa15f8d1bb admin admin] PATH_INFO: `/v3/projects` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:53.445295 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdbd550-c1cd-4b0d-aaf9-dbfa15f8d1bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:28:53.447173 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdbd550-c1cd-4b0d-aaf9-dbfa15f8d1bb admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:28:53.474591 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1314/2612] 10.222.0.70 () {60 vars in 1152 bytes} [Tue May 10 19:28:53 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:28:53.479265 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50259bca-4fc9-43bb-8efb-63f6d57ecc54 admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:28:53.489173 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50259bca-4fc9-43bb-8efb-63f6d57ecc54 admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:28:53.545412 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea381ddc-9f19-463b-9e38-8015131b7fd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:28:53.546166 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea381ddc-9f19-463b-9e38-8015131b7fd6 admin admin] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:53.546517 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea381ddc-9f19-463b-9e38-8015131b7fd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:53.546898 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea381ddc-9f19-463b-9e38-8015131b7fd6 admin admin] PATH_INFO: `/v3/users` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:53.547679 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea381ddc-9f19-463b-9e38-8015131b7fd6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:28:53.549685 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea381ddc-9f19-463b-9e38-8015131b7fd6 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:28:53.568754 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1299/2613] 10.222.0.70 () {60 vars in 1143 bytes} [Tue May 10 19:28:53 2022] POST /identity/v3/users => generated 287 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 19:28:53.572734 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdbd550-c1cd-4b0d-aaf9-dbfa15f8d1bb admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:28:53.582665 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdbd550-c1cd-4b0d-aaf9-dbfa15f8d1bb admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:28:53.587720 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03371a9-5050-4251-9a88-6fb55bfdcf26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:28:53.588367 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03371a9-5050-4251-9a88-6fb55bfdcf26 admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:53.588681 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03371a9-5050-4251-9a88-6fb55bfdcf26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:53.588957 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03371a9-5050-4251-9a88-6fb55bfdcf26 admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:53.589668 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03371a9-5050-4251-9a88-6fb55bfdcf26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:28:53.591241 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03371a9-5050-4251-9a88-6fb55bfdcf26 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:28:53.602810 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1315/2614] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:28:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:28:53.606668 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea381ddc-9f19-463b-9e38-8015131b7fd6 admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:28:53.616572 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea381ddc-9f19-463b-9e38-8015131b7fd6 admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:28:53.621226 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee75c65-fedc-4373-aa51-208ec4b14cac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:28:53.621837 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee75c65-fedc-4373-aa51-208ec4b14cac admin admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:53.622122 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee75c65-fedc-4373-aa51-208ec4b14cac admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:53.622393 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee75c65-fedc-4373-aa51-208ec4b14cac admin admin] PATH_INFO: `/v3/roles` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:53.623098 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee75c65-fedc-4373-aa51-208ec4b14cac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:28:53.624700 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee75c65-fedc-4373-aa51-208ec4b14cac admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:28:53.634191 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1300/2615] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:28:53 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 19:28:53.638265 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03371a9-5050-4251-9a88-6fb55bfdcf26 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:28:53.647909 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03371a9-5050-4251-9a88-6fb55bfdcf26 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:28:53.652934 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7e7d17-9ead-4ac2-9856-0d6bd906329b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:28:53.653800 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7e7d17-9ead-4ac2-9856-0d6bd906329b admin admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:53.654076 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7e7d17-9ead-4ac2-9856-0d6bd906329b admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:53.654344 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7e7d17-9ead-4ac2-9856-0d6bd906329b admin admin] PATH_INFO: `/v3/projects/91b230e27baf49a6937368429b8af742/users/1fc0bac58efb42ebae5f57f1af28f58a/roles/5c07cf5bfbd3427db18428aa50420962` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:53.669029 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7e7d17-9ead-4ac2-9856-0d6bd906329b admin admin] RBAC: Authorizing `identity:create_grant(project_id=91b230e27baf49a6937368429b8af742, user_id=1fc0bac58efb42ebae5f57f1af28f58a, role_id=5c07cf5bfbd3427db18428aa50420962)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:28:53.671640 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7e7d17-9ead-4ac2-9856-0d6bd906329b admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:28:53.684728 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1316/2616] 10.222.0.70 () {60 vars in 1482 bytes} [Tue May 10 19:28:53 2022] PUT /identity/v3/projects/91b230e27baf49a6937368429b8af742/users/1fc0bac58efb42ebae5f57f1af28f58a/roles/5c07cf5bfbd3427db18428aa50420962 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:28:53.694953 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4626e646-c4d6-4ada-96ce-92bcde0ef143 None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:53.695750 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4626e646-c4d6-4ada-96ce-92bcde0ef143 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:53.696028 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4626e646-c4d6-4ada-96ce-92bcde0ef143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:53.723436 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-4626e646-c4d6-4ada-96ce-92bcde0ef143 None None] MFA Rules not processed for user `1fc0bac58efb42ebae5f57f1af28f58a`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:28:53.724943 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-4626e646-c4d6-4ada-96ce-92bcde0ef143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:28:53.785879 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1301/2617] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:28:53 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:28:53.796805 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7e7d17-9ead-4ac2-9856-0d6bd906329b admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:28:53.798513 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-3e7e7d17-9ead-4ac2-9856-0d6bd906329b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:28:53.871297 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7e7d17-9ead-4ac2-9856-0d6bd906329b admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:28:53.880301 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c252f88a-62f9-45f6-9248-4aaf4f5fd843 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9f310a468ec4058b3c95356ea60ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:28:53.880990 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c252f88a-62f9-45f6-9248-4aaf4f5fd843 service nova] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:53.881278 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c252f88a-62f9-45f6-9248-4aaf4f5fd843 service nova] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:53.881662 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c252f88a-62f9-45f6-9248-4aaf4f5fd843 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:53.890063 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c252f88a-62f9-45f6-9248-4aaf4f5fd843 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:28:53.891635 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c252f88a-62f9-45f6-9248-4aaf4f5fd843 service nova] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:28:53.909005 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1317/2618] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:28:53 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:28:56.646981 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4626e646-c4d6-4ada-96ce-92bcde0ef143 None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:28:56.735780 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4626e646-c4d6-4ada-96ce-92bcde0ef143 None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:28:56.740528 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca93091-c60c-4d80-b647-52c4ce324e45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:28:56.741402 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca93091-c60c-4d80-b647-52c4ce324e45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:56.742210 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca93091-c60c-4d80-b647-52c4ce324e45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:56.742210 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca93091-c60c-4d80-b647-52c4ce324e45 admin admin] PATH_INFO: `/v3/users/1fc0bac58efb42ebae5f57f1af28f58a` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:56.743181 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca93091-c60c-4d80-b647-52c4ce324e45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1fc0bac58efb42ebae5f57f1af28f58a)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:28:56.745783 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca93091-c60c-4d80-b647-52c4ce324e45 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:28:56.794681 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-6ca93091-c60c-4d80-b647-52c4ce324e45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1fc0bac58efb42ebae5f57f1af28f58a'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:56.806159 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-6ca93091-c60c-4d80-b647-52c4ce324e45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1fc0bac58efb42ebae5f57f1af28f58a'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:56.813865 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-6ca93091-c60c-4d80-b647-52c4ce324e45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1fc0bac58efb42ebae5f57f1af28f58a'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:56.814662 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-6ca93091-c60c-4d80-b647-52c4ce324e45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1fc0bac58efb42ebae5f57f1af28f58a'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:56.822874 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-6ca93091-c60c-4d80-b647-52c4ce324e45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1fc0bac58efb42ebae5f57f1af28f58a'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:56.829418 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1302/2619] 10.222.0.70 () {58 vars in 1223 bytes} [Tue May 10 19:28:56 2022] DELETE /identity/v3/users/1fc0bac58efb42ebae5f57f1af28f58a => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:28:56.833976 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2294ba3a-25b0-4204-b5bf-3e425192e73f None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:56.834439 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2294ba3a-25b0-4204-b5bf-3e425192e73f None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:56.834724 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2294ba3a-25b0-4204-b5bf-3e425192e73f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:56.852911 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-2294ba3a-25b0-4204-b5bf-3e425192e73f None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:28:56.854287 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-2294ba3a-25b0-4204-b5bf-3e425192e73f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:28:56.921033 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1318/2620] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:28:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:28:56.931622 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca93091-c60c-4d80-b647-52c4ce324e45 admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:28:56.932751 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-6ca93091-c60c-4d80-b647-52c4ce324e45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:28:56.998635 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca93091-c60c-4d80-b647-52c4ce324e45 admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:28:57.002351 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fd21b5-17cf-4ee3-a6aa-209086f1d58b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f1dc79540b48c0866478cc48cd8205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:28:57.003059 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fd21b5-17cf-4ee3-a6aa-209086f1d58b service neutron] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:57.003406 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fd21b5-17cf-4ee3-a6aa-209086f1d58b service neutron] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:57.003798 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fd21b5-17cf-4ee3-a6aa-209086f1d58b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:57.013477 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fd21b5-17cf-4ee3-a6aa-209086f1d58b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:28:57.014992 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fd21b5-17cf-4ee3-a6aa-209086f1d58b service neutron] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:28:57.025229 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1303/2621] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:28:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 19:28:57.378898 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2294ba3a-25b0-4204-b5bf-3e425192e73f None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:28:57.380463 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-2294ba3a-25b0-4204-b5bf-3e425192e73f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:28:57.393208 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2294ba3a-25b0-4204-b5bf-3e425192e73f None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:28:57.409066 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8751b0e2-05ff-446f-a5c8-5733a7ad4798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:28:57.410025 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8751b0e2-05ff-446f-a5c8-5733a7ad4798 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:57.410315 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8751b0e2-05ff-446f-a5c8-5733a7ad4798 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:57.410621 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8751b0e2-05ff-446f-a5c8-5733a7ad4798 admin admin] PATH_INFO: `/v3/projects/91b230e27baf49a6937368429b8af742` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:57.411893 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8751b0e2-05ff-446f-a5c8-5733a7ad4798 admin admin] RBAC: Authorizing `identity:delete_project(project_id=91b230e27baf49a6937368429b8af742)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:28:57.414085 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8751b0e2-05ff-446f-a5c8-5733a7ad4798 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:28:57.472725 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-8751b0e2-05ff-446f-a5c8-5733a7ad4798 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91b230e27baf49a6937368429b8af742', 'request_id': 'req-8751b0e2-05ff-446f-a5c8-5733a7ad4798'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:57.479225 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-8751b0e2-05ff-446f-a5c8-5733a7ad4798 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91b230e27baf49a6937368429b8af742', 'request_id': 'req-8751b0e2-05ff-446f-a5c8-5733a7ad4798'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:57.487116 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-8751b0e2-05ff-446f-a5c8-5733a7ad4798 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91b230e27baf49a6937368429b8af742', 'request_id': 'req-8751b0e2-05ff-446f-a5c8-5733a7ad4798'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:57.498438 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-8751b0e2-05ff-446f-a5c8-5733a7ad4798 admin admin] The token cache is being invalidate because project 91b230e27baf49a6937368429b8af742 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79994) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:28:57.498725 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-8751b0e2-05ff-446f-a5c8-5733a7ad4798 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:57.499385 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-8751b0e2-05ff-446f-a5c8-5733a7ad4798 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:28:57.500952 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1319/2622] 10.222.0.70 () {58 vars in 1232 bytes} [Tue May 10 19:28:57 2022] DELETE /identity/v3/projects/91b230e27baf49a6937368429b8af742 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:28:57.505720 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bea46b-7b94-4a9a-ad03-4ed96af536e5 None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:57.506009 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bea46b-7b94-4a9a-ad03-4ed96af536e5 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:57.506284 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bea46b-7b94-4a9a-ad03-4ed96af536e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:57.523054 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-86bea46b-7b94-4a9a-ad03-4ed96af536e5 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:28:57.524253 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-86bea46b-7b94-4a9a-ad03-4ed96af536e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:28:57.581848 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1304/2623] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:28:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:28:57.589751 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1ac1e6-b036-45db-81dd-12ac20ec53c6 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:57.590256 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1ac1e6-b036-45db-81dd-12ac20ec53c6 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:57.590537 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1ac1e6-b036-45db-81dd-12ac20ec53c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:57.611322 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-bf1ac1e6-b036-45db-81dd-12ac20ec53c6 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:28:57.612612 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-bf1ac1e6-b036-45db-81dd-12ac20ec53c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:28:57.621611 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1320/2624] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:28:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:28:57.625888 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bea46b-7b94-4a9a-ad03-4ed96af536e5 None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:28:57.635492 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bea46b-7b94-4a9a-ad03-4ed96af536e5 None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:28:57.640091 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b625d0b-f594-4d70-ae5b-53fec4b6073d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:28:57.640789 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b625d0b-f594-4d70-ae5b-53fec4b6073d admin admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:57.641075 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b625d0b-f594-4d70-ae5b-53fec4b6073d admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:57.641347 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b625d0b-f594-4d70-ae5b-53fec4b6073d admin admin] PATH_INFO: `/v3/domains` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:57.642066 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b625d0b-f594-4d70-ae5b-53fec4b6073d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:28:57.642366 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b625d0b-f594-4d70-ae5b-53fec4b6073d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:28:57.643954 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b625d0b-f594-4d70-ae5b-53fec4b6073d admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:28:57.656092 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1305/2625] 10.222.0.70 () {58 vars in 1152 bytes} [Tue May 10 19:28:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:28:57.660396 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1ac1e6-b036-45db-81dd-12ac20ec53c6 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:28:57.670275 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1ac1e6-b036-45db-81dd-12ac20ec53c6 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:28:57.675007 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da25b05-e739-44cc-8259-52860c97167f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:28:57.675709 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da25b05-e739-44cc-8259-52860c97167f admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:57.675990 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da25b05-e739-44cc-8259-52860c97167f admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:57.676281 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da25b05-e739-44cc-8259-52860c97167f admin admin] PATH_INFO: `/v3/projects` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:57.676984 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da25b05-e739-44cc-8259-52860c97167f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:28:57.679149 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da25b05-e739-44cc-8259-52860c97167f admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:28:57.710861 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1321/2626] 10.222.0.70 () {60 vars in 1152 bytes} [Tue May 10 19:28:57 2022] POST /identity/v3/projects => generated 381 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:28:57.714770 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b625d0b-f594-4d70-ae5b-53fec4b6073d admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:28:57.724704 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b625d0b-f594-4d70-ae5b-53fec4b6073d admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:28:57.791793 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291d11f0-7764-4d33-8d36-60d5cca1588f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:28:57.792727 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291d11f0-7764-4d33-8d36-60d5cca1588f admin admin] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:57.793086 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291d11f0-7764-4d33-8d36-60d5cca1588f admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:57.793431 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291d11f0-7764-4d33-8d36-60d5cca1588f admin admin] PATH_INFO: `/v3/users` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:57.794333 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291d11f0-7764-4d33-8d36-60d5cca1588f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:28:57.796663 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291d11f0-7764-4d33-8d36-60d5cca1588f admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:28:57.832414 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1306/2627] 10.222.0.70 () {60 vars in 1143 bytes} [Tue May 10 19:28:57 2022] POST /identity/v3/users => generated 291 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:28:57.833823 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da25b05-e739-44cc-8259-52860c97167f admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:28:57.849510 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da25b05-e739-44cc-8259-52860c97167f admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:28:57.856634 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8421584-f204-4fc7-ba55-26c557a2d9f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:28:57.857663 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8421584-f204-4fc7-ba55-26c557a2d9f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:57.858133 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8421584-f204-4fc7-ba55-26c557a2d9f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:57.858580 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8421584-f204-4fc7-ba55-26c557a2d9f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:57.859476 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8421584-f204-4fc7-ba55-26c557a2d9f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:28:57.861534 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8421584-f204-4fc7-ba55-26c557a2d9f9 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:28:57.883442 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291d11f0-7764-4d33-8d36-60d5cca1588f admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:28:57.883794 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1322/2628] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:28:57 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:28:57.893574 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291d11f0-7764-4d33-8d36-60d5cca1588f admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:28:57.899296 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3ddeb9-2788-4dbc-9b88-555e5a31469f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:28:57.900258 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3ddeb9-2788-4dbc-9b88-555e5a31469f admin admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:57.900778 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3ddeb9-2788-4dbc-9b88-555e5a31469f admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:57.901246 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3ddeb9-2788-4dbc-9b88-555e5a31469f admin admin] PATH_INFO: `/v3/roles` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:57.902623 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3ddeb9-2788-4dbc-9b88-555e5a31469f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:28:57.904460 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3ddeb9-2788-4dbc-9b88-555e5a31469f admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:28:57.924099 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1307/2629] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:28:57 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:28:57.925084 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8421584-f204-4fc7-ba55-26c557a2d9f9 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:28:57.940895 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8421584-f204-4fc7-ba55-26c557a2d9f9 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:28:57.953499 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4f1f77-f212-4e0e-a7b6-f8f911a106b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:28:57.954494 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4f1f77-f212-4e0e-a7b6-f8f911a106b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:57.954729 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4f1f77-f212-4e0e-a7b6-f8f911a106b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:57.955009 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4f1f77-f212-4e0e-a7b6-f8f911a106b9 admin admin] PATH_INFO: `/v3/projects/75de448cb9bf4325873a2fa048848fcc/users/998262c67ecd4156ab8ff1cf3a489993/roles/5c07cf5bfbd3427db18428aa50420962` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:57.995758 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4f1f77-f212-4e0e-a7b6-f8f911a106b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75de448cb9bf4325873a2fa048848fcc, user_id=998262c67ecd4156ab8ff1cf3a489993, role_id=5c07cf5bfbd3427db18428aa50420962)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:28:57.998871 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4f1f77-f212-4e0e-a7b6-f8f911a106b9 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:28:58.029752 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1323/2630] 10.222.0.70 () {60 vars in 1482 bytes} [Tue May 10 19:28:57 2022] PUT /identity/v3/projects/75de448cb9bf4325873a2fa048848fcc/users/998262c67ecd4156ab8ff1cf3a489993/roles/5c07cf5bfbd3427db18428aa50420962 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:28:58.042187 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a051678-6b74-48e6-8184-7232933fcc32 None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:58.042610 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a051678-6b74-48e6-8184-7232933fcc32 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:58.043070 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a051678-6b74-48e6-8184-7232933fcc32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:58.079613 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-1a051678-6b74-48e6-8184-7232933fcc32 None None] MFA Rules not processed for user `998262c67ecd4156ab8ff1cf3a489993`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:28:58.081014 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-1a051678-6b74-48e6-8184-7232933fcc32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:28:58.173026 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1308/2631] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:28:58 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:28:58.177848 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4f1f77-f212-4e0e-a7b6-f8f911a106b9 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:28:58.260517 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4f1f77-f212-4e0e-a7b6-f8f911a106b9 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:28:58.268323 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71da8c8-6a55-4ba9-9c90-810681a068ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:28:58.269555 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71da8c8-6a55-4ba9-9c90-810681a068ec admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:58.270264 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71da8c8-6a55-4ba9-9c90-810681a068ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:58.271023 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71da8c8-6a55-4ba9-9c90-810681a068ec admin admin] PATH_INFO: `/v3/projects` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:58.271802 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71da8c8-6a55-4ba9-9c90-810681a068ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:28:58.275337 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71da8c8-6a55-4ba9-9c90-810681a068ec admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:28:58.313740 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1324/2632] 10.222.0.70 () {60 vars in 1152 bytes} [Tue May 10 19:28:58 2022] POST /identity/v3/projects => generated 381 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:28:58.317422 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a051678-6b74-48e6-8184-7232933fcc32 None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:28:58.332394 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a051678-6b74-48e6-8184-7232933fcc32 None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:28:58.410397 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eee0697-2449-4f34-85bf-621980303988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:28:58.410397 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eee0697-2449-4f34-85bf-621980303988 admin admin] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:58.410397 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eee0697-2449-4f34-85bf-621980303988 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:58.410397 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eee0697-2449-4f34-85bf-621980303988 admin admin] PATH_INFO: `/v3/users` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:58.410818 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eee0697-2449-4f34-85bf-621980303988 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:28:58.411486 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eee0697-2449-4f34-85bf-621980303988 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:28:58.434835 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1309/2633] 10.222.0.70 () {60 vars in 1143 bytes} [Tue May 10 19:28:58 2022] POST /identity/v3/users => generated 297 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 19:28:58.438653 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71da8c8-6a55-4ba9-9c90-810681a068ec admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:28:58.451336 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71da8c8-6a55-4ba9-9c90-810681a068ec admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:28:58.456916 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f98cec-a44c-4326-a753-c64e49ae1885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:28:58.457771 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f98cec-a44c-4326-a753-c64e49ae1885 admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:58.458049 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f98cec-a44c-4326-a753-c64e49ae1885 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:58.458379 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f98cec-a44c-4326-a753-c64e49ae1885 admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:58.459042 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f98cec-a44c-4326-a753-c64e49ae1885 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:28:58.460740 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f98cec-a44c-4326-a753-c64e49ae1885 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:28:58.473592 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1325/2634] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:28:58 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:28:58.477636 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eee0697-2449-4f34-85bf-621980303988 admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:28:58.487722 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eee0697-2449-4f34-85bf-621980303988 admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:28:58.492835 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da87dc1-4fe1-424f-a4b4-234070cff76d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:28:58.493734 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da87dc1-4fe1-424f-a4b4-234070cff76d admin admin] REQUEST_METHOD: `PUT` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:58.494016 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da87dc1-4fe1-424f-a4b4-234070cff76d admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:58.494287 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da87dc1-4fe1-424f-a4b4-234070cff76d admin admin] PATH_INFO: `/v3/projects/408178bb26d545989895ea960bd8d38f/users/27362514ce03433cb97b41e014d8ebeb/roles/634ba284303b4626b5a0402772c68f5c` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:58.509875 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da87dc1-4fe1-424f-a4b4-234070cff76d admin admin] RBAC: Authorizing `identity:create_grant(project_id=408178bb26d545989895ea960bd8d38f, user_id=27362514ce03433cb97b41e014d8ebeb, role_id=634ba284303b4626b5a0402772c68f5c)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:28:58.512548 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da87dc1-4fe1-424f-a4b4-234070cff76d admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:28:58.524981 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1310/2635] 10.222.0.70 () {60 vars in 1482 bytes} [Tue May 10 19:28:58 2022] PUT /identity/v3/projects/408178bb26d545989895ea960bd8d38f/users/27362514ce03433cb97b41e014d8ebeb/roles/634ba284303b4626b5a0402772c68f5c => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 19:28:58.529038 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f98cec-a44c-4326-a753-c64e49ae1885 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:28:58.539093 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f98cec-a44c-4326-a753-c64e49ae1885 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:28:58.598977 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b14948-8bf8-470b-9431-8eab23e50e26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:28:58.599748 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b14948-8bf8-470b-9431-8eab23e50e26 admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:58.600031 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b14948-8bf8-470b-9431-8eab23e50e26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:58.600307 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b14948-8bf8-470b-9431-8eab23e50e26 admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:58.601069 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b14948-8bf8-470b-9431-8eab23e50e26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:28:58.602707 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b14948-8bf8-470b-9431-8eab23e50e26 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:28:58.614087 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1326/2636] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:28:58 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:28:58.619065 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da87dc1-4fe1-424f-a4b4-234070cff76d admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:28:58.630930 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da87dc1-4fe1-424f-a4b4-234070cff76d admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:28:58.637089 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b093d38e-fb20-4899-8606-ac5cdb5abc1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:28:58.638116 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b093d38e-fb20-4899-8606-ac5cdb5abc1e admin admin] REQUEST_METHOD: `PUT` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:58.638412 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b093d38e-fb20-4899-8606-ac5cdb5abc1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:58.638692 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b093d38e-fb20-4899-8606-ac5cdb5abc1e admin admin] PATH_INFO: `/v3/projects/408178bb26d545989895ea960bd8d38f/users/27362514ce03433cb97b41e014d8ebeb/roles/634ba284303b4626b5a0402772c68f5c` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:58.641372 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b093d38e-fb20-4899-8606-ac5cdb5abc1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=408178bb26d545989895ea960bd8d38f, user_id=27362514ce03433cb97b41e014d8ebeb, role_id=634ba284303b4626b5a0402772c68f5c)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:28:58.646749 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b093d38e-fb20-4899-8606-ac5cdb5abc1e admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:28:58.658444 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1311/2637] 10.222.0.70 () {60 vars in 1482 bytes} [Tue May 10 19:28:58 2022] PUT /identity/v3/projects/408178bb26d545989895ea960bd8d38f/users/27362514ce03433cb97b41e014d8ebeb/roles/634ba284303b4626b5a0402772c68f5c => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 19:28:58.668648 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba74de09-9793-4dea-a277-76c1c9472d97 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:58.669045 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba74de09-9793-4dea-a277-76c1c9472d97 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:58.669403 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba74de09-9793-4dea-a277-76c1c9472d97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:58.699906 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-ba74de09-9793-4dea-a277-76c1c9472d97 None None] MFA Rules not processed for user `27362514ce03433cb97b41e014d8ebeb`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:28:58.701149 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-ba74de09-9793-4dea-a277-76c1c9472d97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:28:58.782204 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1327/2638] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:28:58 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:28:58.794340 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b093d38e-fb20-4899-8606-ac5cdb5abc1e admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:28:58.796281 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-b093d38e-fb20-4899-8606-ac5cdb5abc1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:28:58.863773 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b093d38e-fb20-4899-8606-ac5cdb5abc1e admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:28:58.869398 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd158de3-6b27-4f73-88e8-63f0493a880d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15df2a8967aa43299c10e365f4200d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:28:58.870063 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd158de3-6b27-4f73-88e8-63f0493a880d service cinder] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:58.870347 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd158de3-6b27-4f73-88e8-63f0493a880d service cinder] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:58.870624 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd158de3-6b27-4f73-88e8-63f0493a880d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:58.892510 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd158de3-6b27-4f73-88e8-63f0493a880d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:28:58.894864 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd158de3-6b27-4f73-88e8-63f0493a880d service cinder] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:28:58.905892 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1312/2639] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:28:58 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:28:59.033440 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba74de09-9793-4dea-a277-76c1c9472d97 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:28:59.046177 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba74de09-9793-4dea-a277-76c1c9472d97 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:28:59.050421 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46f4cab-6dfb-4826-bdd2-babaa75bfecd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15df2a8967aa43299c10e365f4200d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:28:59.051110 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46f4cab-6dfb-4826-bdd2-babaa75bfecd service cinder] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:28:59.051489 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46f4cab-6dfb-4826-bdd2-babaa75bfecd service cinder] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:28:59.053680 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46f4cab-6dfb-4826-bdd2-babaa75bfecd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:28:59.116677 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46f4cab-6dfb-4826-bdd2-babaa75bfecd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:28:59.118799 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46f4cab-6dfb-4826-bdd2-babaa75bfecd service cinder] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:28:59.128781 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1328/2640] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:28:59 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:29:01.713592 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd158de3-6b27-4f73-88e8-63f0493a880d service cinder] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:01.774671 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd158de3-6b27-4f73-88e8-63f0493a880d service cinder] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:01.779661 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962846ed-1aad-4f4e-9e9c-b1deafd42e5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:01.780603 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962846ed-1aad-4f4e-9e9c-b1deafd42e5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:01.780886 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962846ed-1aad-4f4e-9e9c-b1deafd42e5e admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:01.781153 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962846ed-1aad-4f4e-9e9c-b1deafd42e5e admin admin] PATH_INFO: `/v3/users/998262c67ecd4156ab8ff1cf3a489993` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:01.782347 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962846ed-1aad-4f4e-9e9c-b1deafd42e5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=998262c67ecd4156ab8ff1cf3a489993)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:01.784265 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962846ed-1aad-4f4e-9e9c-b1deafd42e5e admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:01.829162 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-962846ed-1aad-4f4e-9e9c-b1deafd42e5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '998262c67ecd4156ab8ff1cf3a489993'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:01.840783 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-962846ed-1aad-4f4e-9e9c-b1deafd42e5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '998262c67ecd4156ab8ff1cf3a489993'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:01.847455 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-962846ed-1aad-4f4e-9e9c-b1deafd42e5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '998262c67ecd4156ab8ff1cf3a489993'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:01.848174 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-962846ed-1aad-4f4e-9e9c-b1deafd42e5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '998262c67ecd4156ab8ff1cf3a489993'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:01.856983 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-962846ed-1aad-4f4e-9e9c-b1deafd42e5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '998262c67ecd4156ab8ff1cf3a489993'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:01.862894 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1313/2641] 10.222.0.70 () {58 vars in 1223 bytes} [Tue May 10 19:29:01 2022] DELETE /identity/v3/users/998262c67ecd4156ab8ff1cf3a489993 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:29:01.867427 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37fa3d4-3073-491c-a0f7-7c3ac27f6e16 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:01.867891 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37fa3d4-3073-491c-a0f7-7c3ac27f6e16 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:01.868011 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37fa3d4-3073-491c-a0f7-7c3ac27f6e16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:01.886082 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-f37fa3d4-3073-491c-a0f7-7c3ac27f6e16 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:29:01.887284 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-f37fa3d4-3073-491c-a0f7-7c3ac27f6e16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:29:01.956471 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1329/2642] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:29:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:29:01.966343 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962846ed-1aad-4f4e-9e9c-b1deafd42e5e admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:01.967873 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-962846ed-1aad-4f4e-9e9c-b1deafd42e5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:29:02.020525 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37fa3d4-3073-491c-a0f7-7c3ac27f6e16 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:02.021949 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-f37fa3d4-3073-491c-a0f7-7c3ac27f6e16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:29:02.030266 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962846ed-1aad-4f4e-9e9c-b1deafd42e5e admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:02.034890 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37fa3d4-3073-491c-a0f7-7c3ac27f6e16 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:02.035309 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbf4b0c-4146-41b9-95f0-b511189e6687 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f1dc79540b48c0866478cc48cd8205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:02.035971 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbf4b0c-4146-41b9-95f0-b511189e6687 service neutron] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:02.036256 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbf4b0c-4146-41b9-95f0-b511189e6687 service neutron] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:02.036572 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbf4b0c-4146-41b9-95f0-b511189e6687 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:02.038605 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d180484c-72a2-44db-9d92-d21fe5fe919f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f1dc79540b48c0866478cc48cd8205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:02.039248 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d180484c-72a2-44db-9d92-d21fe5fe919f service neutron] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:02.039531 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d180484c-72a2-44db-9d92-d21fe5fe919f service neutron] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:02.039806 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d180484c-72a2-44db-9d92-d21fe5fe919f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:02.042116 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-d180484c-72a2-44db-9d92-d21fe5fe919f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:29:02.046932 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbf4b0c-4146-41b9-95f0-b511189e6687 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:02.048402 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbf4b0c-4146-41b9-95f0-b511189e6687 service neutron] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:02.054162 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d180484c-72a2-44db-9d92-d21fe5fe919f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:02.055614 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d180484c-72a2-44db-9d92-d21fe5fe919f service neutron] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:02.058523 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1314/2643] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:29:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:29:02.069656 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1330/2644] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:29:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 19:29:02.342664 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbf4b0c-4146-41b9-95f0-b511189e6687 service neutron] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:02.345116 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-fbbf4b0c-4146-41b9-95f0-b511189e6687 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:29:02.369731 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbf4b0c-4146-41b9-95f0-b511189e6687 service neutron] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:02.375620 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f62de1a-4a6f-4310-81f8-58510f56782e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:02.376523 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f62de1a-4a6f-4310-81f8-58510f56782e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:02.376812 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f62de1a-4a6f-4310-81f8-58510f56782e admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:02.377089 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f62de1a-4a6f-4310-81f8-58510f56782e admin admin] PATH_INFO: `/v3/projects/75de448cb9bf4325873a2fa048848fcc` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:02.378279 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f62de1a-4a6f-4310-81f8-58510f56782e admin admin] RBAC: Authorizing `identity:delete_project(project_id=75de448cb9bf4325873a2fa048848fcc)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:02.380740 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f62de1a-4a6f-4310-81f8-58510f56782e admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:02.432715 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-0f62de1a-4a6f-4310-81f8-58510f56782e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75de448cb9bf4325873a2fa048848fcc', 'request_id': 'req-0f62de1a-4a6f-4310-81f8-58510f56782e'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:02.438150 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-0f62de1a-4a6f-4310-81f8-58510f56782e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75de448cb9bf4325873a2fa048848fcc', 'request_id': 'req-0f62de1a-4a6f-4310-81f8-58510f56782e'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:02.446168 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-0f62de1a-4a6f-4310-81f8-58510f56782e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75de448cb9bf4325873a2fa048848fcc', 'request_id': 'req-0f62de1a-4a6f-4310-81f8-58510f56782e'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:02.463254 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-0f62de1a-4a6f-4310-81f8-58510f56782e admin admin] The token cache is being invalidate because project 75de448cb9bf4325873a2fa048848fcc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79993) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:29:02.463537 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-0f62de1a-4a6f-4310-81f8-58510f56782e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:02.464303 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-0f62de1a-4a6f-4310-81f8-58510f56782e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:02.466049 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1315/2645] 10.222.0.70 () {58 vars in 1232 bytes} [Tue May 10 19:29:02 2022] DELETE /identity/v3/projects/75de448cb9bf4325873a2fa048848fcc => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:29:02.472124 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d180484c-72a2-44db-9d92-d21fe5fe919f service neutron] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:02.483376 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d180484c-72a2-44db-9d92-d21fe5fe919f service neutron] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:02.541555 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f9b4b7-85ec-4683-8146-344d2b56374d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:02.542477 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f9b4b7-85ec-4683-8146-344d2b56374d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:02.542746 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f9b4b7-85ec-4683-8146-344d2b56374d admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:02.543021 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f9b4b7-85ec-4683-8146-344d2b56374d admin admin] PATH_INFO: `/v3/users/27362514ce03433cb97b41e014d8ebeb` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:02.544212 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f9b4b7-85ec-4683-8146-344d2b56374d admin admin] RBAC: Authorizing `identity:delete_user(user_id=27362514ce03433cb97b41e014d8ebeb)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:02.546189 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f9b4b7-85ec-4683-8146-344d2b56374d admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:02.593514 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-14f9b4b7-85ec-4683-8146-344d2b56374d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27362514ce03433cb97b41e014d8ebeb'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:02.606736 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-14f9b4b7-85ec-4683-8146-344d2b56374d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27362514ce03433cb97b41e014d8ebeb'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:02.607467 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-14f9b4b7-85ec-4683-8146-344d2b56374d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27362514ce03433cb97b41e014d8ebeb'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:02.615055 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-14f9b4b7-85ec-4683-8146-344d2b56374d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27362514ce03433cb97b41e014d8ebeb'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:02.622580 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-14f9b4b7-85ec-4683-8146-344d2b56374d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27362514ce03433cb97b41e014d8ebeb'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:02.628907 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1331/2646] 10.222.0.70 () {58 vars in 1223 bytes} [Tue May 10 19:29:02 2022] DELETE /identity/v3/users/27362514ce03433cb97b41e014d8ebeb => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:29:03.041788 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f62de1a-4a6f-4310-81f8-58510f56782e admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:03.043310 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-0f62de1a-4a6f-4310-81f8-58510f56782e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:29:03.058370 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f62de1a-4a6f-4310-81f8-58510f56782e admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:03.136645 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a0681f-4780-4f59-9671-75061a88bbb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:03.137532 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a0681f-4780-4f59-9671-75061a88bbb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:03.138460 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a0681f-4780-4f59-9671-75061a88bbb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:03.138747 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a0681f-4780-4f59-9671-75061a88bbb6 admin admin] PATH_INFO: `/v3/projects/408178bb26d545989895ea960bd8d38f` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:03.140351 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a0681f-4780-4f59-9671-75061a88bbb6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=408178bb26d545989895ea960bd8d38f)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:03.142451 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a0681f-4780-4f59-9671-75061a88bbb6 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:03.201686 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-e0a0681f-4780-4f59-9671-75061a88bbb6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '408178bb26d545989895ea960bd8d38f', 'request_id': 'req-e0a0681f-4780-4f59-9671-75061a88bbb6'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:03.209374 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-e0a0681f-4780-4f59-9671-75061a88bbb6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '408178bb26d545989895ea960bd8d38f', 'request_id': 'req-e0a0681f-4780-4f59-9671-75061a88bbb6'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:03.226559 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-e0a0681f-4780-4f59-9671-75061a88bbb6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '408178bb26d545989895ea960bd8d38f', 'request_id': 'req-e0a0681f-4780-4f59-9671-75061a88bbb6'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:03.241873 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-e0a0681f-4780-4f59-9671-75061a88bbb6 admin admin] The token cache is being invalidate because project 408178bb26d545989895ea960bd8d38f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79993) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:29:03.242166 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-e0a0681f-4780-4f59-9671-75061a88bbb6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:03.242826 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-e0a0681f-4780-4f59-9671-75061a88bbb6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:03.245137 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1316/2647] 10.222.0.70 () {58 vars in 1232 bytes} [Tue May 10 19:29:03 2022] DELETE /identity/v3/projects/408178bb26d545989895ea960bd8d38f => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:29:03.250076 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df82f7b-bb60-405d-b288-ba6e5de764ee None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:03.250958 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df82f7b-bb60-405d-b288-ba6e5de764ee None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:03.251469 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df82f7b-bb60-405d-b288-ba6e5de764ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:03.270951 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-7df82f7b-bb60-405d-b288-ba6e5de764ee None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:29:03.272444 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-7df82f7b-bb60-405d-b288-ba6e5de764ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:29:03.333236 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1332/2648] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:29:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:29:03.342260 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606b9287-be7f-413c-b2f0-b1bb07ed673f None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:03.342552 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606b9287-be7f-413c-b2f0-b1bb07ed673f None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:03.342830 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606b9287-be7f-413c-b2f0-b1bb07ed673f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:03.361272 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-606b9287-be7f-413c-b2f0-b1bb07ed673f None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:29:03.362641 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-606b9287-be7f-413c-b2f0-b1bb07ed673f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:29:03.373281 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1317/2649] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:29:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:29:03.377501 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df82f7b-bb60-405d-b288-ba6e5de764ee None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:03.387718 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df82f7b-bb60-405d-b288-ba6e5de764ee None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:03.392623 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241708cb-5b8b-4e9f-b6f5-b1345b74354d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:03.393283 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241708cb-5b8b-4e9f-b6f5-b1345b74354d admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:03.393662 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241708cb-5b8b-4e9f-b6f5-b1345b74354d admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:03.394153 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241708cb-5b8b-4e9f-b6f5-b1345b74354d admin admin] PATH_INFO: `/v3/domains` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:03.394888 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241708cb-5b8b-4e9f-b6f5-b1345b74354d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:29:03.395196 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241708cb-5b8b-4e9f-b6f5-b1345b74354d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:03.396870 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241708cb-5b8b-4e9f-b6f5-b1345b74354d admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:03.408661 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1333/2650] 10.222.0.70 () {58 vars in 1152 bytes} [Tue May 10 19:29:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:29:03.412979 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606b9287-be7f-413c-b2f0-b1bb07ed673f None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:03.424456 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606b9287-be7f-413c-b2f0-b1bb07ed673f None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:03.429220 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43155fb7-e379-4b32-a9f1-2087d9c5c205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:03.429884 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43155fb7-e379-4b32-a9f1-2087d9c5c205 admin admin] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:03.430172 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43155fb7-e379-4b32-a9f1-2087d9c5c205 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:03.430455 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43155fb7-e379-4b32-a9f1-2087d9c5c205 admin admin] PATH_INFO: `/v3/projects` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:03.431716 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43155fb7-e379-4b32-a9f1-2087d9c5c205 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:03.433663 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43155fb7-e379-4b32-a9f1-2087d9c5c205 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:03.464273 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1318/2651] 10.222.0.70 () {60 vars in 1152 bytes} [Tue May 10 19:29:03 2022] POST /identity/v3/projects => generated 371 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 19:29:03.465781 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241708cb-5b8b-4e9f-b6f5-b1345b74354d admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:03.481552 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241708cb-5b8b-4e9f-b6f5-b1345b74354d admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:03.542410 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5887a6de-7440-4dd3-aaa9-b99cc1c9b04b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:03.543214 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5887a6de-7440-4dd3-aaa9-b99cc1c9b04b admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:03.544122 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5887a6de-7440-4dd3-aaa9-b99cc1c9b04b admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:03.544506 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5887a6de-7440-4dd3-aaa9-b99cc1c9b04b admin admin] PATH_INFO: `/v3/users` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:03.545398 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5887a6de-7440-4dd3-aaa9-b99cc1c9b04b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:03.547465 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5887a6de-7440-4dd3-aaa9-b99cc1c9b04b admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:03.584113 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1334/2652] 10.222.0.70 () {60 vars in 1143 bytes} [Tue May 10 19:29:03 2022] POST /identity/v3/users => generated 286 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 19:29:03.588347 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43155fb7-e379-4b32-a9f1-2087d9c5c205 admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:03.601414 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43155fb7-e379-4b32-a9f1-2087d9c5c205 admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:03.606905 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84249484-8a2a-4958-abc6-84a63fb0995d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:03.607830 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84249484-8a2a-4958-abc6-84a63fb0995d admin admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:03.608262 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84249484-8a2a-4958-abc6-84a63fb0995d admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:03.608761 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84249484-8a2a-4958-abc6-84a63fb0995d admin admin] PATH_INFO: `/v3/roles` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:03.609612 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84249484-8a2a-4958-abc6-84a63fb0995d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:03.611634 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84249484-8a2a-4958-abc6-84a63fb0995d admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:03.624155 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1319/2653] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:29:03 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:29:03.628170 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5887a6de-7440-4dd3-aaa9-b99cc1c9b04b admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:03.641662 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5887a6de-7440-4dd3-aaa9-b99cc1c9b04b admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:03.646527 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e141d7a1-f645-476e-9ca6-6e05dbe37244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:03.647159 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e141d7a1-f645-476e-9ca6-6e05dbe37244 admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:03.647445 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e141d7a1-f645-476e-9ca6-6e05dbe37244 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:03.647732 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e141d7a1-f645-476e-9ca6-6e05dbe37244 admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:03.648486 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e141d7a1-f645-476e-9ca6-6e05dbe37244 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:03.650662 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e141d7a1-f645-476e-9ca6-6e05dbe37244 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:03.665231 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1335/2654] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:29:03 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 19:29:03.669356 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84249484-8a2a-4958-abc6-84a63fb0995d admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:03.680780 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84249484-8a2a-4958-abc6-84a63fb0995d admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:03.687369 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f47ca9-4ae9-4f2a-ac1a-30681ac102cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:03.688828 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f47ca9-4ae9-4f2a-ac1a-30681ac102cd admin admin] REQUEST_METHOD: `PUT` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:03.688926 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f47ca9-4ae9-4f2a-ac1a-30681ac102cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:03.689182 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f47ca9-4ae9-4f2a-ac1a-30681ac102cd admin admin] PATH_INFO: `/v3/projects/7f3f42959f7e488398ba38d0750f669c/users/0faac63a621b4e3ab202df8c24b44c0a/roles/5c07cf5bfbd3427db18428aa50420962` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:03.706674 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f47ca9-4ae9-4f2a-ac1a-30681ac102cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f3f42959f7e488398ba38d0750f669c, user_id=0faac63a621b4e3ab202df8c24b44c0a, role_id=5c07cf5bfbd3427db18428aa50420962)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:03.709694 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f47ca9-4ae9-4f2a-ac1a-30681ac102cd admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:03.729429 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1320/2655] 10.222.0.70 () {60 vars in 1482 bytes} [Tue May 10 19:29:03 2022] PUT /identity/v3/projects/7f3f42959f7e488398ba38d0750f669c/users/0faac63a621b4e3ab202df8c24b44c0a/roles/5c07cf5bfbd3427db18428aa50420962 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:29:03.736493 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b502cf-230c-403f-8612-2771a7106e1d None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:03.737286 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b502cf-230c-403f-8612-2771a7106e1d None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:03.737734 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b502cf-230c-403f-8612-2771a7106e1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:03.758207 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-84b502cf-230c-403f-8612-2771a7106e1d None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:29:03.759821 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-84b502cf-230c-403f-8612-2771a7106e1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:29:03.829150 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1336/2656] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:29:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:29:03.842437 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f47ca9-4ae9-4f2a-ac1a-30681ac102cd admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:03.844765 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-69f47ca9-4ae9-4f2a-ac1a-30681ac102cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:29:03.912625 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f47ca9-4ae9-4f2a-ac1a-30681ac102cd admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:03.916664 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2b1561-6901-4d3a-a683-f16d247d7f89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f1dc79540b48c0866478cc48cd8205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:03.917397 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2b1561-6901-4d3a-a683-f16d247d7f89 service neutron] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:03.917753 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2b1561-6901-4d3a-a683-f16d247d7f89 service neutron] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:03.918102 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2b1561-6901-4d3a-a683-f16d247d7f89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:03.927987 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2b1561-6901-4d3a-a683-f16d247d7f89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:03.929764 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2b1561-6901-4d3a-a683-f16d247d7f89 service neutron] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:03.944176 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1321/2657] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:29:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 19:29:05.106529 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf51979-6941-4d87-8b96-e245576091a9 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:05.107653 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf51979-6941-4d87-8b96-e245576091a9 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:05.110464 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf51979-6941-4d87-8b96-e245576091a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:05.141394 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-2bf51979-6941-4d87-8b96-e245576091a9 None None] MFA Rules not processed for user `0faac63a621b4e3ab202df8c24b44c0a`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:29:05.142854 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-2bf51979-6941-4d87-8b96-e245576091a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:29:05.233965 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1337/2658] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:29:05 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:29:05.238410 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2b1561-6901-4d3a-a683-f16d247d7f89 service neutron] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:05.252510 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2b1561-6901-4d3a-a683-f16d247d7f89 service neutron] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:05.259096 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd618cad-53e1-491d-a282-0899a399d76c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:05.259789 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd618cad-53e1-491d-a282-0899a399d76c admin admin] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:05.260449 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd618cad-53e1-491d-a282-0899a399d76c admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:05.260831 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd618cad-53e1-491d-a282-0899a399d76c admin admin] PATH_INFO: `/v3/projects` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:05.261599 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd618cad-53e1-491d-a282-0899a399d76c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:05.264477 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd618cad-53e1-491d-a282-0899a399d76c admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:05.293188 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1322/2659] 10.222.0.70 () {60 vars in 1152 bytes} [Tue May 10 19:29:05 2022] POST /identity/v3/projects => generated 369 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:29:05.296877 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf51979-6941-4d87-8b96-e245576091a9 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:05.308469 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf51979-6941-4d87-8b96-e245576091a9 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:05.412097 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf44ab03-72bc-4622-8678-d1cb1bb9d252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:05.418952 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf44ab03-72bc-4622-8678-d1cb1bb9d252 admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:05.419410 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf44ab03-72bc-4622-8678-d1cb1bb9d252 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:05.419787 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf44ab03-72bc-4622-8678-d1cb1bb9d252 admin admin] PATH_INFO: `/v3/users` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:05.421549 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf44ab03-72bc-4622-8678-d1cb1bb9d252 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:05.424064 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf44ab03-72bc-4622-8678-d1cb1bb9d252 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:05.452657 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1338/2660] 10.222.0.70 () {60 vars in 1143 bytes} [Tue May 10 19:29:05 2022] POST /identity/v3/users => generated 291 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:29:05.453801 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd618cad-53e1-491d-a282-0899a399d76c admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:05.474019 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd618cad-53e1-491d-a282-0899a399d76c admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:05.492499 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1504a1-5ff2-4c05-b4f2-dd018ca7fb40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:05.493537 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1504a1-5ff2-4c05-b4f2-dd018ca7fb40 admin admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:05.494021 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1504a1-5ff2-4c05-b4f2-dd018ca7fb40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:05.494359 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1504a1-5ff2-4c05-b4f2-dd018ca7fb40 admin admin] PATH_INFO: `/v3/roles` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:05.495106 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1504a1-5ff2-4c05-b4f2-dd018ca7fb40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:05.496764 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1504a1-5ff2-4c05-b4f2-dd018ca7fb40 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:05.520034 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1323/2661] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:29:05 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:29:05.528660 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf44ab03-72bc-4622-8678-d1cb1bb9d252 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:05.548696 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf44ab03-72bc-4622-8678-d1cb1bb9d252 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:05.555098 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126c386f-05cb-48fb-bd20-ab9eda4ee6a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:05.556483 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126c386f-05cb-48fb-bd20-ab9eda4ee6a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:05.556855 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126c386f-05cb-48fb-bd20-ab9eda4ee6a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:05.557032 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126c386f-05cb-48fb-bd20-ab9eda4ee6a8 admin admin] PATH_INFO: `/v3/projects/c7850f159ae04e78bceb1b2f9550d492/users/d3fff3fe059e49a59f8f86b46353f3b2/roles/634ba284303b4626b5a0402772c68f5c` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:05.580828 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126c386f-05cb-48fb-bd20-ab9eda4ee6a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7850f159ae04e78bceb1b2f9550d492, user_id=d3fff3fe059e49a59f8f86b46353f3b2, role_id=634ba284303b4626b5a0402772c68f5c)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:05.586208 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126c386f-05cb-48fb-bd20-ab9eda4ee6a8 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:05.604027 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1339/2662] 10.222.0.70 () {60 vars in 1482 bytes} [Tue May 10 19:29:05 2022] PUT /identity/v3/projects/c7850f159ae04e78bceb1b2f9550d492/users/d3fff3fe059e49a59f8f86b46353f3b2/roles/634ba284303b4626b5a0402772c68f5c => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:29:05.607819 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1504a1-5ff2-4c05-b4f2-dd018ca7fb40 admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:05.617753 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1504a1-5ff2-4c05-b4f2-dd018ca7fb40 admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:05.686905 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234662e2-69a7-46e0-b132-34e80fae1938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:05.687954 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234662e2-69a7-46e0-b132-34e80fae1938 admin admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:05.689434 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234662e2-69a7-46e0-b132-34e80fae1938 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:05.689785 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234662e2-69a7-46e0-b132-34e80fae1938 admin admin] PATH_INFO: `/v3/roles` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:05.691022 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234662e2-69a7-46e0-b132-34e80fae1938 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:05.693391 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234662e2-69a7-46e0-b132-34e80fae1938 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:05.709234 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1324/2663] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:29:05 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:29:05.710694 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126c386f-05cb-48fb-bd20-ab9eda4ee6a8 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:05.725444 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126c386f-05cb-48fb-bd20-ab9eda4ee6a8 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:05.730367 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ae6909-c07e-4bf7-a84b-1e00ff7e76bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:05.731367 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ae6909-c07e-4bf7-a84b-1e00ff7e76bd admin admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:05.731753 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ae6909-c07e-4bf7-a84b-1e00ff7e76bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:05.732134 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ae6909-c07e-4bf7-a84b-1e00ff7e76bd admin admin] PATH_INFO: `/v3/projects/c7850f159ae04e78bceb1b2f9550d492/users/d3fff3fe059e49a59f8f86b46353f3b2/roles/634ba284303b4626b5a0402772c68f5c` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:05.734319 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ae6909-c07e-4bf7-a84b-1e00ff7e76bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7850f159ae04e78bceb1b2f9550d492, user_id=d3fff3fe059e49a59f8f86b46353f3b2, role_id=634ba284303b4626b5a0402772c68f5c)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:05.739221 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ae6909-c07e-4bf7-a84b-1e00ff7e76bd admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:05.751430 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1340/2664] 10.222.0.70 () {60 vars in 1482 bytes} [Tue May 10 19:29:05 2022] PUT /identity/v3/projects/c7850f159ae04e78bceb1b2f9550d492/users/d3fff3fe059e49a59f8f86b46353f3b2/roles/634ba284303b4626b5a0402772c68f5c => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:29:05.931173 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234662e2-69a7-46e0-b132-34e80fae1938 admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:05.932967 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-234662e2-69a7-46e0-b132-34e80fae1938 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:29:05.967874 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234662e2-69a7-46e0-b132-34e80fae1938 admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:06.047181 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53253b61-ddbc-44b5-b897-b9b86ac65433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:06.048967 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53253b61-ddbc-44b5-b897-b9b86ac65433 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:06.048967 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53253b61-ddbc-44b5-b897-b9b86ac65433 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:06.049177 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53253b61-ddbc-44b5-b897-b9b86ac65433 admin admin] PATH_INFO: `/v3/users/90bbeed46811450f953507e570a2bd94` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:06.050495 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53253b61-ddbc-44b5-b897-b9b86ac65433 admin admin] RBAC: Authorizing `identity:delete_user(user_id=90bbeed46811450f953507e570a2bd94)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:06.052942 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53253b61-ddbc-44b5-b897-b9b86ac65433 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:06.113760 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-53253b61-ddbc-44b5-b897-b9b86ac65433 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90bbeed46811450f953507e570a2bd94'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:06.127660 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-53253b61-ddbc-44b5-b897-b9b86ac65433 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90bbeed46811450f953507e570a2bd94'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:06.136320 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-53253b61-ddbc-44b5-b897-b9b86ac65433 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90bbeed46811450f953507e570a2bd94'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:06.137096 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-53253b61-ddbc-44b5-b897-b9b86ac65433 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90bbeed46811450f953507e570a2bd94'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:06.149071 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-53253b61-ddbc-44b5-b897-b9b86ac65433 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90bbeed46811450f953507e570a2bd94'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:06.157528 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1325/2665] 10.222.0.70 () {58 vars in 1223 bytes} [Tue May 10 19:29:05 2022] DELETE /identity/v3/users/90bbeed46811450f953507e570a2bd94 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:29:06.353226 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ae6909-c07e-4bf7-a84b-1e00ff7e76bd admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:06.355564 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-f1ae6909-c07e-4bf7-a84b-1e00ff7e76bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:29:06.372601 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ae6909-c07e-4bf7-a84b-1e00ff7e76bd admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:06.445635 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277622d2-02b1-4c91-895e-1e9773c09ee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:06.446658 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277622d2-02b1-4c91-895e-1e9773c09ee8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:06.446947 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277622d2-02b1-4c91-895e-1e9773c09ee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:06.447213 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277622d2-02b1-4c91-895e-1e9773c09ee8 admin admin] PATH_INFO: `/v3/projects/8588427eb06848b9ad22fab88b7c91e3` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:06.448629 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277622d2-02b1-4c91-895e-1e9773c09ee8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8588427eb06848b9ad22fab88b7c91e3)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:06.450938 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277622d2-02b1-4c91-895e-1e9773c09ee8 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:06.462762 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8ad769-a90d-4fb6-ba6e-ad0a0d3b828d None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:06.463420 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8ad769-a90d-4fb6-ba6e-ad0a0d3b828d None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:06.463420 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8ad769-a90d-4fb6-ba6e-ad0a0d3b828d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:06.497846 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-9b8ad769-a90d-4fb6-ba6e-ad0a0d3b828d None None] MFA Rules not processed for user `d3fff3fe059e49a59f8f86b46353f3b2`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:29:06.499749 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-9b8ad769-a90d-4fb6-ba6e-ad0a0d3b828d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:29:06.514045 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-277622d2-02b1-4c91-895e-1e9773c09ee8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8588427eb06848b9ad22fab88b7c91e3', 'request_id': 'req-277622d2-02b1-4c91-895e-1e9773c09ee8'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:06.525915 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-277622d2-02b1-4c91-895e-1e9773c09ee8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8588427eb06848b9ad22fab88b7c91e3', 'request_id': 'req-277622d2-02b1-4c91-895e-1e9773c09ee8'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:06.544857 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-277622d2-02b1-4c91-895e-1e9773c09ee8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8588427eb06848b9ad22fab88b7c91e3', 'request_id': 'req-277622d2-02b1-4c91-895e-1e9773c09ee8'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:06.565042 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-277622d2-02b1-4c91-895e-1e9773c09ee8 admin admin] The token cache is being invalidate because project 8588427eb06848b9ad22fab88b7c91e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79994) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:29:06.565429 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-277622d2-02b1-4c91-895e-1e9773c09ee8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:06.566174 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-277622d2-02b1-4c91-895e-1e9773c09ee8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:06.568732 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1341/2666] 10.222.0.70 () {58 vars in 1232 bytes} [Tue May 10 19:29:06 2022] DELETE /identity/v3/projects/8588427eb06848b9ad22fab88b7c91e3 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:29:06.574029 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839f3300-2cc6-4896-8c27-bddf6c63ad37 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:06.575170 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839f3300-2cc6-4896-8c27-bddf6c63ad37 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:06.575688 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839f3300-2cc6-4896-8c27-bddf6c63ad37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:06.591336 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1326/2667] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:29:06 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:29:06.600624 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8ad769-a90d-4fb6-ba6e-ad0a0d3b828d None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:06.601240 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-839f3300-2cc6-4896-8c27-bddf6c63ad37 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:29:06.602171 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-9b8ad769-a90d-4fb6-ba6e-ad0a0d3b828d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:29:06.605944 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-839f3300-2cc6-4896-8c27-bddf6c63ad37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:29:06.671722 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8ad769-a90d-4fb6-ba6e-ad0a0d3b828d None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:06.675765 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdeae81-12b6-4b56-9751-4bba602f41fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15df2a8967aa43299c10e365f4200d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:06.676769 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdeae81-12b6-4b56-9751-4bba602f41fc service cinder] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:06.677148 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdeae81-12b6-4b56-9751-4bba602f41fc service cinder] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:06.677503 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdeae81-12b6-4b56-9751-4bba602f41fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:06.680357 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-7bdeae81-12b6-4b56-9751-4bba602f41fc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:29:06.714632 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1342/2668] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:29:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:29:06.716879 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a485365f-a57c-4c8c-8943-bafbc281ef6f None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:06.717187 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a485365f-a57c-4c8c-8943-bafbc281ef6f None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:06.717465 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a485365f-a57c-4c8c-8943-bafbc281ef6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:06.753226 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdeae81-12b6-4b56-9751-4bba602f41fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:06.753846 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-a485365f-a57c-4c8c-8943-bafbc281ef6f None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:29:06.754691 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdeae81-12b6-4b56-9751-4bba602f41fc service cinder] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:06.755254 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-a485365f-a57c-4c8c-8943-bafbc281ef6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:29:06.763529 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1343/2669] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:29:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:29:06.764021 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1327/2670] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:29:06 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 19:29:06.767551 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a485365f-a57c-4c8c-8943-bafbc281ef6f None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:06.778396 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a485365f-a57c-4c8c-8943-bafbc281ef6f None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:06.783712 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b547b05-629d-481f-94fb-abbcec66a210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:06.784372 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b547b05-629d-481f-94fb-abbcec66a210 admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:06.784680 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b547b05-629d-481f-94fb-abbcec66a210 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:06.784948 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b547b05-629d-481f-94fb-abbcec66a210 admin admin] PATH_INFO: `/v3/domains` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:06.785658 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b547b05-629d-481f-94fb-abbcec66a210 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:29:06.785955 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b547b05-629d-481f-94fb-abbcec66a210 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:06.787523 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b547b05-629d-481f-94fb-abbcec66a210 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:06.800311 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1344/2671] 10.222.0.70 () {58 vars in 1152 bytes} [Tue May 10 19:29:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:29:06.804725 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdeae81-12b6-4b56-9751-4bba602f41fc service cinder] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:06.815572 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdeae81-12b6-4b56-9751-4bba602f41fc service cinder] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:06.821832 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f43c085-ed84-4f44-8b2d-6056e0a3ea93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:06.822510 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f43c085-ed84-4f44-8b2d-6056e0a3ea93 admin admin] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:06.822824 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f43c085-ed84-4f44-8b2d-6056e0a3ea93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:06.823100 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f43c085-ed84-4f44-8b2d-6056e0a3ea93 admin admin] PATH_INFO: `/v3/projects` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:06.823804 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f43c085-ed84-4f44-8b2d-6056e0a3ea93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:06.825847 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f43c085-ed84-4f44-8b2d-6056e0a3ea93 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:06.854501 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1328/2672] 10.222.0.70 () {60 vars in 1152 bytes} [Tue May 10 19:29:06 2022] POST /identity/v3/projects => generated 405 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:29:06.858727 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b547b05-629d-481f-94fb-abbcec66a210 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:06.869440 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b547b05-629d-481f-94fb-abbcec66a210 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:06.963942 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf4e876-35bb-44af-98fe-c21e2c7fce9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:06.964656 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf4e876-35bb-44af-98fe-c21e2c7fce9b admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:06.964989 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf4e876-35bb-44af-98fe-c21e2c7fce9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:06.965267 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf4e876-35bb-44af-98fe-c21e2c7fce9b admin admin] PATH_INFO: `/v3/users` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:06.966002 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf4e876-35bb-44af-98fe-c21e2c7fce9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:06.967940 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf4e876-35bb-44af-98fe-c21e2c7fce9b admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:06.991625 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1345/2673] 10.222.0.70 () {60 vars in 1143 bytes} [Tue May 10 19:29:06 2022] POST /identity/v3/users => generated 303 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:29:06.996069 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f43c085-ed84-4f44-8b2d-6056e0a3ea93 admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:07.007720 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f43c085-ed84-4f44-8b2d-6056e0a3ea93 admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:07.013684 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae28c5f5-77f2-4192-aefa-01946bc71a65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:07.014443 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae28c5f5-77f2-4192-aefa-01946bc71a65 admin admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:07.014722 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae28c5f5-77f2-4192-aefa-01946bc71a65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:07.015040 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae28c5f5-77f2-4192-aefa-01946bc71a65 admin admin] PATH_INFO: `/v3/roles` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:07.015829 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae28c5f5-77f2-4192-aefa-01946bc71a65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:07.017500 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae28c5f5-77f2-4192-aefa-01946bc71a65 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:07.031061 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1329/2674] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:29:06 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 19:29:07.035273 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf4e876-35bb-44af-98fe-c21e2c7fce9b admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:07.052042 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf4e876-35bb-44af-98fe-c21e2c7fce9b admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:07.057689 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a39d9fb-d8da-4140-b3e2-8717905f9dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:07.058543 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a39d9fb-d8da-4140-b3e2-8717905f9dc7 admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:07.058927 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a39d9fb-d8da-4140-b3e2-8717905f9dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:07.059340 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a39d9fb-d8da-4140-b3e2-8717905f9dc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:07.060383 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a39d9fb-d8da-4140-b3e2-8717905f9dc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:07.062131 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a39d9fb-d8da-4140-b3e2-8717905f9dc7 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:07.073943 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1346/2675] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:29:07 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:29:07.077985 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae28c5f5-77f2-4192-aefa-01946bc71a65 admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:07.089713 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae28c5f5-77f2-4192-aefa-01946bc71a65 admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:07.095640 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75d323d-dc95-4292-9696-d40f8f2ddba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:07.097000 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75d323d-dc95-4292-9696-d40f8f2ddba4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:07.097136 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75d323d-dc95-4292-9696-d40f8f2ddba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:07.097343 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75d323d-dc95-4292-9696-d40f8f2ddba4 admin admin] PATH_INFO: `/v3/projects/53b50d5da7b446b9bd8c522b0e45f159/users/4d8ebccf99d44393ada9a256afc0067c/roles/5c07cf5bfbd3427db18428aa50420962` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:07.116901 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75d323d-dc95-4292-9696-d40f8f2ddba4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53b50d5da7b446b9bd8c522b0e45f159, user_id=4d8ebccf99d44393ada9a256afc0067c, role_id=5c07cf5bfbd3427db18428aa50420962)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:07.120391 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75d323d-dc95-4292-9696-d40f8f2ddba4 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:07.138281 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1330/2676] 10.222.0.70 () {60 vars in 1482 bytes} [Tue May 10 19:29:07 2022] PUT /identity/v3/projects/53b50d5da7b446b9bd8c522b0e45f159/users/4d8ebccf99d44393ada9a256afc0067c/roles/5c07cf5bfbd3427db18428aa50420962 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:29:07.143946 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94a5d9d-6e2c-4339-910f-776437eafbc6 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:07.144273 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94a5d9d-6e2c-4339-910f-776437eafbc6 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:07.144774 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94a5d9d-6e2c-4339-910f-776437eafbc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:07.168550 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-f94a5d9d-6e2c-4339-910f-776437eafbc6 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:29:07.169798 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-f94a5d9d-6e2c-4339-910f-776437eafbc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:29:07.228577 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1347/2677] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:29:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:29:07.238407 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75d323d-dc95-4292-9696-d40f8f2ddba4 admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:07.240178 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-b75d323d-dc95-4292-9696-d40f8f2ddba4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:29:07.296576 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75d323d-dc95-4292-9696-d40f8f2ddba4 admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:07.300196 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f13ce3a-5678-4485-8ac2-aec00a3f84d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f1dc79540b48c0866478cc48cd8205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:07.300942 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f13ce3a-5678-4485-8ac2-aec00a3f84d3 service neutron] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:07.301228 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f13ce3a-5678-4485-8ac2-aec00a3f84d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:07.301505 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f13ce3a-5678-4485-8ac2-aec00a3f84d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:07.310883 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f13ce3a-5678-4485-8ac2-aec00a3f84d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:07.312636 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f13ce3a-5678-4485-8ac2-aec00a3f84d3 service neutron] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:07.325654 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1331/2678] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:29:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:29:08.050080 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a681cf-4364-4b4f-b0fa-94e5a61a8af1 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:08.050591 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a681cf-4364-4b4f-b0fa-94e5a61a8af1 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:08.050720 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a681cf-4364-4b4f-b0fa-94e5a61a8af1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:08.077762 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-30a681cf-4364-4b4f-b0fa-94e5a61a8af1 None None] MFA Rules not processed for user `4d8ebccf99d44393ada9a256afc0067c`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:29:08.078968 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-30a681cf-4364-4b4f-b0fa-94e5a61a8af1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:29:08.147446 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1348/2679] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:29:08 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:29:08.151729 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f13ce3a-5678-4485-8ac2-aec00a3f84d3 service neutron] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:08.162017 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f13ce3a-5678-4485-8ac2-aec00a3f84d3 service neutron] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:08.168293 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e05d597-8bcf-4fdd-9a11-bb5763b3a5ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:08.168987 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e05d597-8bcf-4fdd-9a11-bb5763b3a5ef admin admin] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:08.169275 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e05d597-8bcf-4fdd-9a11-bb5763b3a5ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:08.169554 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e05d597-8bcf-4fdd-9a11-bb5763b3a5ef admin admin] PATH_INFO: `/v3/projects` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:08.170294 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e05d597-8bcf-4fdd-9a11-bb5763b3a5ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:08.172895 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e05d597-8bcf-4fdd-9a11-bb5763b3a5ef admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:08.186509 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a681cf-4364-4b4f-b0fa-94e5a61a8af1 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:08.202870 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1332/2680] 10.222.0.70 () {60 vars in 1152 bytes} [Tue May 10 19:29:08 2022] POST /identity/v3/projects => generated 403 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:29:08.205571 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e05d597-8bcf-4fdd-9a11-bb5763b3a5ef admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:08.265043 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a681cf-4364-4b4f-b0fa-94e5a61a8af1 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:08.278730 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e05d597-8bcf-4fdd-9a11-bb5763b3a5ef admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:08.283836 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56b7ccc-7d5d-48b6-b1c1-a4ce43823e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:08.284514 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56b7ccc-7d5d-48b6-b1c1-a4ce43823e90 admin admin] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:08.284938 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56b7ccc-7d5d-48b6-b1c1-a4ce43823e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:08.285207 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56b7ccc-7d5d-48b6-b1c1-a4ce43823e90 admin admin] PATH_INFO: `/v3/users` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:08.285957 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56b7ccc-7d5d-48b6-b1c1-a4ce43823e90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:08.287930 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56b7ccc-7d5d-48b6-b1c1-a4ce43823e90 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:08.307296 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1333/2681] 10.222.0.70 () {60 vars in 1143 bytes} [Tue May 10 19:29:08 2022] POST /identity/v3/users => generated 308 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:29:08.311288 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56b7ccc-7d5d-48b6-b1c1-a4ce43823e90 admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:08.315189 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf35b223-7bba-4a7c-b4eb-d6031ebfe002 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15df2a8967aa43299c10e365f4200d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:08.315841 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf35b223-7bba-4a7c-b4eb-d6031ebfe002 service cinder] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:08.316122 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf35b223-7bba-4a7c-b4eb-d6031ebfe002 service cinder] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:08.316396 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf35b223-7bba-4a7c-b4eb-d6031ebfe002 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:08.321263 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56b7ccc-7d5d-48b6-b1c1-a4ce43823e90 admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:08.325984 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b2b327-d0dc-4031-b735-69084e9e07c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:08.326735 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b2b327-d0dc-4031-b735-69084e9e07c8 admin admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:08.327046 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b2b327-d0dc-4031-b735-69084e9e07c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:08.327319 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b2b327-d0dc-4031-b735-69084e9e07c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:08.328024 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b2b327-d0dc-4031-b735-69084e9e07c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:08.329641 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b2b327-d0dc-4031-b735-69084e9e07c8 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:08.339909 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1334/2682] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:29:08 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 19:29:08.343934 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b2b327-d0dc-4031-b735-69084e9e07c8 admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:08.354084 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b2b327-d0dc-4031-b735-69084e9e07c8 admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:08.358735 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed858b0-108c-4b66-9fae-1ec2d723a58f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:08.359592 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed858b0-108c-4b66-9fae-1ec2d723a58f admin admin] REQUEST_METHOD: `PUT` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:08.359878 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed858b0-108c-4b66-9fae-1ec2d723a58f admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:08.360159 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed858b0-108c-4b66-9fae-1ec2d723a58f admin admin] PATH_INFO: `/v3/projects/ec32529a130b48b388734e1596dd7430/users/2eab2e99881f4b62b5b48e6f565ca2ac/roles/634ba284303b4626b5a0402772c68f5c` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:08.374338 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed858b0-108c-4b66-9fae-1ec2d723a58f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec32529a130b48b388734e1596dd7430, user_id=2eab2e99881f4b62b5b48e6f565ca2ac, role_id=634ba284303b4626b5a0402772c68f5c)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:08.376377 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf35b223-7bba-4a7c-b4eb-d6031ebfe002 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:08.377014 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed858b0-108c-4b66-9fae-1ec2d723a58f admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:08.377833 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf35b223-7bba-4a7c-b4eb-d6031ebfe002 service cinder] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:08.388009 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1349/2683] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:29:08 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 19:29:08.389726 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1335/2684] 10.222.0.70 () {60 vars in 1482 bytes} [Tue May 10 19:29:08 2022] PUT /identity/v3/projects/ec32529a130b48b388734e1596dd7430/users/2eab2e99881f4b62b5b48e6f565ca2ac/roles/634ba284303b4626b5a0402772c68f5c => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 19:29:08.393507 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf35b223-7bba-4a7c-b4eb-d6031ebfe002 service cinder] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:08.404159 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf35b223-7bba-4a7c-b4eb-d6031ebfe002 service cinder] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:08.463207 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b0e8a5-f735-4902-813e-a8f6d6146347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:08.463873 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b0e8a5-f735-4902-813e-a8f6d6146347 admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:08.464153 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b0e8a5-f735-4902-813e-a8f6d6146347 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:08.464450 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b0e8a5-f735-4902-813e-a8f6d6146347 admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:08.465196 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b0e8a5-f735-4902-813e-a8f6d6146347 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:08.466763 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b0e8a5-f735-4902-813e-a8f6d6146347 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:08.480208 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1350/2685] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:29:08 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:29:08.485081 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed858b0-108c-4b66-9fae-1ec2d723a58f admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:08.495756 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed858b0-108c-4b66-9fae-1ec2d723a58f admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:08.501054 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dcd7d3-8a69-492e-8a30-6d5e7ec4d9c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:08.501940 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dcd7d3-8a69-492e-8a30-6d5e7ec4d9c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:08.502251 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dcd7d3-8a69-492e-8a30-6d5e7ec4d9c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:08.502520 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dcd7d3-8a69-492e-8a30-6d5e7ec4d9c4 admin admin] PATH_INFO: `/v3/projects/ec32529a130b48b388734e1596dd7430/users/2eab2e99881f4b62b5b48e6f565ca2ac/roles/634ba284303b4626b5a0402772c68f5c` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:08.504487 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dcd7d3-8a69-492e-8a30-6d5e7ec4d9c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec32529a130b48b388734e1596dd7430, user_id=2eab2e99881f4b62b5b48e6f565ca2ac, role_id=634ba284303b4626b5a0402772c68f5c)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:08.507151 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dcd7d3-8a69-492e-8a30-6d5e7ec4d9c4 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:08.518601 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1336/2686] 10.222.0.70 () {60 vars in 1482 bytes} [Tue May 10 19:29:08 2022] PUT /identity/v3/projects/ec32529a130b48b388734e1596dd7430/users/2eab2e99881f4b62b5b48e6f565ca2ac/roles/634ba284303b4626b5a0402772c68f5c => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:29:09.177644 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5cb68b-0aab-48ca-9683-93a7f11f1af2 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:09.178646 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5cb68b-0aab-48ca-9683-93a7f11f1af2 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:09.178957 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5cb68b-0aab-48ca-9683-93a7f11f1af2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:09.215244 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-0e5cb68b-0aab-48ca-9683-93a7f11f1af2 None None] MFA Rules not processed for user `2eab2e99881f4b62b5b48e6f565ca2ac`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:29:09.215244 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-0e5cb68b-0aab-48ca-9683-93a7f11f1af2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:29:09.288247 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1351/2687] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:29:09 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:29:10.400389 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dcd7d3-8a69-492e-8a30-6d5e7ec4d9c4 admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:10.469007 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dcd7d3-8a69-492e-8a30-6d5e7ec4d9c4 admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:10.474200 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b094b4ca-7ef0-417a-aaf7-b401c00158f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:10.475010 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b094b4ca-7ef0-417a-aaf7-b401c00158f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:10.475293 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b094b4ca-7ef0-417a-aaf7-b401c00158f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:10.475569 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b094b4ca-7ef0-417a-aaf7-b401c00158f1 admin admin] PATH_INFO: `/v3/users/4d8ebccf99d44393ada9a256afc0067c` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:10.476768 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b094b4ca-7ef0-417a-aaf7-b401c00158f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d8ebccf99d44393ada9a256afc0067c)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:10.479205 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b094b4ca-7ef0-417a-aaf7-b401c00158f1 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:10.529774 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded09ad2-82b2-4748-bc54-1daf8934f8f3 None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:10.530358 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded09ad2-82b2-4748-bc54-1daf8934f8f3 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:10.530358 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded09ad2-82b2-4748-bc54-1daf8934f8f3 None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:10.532205 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1352/2688] 10.222.0.70 () {54 vars in 921 bytes} [Tue May 10 19:29:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 19:29:10.538137 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8a4bd0-b2f7-40ec-8067-7504b67f456a None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:10.538488 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8a4bd0-b2f7-40ec-8067-7504b67f456a None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:10.538796 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8a4bd0-b2f7-40ec-8067-7504b67f456a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:10.543595 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-b094b4ca-7ef0-417a-aaf7-b401c00158f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d8ebccf99d44393ada9a256afc0067c'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:10.558220 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-b094b4ca-7ef0-417a-aaf7-b401c00158f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d8ebccf99d44393ada9a256afc0067c'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:10.558427 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-7f8a4bd0-b2f7-40ec-8067-7504b67f456a None None] MFA Rules not processed for user `91f1dc79540b48c0866478cc48cd8205`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:29:10.559552 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-7f8a4bd0-b2f7-40ec-8067-7504b67f456a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:29:10.566074 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-b094b4ca-7ef0-417a-aaf7-b401c00158f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d8ebccf99d44393ada9a256afc0067c'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:10.566778 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-b094b4ca-7ef0-417a-aaf7-b401c00158f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d8ebccf99d44393ada9a256afc0067c'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:10.576111 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-b094b4ca-7ef0-417a-aaf7-b401c00158f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d8ebccf99d44393ada9a256afc0067c'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:10.583683 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1337/2689] 10.222.0.70 () {58 vars in 1223 bytes} [Tue May 10 19:29:10 2022] DELETE /identity/v3/users/4d8ebccf99d44393ada9a256afc0067c => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 19:29:10.616556 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1353/2690] 10.222.0.70 () {58 vars in 1018 bytes} [Tue May 10 19:29:10 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:29:10.629190 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b094b4ca-7ef0-417a-aaf7-b401c00158f1 admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:10.630656 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-b094b4ca-7ef0-417a-aaf7-b401c00158f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:29:10.691980 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b094b4ca-7ef0-417a-aaf7-b401c00158f1 admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:10.696617 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4915f6f4-2354-46c1-a42a-085b143170a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f1dc79540b48c0866478cc48cd8205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:10.697298 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4915f6f4-2354-46c1-a42a-085b143170a3 service neutron] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:10.697588 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4915f6f4-2354-46c1-a42a-085b143170a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:10.697866 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4915f6f4-2354-46c1-a42a-085b143170a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:10.705176 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4915f6f4-2354-46c1-a42a-085b143170a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:10.706626 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4915f6f4-2354-46c1-a42a-085b143170a3 service neutron] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:10.716474 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1338/2691] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:29:10 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:29:10.822382 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b43a08-a57d-452f-b2f0-df255702d93b None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:10.822664 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b43a08-a57d-452f-b2f0-df255702d93b None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:10.822935 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b43a08-a57d-452f-b2f0-df255702d93b None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:10.824312 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1354/2692] 10.222.0.70 () {54 vars in 921 bytes} [Tue May 10 19:29:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:29:10.830929 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64da20a5-8458-45b2-8adf-640258a2ce46 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:10.831244 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4915f6f4-2354-46c1-a42a-085b143170a3 service neutron] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:10.831389 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64da20a5-8458-45b2-8adf-640258a2ce46 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:10.831610 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64da20a5-8458-45b2-8adf-640258a2ce46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:10.832857 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-4915f6f4-2354-46c1-a42a-085b143170a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:29:10.856490 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-64da20a5-8458-45b2-8adf-640258a2ce46 None None] MFA Rules not processed for user `b9f310a468ec4058b3c95356ea60ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:29:10.857669 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-64da20a5-8458-45b2-8adf-640258a2ce46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:29:10.901588 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4915f6f4-2354-46c1-a42a-085b143170a3 service neutron] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:10.906179 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69356f85-5e1a-402a-b069-d537909bab56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:10.907061 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69356f85-5e1a-402a-b069-d537909bab56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:10.907351 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69356f85-5e1a-402a-b069-d537909bab56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:10.907625 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69356f85-5e1a-402a-b069-d537909bab56 admin admin] PATH_INFO: `/v3/projects/53b50d5da7b446b9bd8c522b0e45f159` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:10.908818 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69356f85-5e1a-402a-b069-d537909bab56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=53b50d5da7b446b9bd8c522b0e45f159)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:10.910704 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69356f85-5e1a-402a-b069-d537909bab56 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:10.923252 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1355/2693] 10.222.0.70 () {58 vars in 1018 bytes} [Tue May 10 19:29:10 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:29:10.935680 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64da20a5-8458-45b2-8adf-640258a2ce46 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:10.937323 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-64da20a5-8458-45b2-8adf-640258a2ce46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:29:10.950238 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64da20a5-8458-45b2-8adf-640258a2ce46 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:10.961955 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-69356f85-5e1a-402a-b069-d537909bab56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53b50d5da7b446b9bd8c522b0e45f159', 'request_id': 'req-69356f85-5e1a-402a-b069-d537909bab56'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:10.968326 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-69356f85-5e1a-402a-b069-d537909bab56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53b50d5da7b446b9bd8c522b0e45f159', 'request_id': 'req-69356f85-5e1a-402a-b069-d537909bab56'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:10.975410 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-69356f85-5e1a-402a-b069-d537909bab56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53b50d5da7b446b9bd8c522b0e45f159', 'request_id': 'req-69356f85-5e1a-402a-b069-d537909bab56'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:10.996559 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-69356f85-5e1a-402a-b069-d537909bab56 admin admin] The token cache is being invalidate because project 53b50d5da7b446b9bd8c522b0e45f159 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79993) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:29:10.996912 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-69356f85-5e1a-402a-b069-d537909bab56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:10.997851 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-69356f85-5e1a-402a-b069-d537909bab56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:11.003015 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4a0541-0e8f-43b9-b8f8-dd861985c835 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f1dc79540b48c0866478cc48cd8205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:11.003388 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1339/2694] 10.222.0.70 () {58 vars in 1232 bytes} [Tue May 10 19:29:10 2022] DELETE /identity/v3/projects/53b50d5da7b446b9bd8c522b0e45f159 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 19:29:11.003502 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4a0541-0e8f-43b9-b8f8-dd861985c835 service neutron] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:11.003502 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4a0541-0e8f-43b9-b8f8-dd861985c835 service neutron] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:11.003502 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4a0541-0e8f-43b9-b8f8-dd861985c835 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:11.003502 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-3b4a0541-0e8f-43b9-b8f8-dd861985c835 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:29:11.003996 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69356f85-5e1a-402a-b069-d537909bab56 admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:11.005244 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-69356f85-5e1a-402a-b069-d537909bab56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:29:11.075279 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69356f85-5e1a-402a-b069-d537909bab56 admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:11.080214 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d537e48b-8fdf-4ebc-a3b3-50d54f90eae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:11.080650 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4a0541-0e8f-43b9-b8f8-dd861985c835 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:11.081113 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d537e48b-8fdf-4ebc-a3b3-50d54f90eae3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:11.081382 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d537e48b-8fdf-4ebc-a3b3-50d54f90eae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:11.081657 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d537e48b-8fdf-4ebc-a3b3-50d54f90eae3 admin admin] PATH_INFO: `/v3/users/2eab2e99881f4b62b5b48e6f565ca2ac` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:11.082636 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4a0541-0e8f-43b9-b8f8-dd861985c835 service neutron] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:11.082922 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d537e48b-8fdf-4ebc-a3b3-50d54f90eae3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2eab2e99881f4b62b5b48e6f565ca2ac)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:11.084776 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d537e48b-8fdf-4ebc-a3b3-50d54f90eae3 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:11.095591 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1356/2695] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:29:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:29:11.145681 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-d537e48b-8fdf-4ebc-a3b3-50d54f90eae3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2eab2e99881f4b62b5b48e6f565ca2ac'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:11.158948 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-d537e48b-8fdf-4ebc-a3b3-50d54f90eae3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2eab2e99881f4b62b5b48e6f565ca2ac'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:11.167052 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-d537e48b-8fdf-4ebc-a3b3-50d54f90eae3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2eab2e99881f4b62b5b48e6f565ca2ac'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:11.167871 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-d537e48b-8fdf-4ebc-a3b3-50d54f90eae3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2eab2e99881f4b62b5b48e6f565ca2ac'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:11.182695 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-d537e48b-8fdf-4ebc-a3b3-50d54f90eae3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2eab2e99881f4b62b5b48e6f565ca2ac'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:11.190832 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1340/2696] 10.222.0.70 () {58 vars in 1223 bytes} [Tue May 10 19:29:11 2022] DELETE /identity/v3/users/2eab2e99881f4b62b5b48e6f565ca2ac => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:29:11.373635 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4a0541-0e8f-43b9-b8f8-dd861985c835 service neutron] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:11.387995 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4a0541-0e8f-43b9-b8f8-dd861985c835 service neutron] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:11.448649 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5a4c62-4ad9-45ed-b80e-4e223463726c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:11.449515 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5a4c62-4ad9-45ed-b80e-4e223463726c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:11.449799 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5a4c62-4ad9-45ed-b80e-4e223463726c admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:11.450060 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5a4c62-4ad9-45ed-b80e-4e223463726c admin admin] PATH_INFO: `/v3/projects/ec32529a130b48b388734e1596dd7430` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:11.451273 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5a4c62-4ad9-45ed-b80e-4e223463726c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec32529a130b48b388734e1596dd7430)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:11.453371 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5a4c62-4ad9-45ed-b80e-4e223463726c admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:11.498855 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-fe5a4c62-4ad9-45ed-b80e-4e223463726c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec32529a130b48b388734e1596dd7430', 'request_id': 'req-fe5a4c62-4ad9-45ed-b80e-4e223463726c'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:11.504499 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-fe5a4c62-4ad9-45ed-b80e-4e223463726c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec32529a130b48b388734e1596dd7430', 'request_id': 'req-fe5a4c62-4ad9-45ed-b80e-4e223463726c'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:11.512228 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-fe5a4c62-4ad9-45ed-b80e-4e223463726c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec32529a130b48b388734e1596dd7430', 'request_id': 'req-fe5a4c62-4ad9-45ed-b80e-4e223463726c'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:11.523822 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-fe5a4c62-4ad9-45ed-b80e-4e223463726c admin admin] The token cache is being invalidate because project ec32529a130b48b388734e1596dd7430 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79994) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:29:11.524129 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-fe5a4c62-4ad9-45ed-b80e-4e223463726c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:11.524900 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-fe5a4c62-4ad9-45ed-b80e-4e223463726c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:11.526465 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1357/2697] 10.222.0.70 () {58 vars in 1232 bytes} [Tue May 10 19:29:11 2022] DELETE /identity/v3/projects/ec32529a130b48b388734e1596dd7430 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 19:29:11.531902 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aff140-f309-4610-ad55-6be6c0bba306 None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:11.532384 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aff140-f309-4610-ad55-6be6c0bba306 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:11.532557 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aff140-f309-4610-ad55-6be6c0bba306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:11.550917 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-03aff140-f309-4610-ad55-6be6c0bba306 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:29:11.552134 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-03aff140-f309-4610-ad55-6be6c0bba306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:29:11.618942 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1341/2698] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:29:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:29:11.628143 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf10c7b-b91f-47d8-9764-a771b95b8ce9 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:11.628602 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf10c7b-b91f-47d8-9764-a771b95b8ce9 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:11.628838 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf10c7b-b91f-47d8-9764-a771b95b8ce9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:11.647357 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-fbf10c7b-b91f-47d8-9764-a771b95b8ce9 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:29:11.648611 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-fbf10c7b-b91f-47d8-9764-a771b95b8ce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:29:11.656820 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1358/2699] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:29:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:29:11.661185 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aff140-f309-4610-ad55-6be6c0bba306 None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:11.671067 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aff140-f309-4610-ad55-6be6c0bba306 None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:11.675616 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6898eb7-fd13-4208-983e-6b206fa55f7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:11.676264 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6898eb7-fd13-4208-983e-6b206fa55f7f admin admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:11.676595 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6898eb7-fd13-4208-983e-6b206fa55f7f admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:11.676875 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6898eb7-fd13-4208-983e-6b206fa55f7f admin admin] PATH_INFO: `/v3/domains` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:11.677594 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6898eb7-fd13-4208-983e-6b206fa55f7f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:29:11.677929 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6898eb7-fd13-4208-983e-6b206fa55f7f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:11.679521 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6898eb7-fd13-4208-983e-6b206fa55f7f admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:11.696934 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1342/2700] 10.222.0.70 () {58 vars in 1152 bytes} [Tue May 10 19:29:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:29:11.698004 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf10c7b-b91f-47d8-9764-a771b95b8ce9 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:11.706965 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf10c7b-b91f-47d8-9764-a771b95b8ce9 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:11.711558 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4574a4b5-2534-4a35-a169-f05d2b9f21c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:11.712238 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4574a4b5-2534-4a35-a169-f05d2b9f21c3 admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:11.712623 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4574a4b5-2534-4a35-a169-f05d2b9f21c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:11.712832 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4574a4b5-2534-4a35-a169-f05d2b9f21c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:11.713514 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4574a4b5-2534-4a35-a169-f05d2b9f21c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:11.715480 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4574a4b5-2534-4a35-a169-f05d2b9f21c3 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:11.741553 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1359/2701] 10.222.0.70 () {60 vars in 1152 bytes} [Tue May 10 19:29:11 2022] POST /identity/v3/projects => generated 373 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:29:11.746267 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6898eb7-fd13-4208-983e-6b206fa55f7f admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:11.756218 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6898eb7-fd13-4208-983e-6b206fa55f7f admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:11.811138 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c061830-46f3-4ac3-9492-3d9034c71510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:11.811859 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c061830-46f3-4ac3-9492-3d9034c71510 admin admin] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:11.812100 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c061830-46f3-4ac3-9492-3d9034c71510 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:11.812380 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c061830-46f3-4ac3-9492-3d9034c71510 admin admin] PATH_INFO: `/v3/users` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:11.813722 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c061830-46f3-4ac3-9492-3d9034c71510 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:11.815771 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c061830-46f3-4ac3-9492-3d9034c71510 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:11.835493 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1343/2702] 10.222.0.70 () {60 vars in 1143 bytes} [Tue May 10 19:29:11 2022] POST /identity/v3/users => generated 287 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:29:11.839688 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4574a4b5-2534-4a35-a169-f05d2b9f21c3 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:11.850701 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4574a4b5-2534-4a35-a169-f05d2b9f21c3 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:11.861662 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148e6b73-cc5c-4f18-9f12-fb68599f664a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:11.862347 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148e6b73-cc5c-4f18-9f12-fb68599f664a admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:11.862630 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148e6b73-cc5c-4f18-9f12-fb68599f664a admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:11.862903 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148e6b73-cc5c-4f18-9f12-fb68599f664a admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:11.863629 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148e6b73-cc5c-4f18-9f12-fb68599f664a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:11.865251 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148e6b73-cc5c-4f18-9f12-fb68599f664a admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:11.876716 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1360/2703] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:29:11 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 19:29:11.880166 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c061830-46f3-4ac3-9492-3d9034c71510 admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:11.889961 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c061830-46f3-4ac3-9492-3d9034c71510 admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:11.894871 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4edf389-51d9-46db-afde-258294555a89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:11.895530 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4edf389-51d9-46db-afde-258294555a89 admin admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:11.895814 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4edf389-51d9-46db-afde-258294555a89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:11.896091 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4edf389-51d9-46db-afde-258294555a89 admin admin] PATH_INFO: `/v3/roles` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:11.896849 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4edf389-51d9-46db-afde-258294555a89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:11.898451 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4edf389-51d9-46db-afde-258294555a89 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:11.908699 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1344/2704] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:29:11 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:29:11.913012 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148e6b73-cc5c-4f18-9f12-fb68599f664a admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:11.926063 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148e6b73-cc5c-4f18-9f12-fb68599f664a admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:11.931334 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0d5d8f-2ea4-4cf4-b794-63de9a956926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:11.932413 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0d5d8f-2ea4-4cf4-b794-63de9a956926 admin admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:11.932572 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0d5d8f-2ea4-4cf4-b794-63de9a956926 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:11.932868 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0d5d8f-2ea4-4cf4-b794-63de9a956926 admin admin] PATH_INFO: `/v3/projects/3a6d862194d742558f63522efb2b1eaa/users/47e45d39583a41fd93f925b65cbbbc56/roles/5c07cf5bfbd3427db18428aa50420962` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:11.953470 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0d5d8f-2ea4-4cf4-b794-63de9a956926 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a6d862194d742558f63522efb2b1eaa, user_id=47e45d39583a41fd93f925b65cbbbc56, role_id=5c07cf5bfbd3427db18428aa50420962)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:11.957330 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0d5d8f-2ea4-4cf4-b794-63de9a956926 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:11.970547 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1361/2705] 10.222.0.70 () {60 vars in 1482 bytes} [Tue May 10 19:29:11 2022] PUT /identity/v3/projects/3a6d862194d742558f63522efb2b1eaa/users/47e45d39583a41fd93f925b65cbbbc56/roles/5c07cf5bfbd3427db18428aa50420962 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:29:11.981540 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cebc221-eb4b-42b0-a144-7ab1279c93da None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:11.981851 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cebc221-eb4b-42b0-a144-7ab1279c93da None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:11.982128 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cebc221-eb4b-42b0-a144-7ab1279c93da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:12.009868 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-6cebc221-eb4b-42b0-a144-7ab1279c93da None None] MFA Rules not processed for user `47e45d39583a41fd93f925b65cbbbc56`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:29:12.011052 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-6cebc221-eb4b-42b0-a144-7ab1279c93da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:29:12.080966 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1345/2706] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:29:11 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:29:12.082000 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0d5d8f-2ea4-4cf4-b794-63de9a956926 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:12.145396 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0d5d8f-2ea4-4cf4-b794-63de9a956926 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:12.150529 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc8f036-4040-4987-8fde-99ec79e9e0db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:12.151215 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc8f036-4040-4987-8fde-99ec79e9e0db admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:12.151497 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc8f036-4040-4987-8fde-99ec79e9e0db admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:12.151767 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc8f036-4040-4987-8fde-99ec79e9e0db admin admin] PATH_INFO: `/v3/projects` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:12.152494 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc8f036-4040-4987-8fde-99ec79e9e0db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:12.154382 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc8f036-4040-4987-8fde-99ec79e9e0db admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:12.182487 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1362/2707] 10.222.0.70 () {60 vars in 1152 bytes} [Tue May 10 19:29:12 2022] POST /identity/v3/projects => generated 371 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:29:12.183689 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cebc221-eb4b-42b0-a144-7ab1279c93da None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:12.194760 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cebc221-eb4b-42b0-a144-7ab1279c93da None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:12.249720 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a45670-89d1-4235-a070-4b6107bf89e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:12.250394 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a45670-89d1-4235-a070-4b6107bf89e3 admin admin] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:12.250679 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a45670-89d1-4235-a070-4b6107bf89e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:12.250957 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a45670-89d1-4235-a070-4b6107bf89e3 admin admin] PATH_INFO: `/v3/users` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:12.251645 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a45670-89d1-4235-a070-4b6107bf89e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:12.253593 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a45670-89d1-4235-a070-4b6107bf89e3 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:12.277231 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1346/2708] 10.222.0.70 () {60 vars in 1143 bytes} [Tue May 10 19:29:12 2022] POST /identity/v3/users => generated 292 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:29:12.278418 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc8f036-4040-4987-8fde-99ec79e9e0db admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:12.288307 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc8f036-4040-4987-8fde-99ec79e9e0db admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:12.293608 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d100935b-196b-4610-a4ee-761b1b873f37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:12.294269 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d100935b-196b-4610-a4ee-761b1b873f37 admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:12.294555 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d100935b-196b-4610-a4ee-761b1b873f37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:12.294825 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d100935b-196b-4610-a4ee-761b1b873f37 admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:12.295556 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d100935b-196b-4610-a4ee-761b1b873f37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:12.297162 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d100935b-196b-4610-a4ee-761b1b873f37 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:12.307307 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1363/2709] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:29:12 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 19:29:12.311645 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a45670-89d1-4235-a070-4b6107bf89e3 admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:12.321987 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a45670-89d1-4235-a070-4b6107bf89e3 admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:12.330269 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5458130e-57a5-48b6-af7f-933981ddb45c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:12.331216 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5458130e-57a5-48b6-af7f-933981ddb45c admin admin] REQUEST_METHOD: `PUT` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:12.331443 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5458130e-57a5-48b6-af7f-933981ddb45c admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:12.331800 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5458130e-57a5-48b6-af7f-933981ddb45c admin admin] PATH_INFO: `/v3/projects/fc17e1ca7cea4ee28a052d96b4ac9b70/users/5fab0f9df19e470fbd2201092bf1692c/roles/634ba284303b4626b5a0402772c68f5c` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:12.348476 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5458130e-57a5-48b6-af7f-933981ddb45c admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc17e1ca7cea4ee28a052d96b4ac9b70, user_id=5fab0f9df19e470fbd2201092bf1692c, role_id=634ba284303b4626b5a0402772c68f5c)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:12.351208 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5458130e-57a5-48b6-af7f-933981ddb45c admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:12.365221 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1347/2710] 10.222.0.70 () {60 vars in 1482 bytes} [Tue May 10 19:29:12 2022] PUT /identity/v3/projects/fc17e1ca7cea4ee28a052d96b4ac9b70/users/5fab0f9df19e470fbd2201092bf1692c/roles/634ba284303b4626b5a0402772c68f5c => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:29:12.369640 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d100935b-196b-4610-a4ee-761b1b873f37 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:12.380819 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d100935b-196b-4610-a4ee-761b1b873f37 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:12.445877 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f1c3bd-cc81-480d-9330-607dd03aab2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:12.446594 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f1c3bd-cc81-480d-9330-607dd03aab2e admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:12.447029 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f1c3bd-cc81-480d-9330-607dd03aab2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:12.447294 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f1c3bd-cc81-480d-9330-607dd03aab2e admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:12.448122 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f1c3bd-cc81-480d-9330-607dd03aab2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:12.449763 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f1c3bd-cc81-480d-9330-607dd03aab2e admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:12.461790 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1364/2711] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:29:12 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 19:29:12.466311 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5458130e-57a5-48b6-af7f-933981ddb45c admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:12.496915 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5458130e-57a5-48b6-af7f-933981ddb45c admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:12.505314 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fbdc45-f740-4d1c-8cff-1a62da148297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:12.507053 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fbdc45-f740-4d1c-8cff-1a62da148297 admin admin] REQUEST_METHOD: `PUT` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:12.507498 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fbdc45-f740-4d1c-8cff-1a62da148297 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:12.507939 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fbdc45-f740-4d1c-8cff-1a62da148297 admin admin] PATH_INFO: `/v3/projects/fc17e1ca7cea4ee28a052d96b4ac9b70/users/5fab0f9df19e470fbd2201092bf1692c/roles/634ba284303b4626b5a0402772c68f5c` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:12.510454 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fbdc45-f740-4d1c-8cff-1a62da148297 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc17e1ca7cea4ee28a052d96b4ac9b70, user_id=5fab0f9df19e470fbd2201092bf1692c, role_id=634ba284303b4626b5a0402772c68f5c)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:12.516276 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fbdc45-f740-4d1c-8cff-1a62da148297 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:12.531866 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1348/2712] 10.222.0.70 () {60 vars in 1482 bytes} [Tue May 10 19:29:12 2022] PUT /identity/v3/projects/fc17e1ca7cea4ee28a052d96b4ac9b70/users/5fab0f9df19e470fbd2201092bf1692c/roles/634ba284303b4626b5a0402772c68f5c => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:29:12.543993 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cca487-c693-493f-96ce-6869dfa3a4fa None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:12.544294 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cca487-c693-493f-96ce-6869dfa3a4fa None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:12.544606 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cca487-c693-493f-96ce-6869dfa3a4fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:12.578081 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-a7cca487-c693-493f-96ce-6869dfa3a4fa None None] MFA Rules not processed for user `5fab0f9df19e470fbd2201092bf1692c`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:29:12.579768 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-a7cca487-c693-493f-96ce-6869dfa3a4fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:29:12.653222 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1365/2713] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:29:12 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:29:12.665974 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fbdc45-f740-4d1c-8cff-1a62da148297 admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:12.667747 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-51fbdc45-f740-4d1c-8cff-1a62da148297 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:29:12.724784 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fbdc45-f740-4d1c-8cff-1a62da148297 admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:12.729634 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c47ea58-d692-4768-9024-1edad616b85b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15df2a8967aa43299c10e365f4200d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:12.730296 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c47ea58-d692-4768-9024-1edad616b85b service cinder] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:12.730578 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c47ea58-d692-4768-9024-1edad616b85b service cinder] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:12.730855 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c47ea58-d692-4768-9024-1edad616b85b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:12.740295 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c47ea58-d692-4768-9024-1edad616b85b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:12.741769 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c47ea58-d692-4768-9024-1edad616b85b service cinder] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:12.753123 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1349/2714] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:29:12 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:29:13.146293 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cca487-c693-493f-96ce-6869dfa3a4fa None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:13.208394 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cca487-c693-493f-96ce-6869dfa3a4fa None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:13.215839 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fc09b6-bdc7-44f5-8c03-282eea15e284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:13.216758 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fc09b6-bdc7-44f5-8c03-282eea15e284 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:13.217044 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fc09b6-bdc7-44f5-8c03-282eea15e284 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:13.217320 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fc09b6-bdc7-44f5-8c03-282eea15e284 admin admin] PATH_INFO: `/v3/users/47e45d39583a41fd93f925b65cbbbc56` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:13.218522 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fc09b6-bdc7-44f5-8c03-282eea15e284 admin admin] RBAC: Authorizing `identity:delete_user(user_id=47e45d39583a41fd93f925b65cbbbc56)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:13.220696 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fc09b6-bdc7-44f5-8c03-282eea15e284 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:13.291137 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-13fc09b6-bdc7-44f5-8c03-282eea15e284 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47e45d39583a41fd93f925b65cbbbc56'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:13.303760 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-13fc09b6-bdc7-44f5-8c03-282eea15e284 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47e45d39583a41fd93f925b65cbbbc56'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:13.304628 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-13fc09b6-bdc7-44f5-8c03-282eea15e284 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47e45d39583a41fd93f925b65cbbbc56'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:13.313783 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-13fc09b6-bdc7-44f5-8c03-282eea15e284 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47e45d39583a41fd93f925b65cbbbc56'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:13.322448 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-13fc09b6-bdc7-44f5-8c03-282eea15e284 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47e45d39583a41fd93f925b65cbbbc56'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:13.329242 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1366/2715] 10.222.0.70 () {58 vars in 1223 bytes} [Tue May 10 19:29:13 2022] DELETE /identity/v3/users/47e45d39583a41fd93f925b65cbbbc56 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:29:13.333767 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d026c7d-05c3-487e-9341-0cb1888afca6 None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:13.334566 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d026c7d-05c3-487e-9341-0cb1888afca6 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:13.334566 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d026c7d-05c3-487e-9341-0cb1888afca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:13.357710 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-1d026c7d-05c3-487e-9341-0cb1888afca6 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:29:13.358912 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-1d026c7d-05c3-487e-9341-0cb1888afca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:29:13.416178 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1350/2716] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:29:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:29:13.429889 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fc09b6-bdc7-44f5-8c03-282eea15e284 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:13.429889 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-13fc09b6-bdc7-44f5-8c03-282eea15e284 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:29:13.486997 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fc09b6-bdc7-44f5-8c03-282eea15e284 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:13.490308 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433c82ae-5990-40d8-86a2-0c5d7bf3faa2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f1dc79540b48c0866478cc48cd8205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:13.490942 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433c82ae-5990-40d8-86a2-0c5d7bf3faa2 service neutron] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:13.491223 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433c82ae-5990-40d8-86a2-0c5d7bf3faa2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:13.491489 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433c82ae-5990-40d8-86a2-0c5d7bf3faa2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:13.500299 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433c82ae-5990-40d8-86a2-0c5d7bf3faa2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:13.501762 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433c82ae-5990-40d8-86a2-0c5d7bf3faa2 service neutron] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:13.511353 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1367/2717] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:29:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 19:29:13.815347 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d026c7d-05c3-487e-9341-0cb1888afca6 None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:13.817590 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-1d026c7d-05c3-487e-9341-0cb1888afca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:29:13.834967 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d026c7d-05c3-487e-9341-0cb1888afca6 None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:13.840483 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75fbd19-e0ec-4654-8aad-4c4e26d05da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:13.841772 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75fbd19-e0ec-4654-8aad-4c4e26d05da0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:13.842414 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75fbd19-e0ec-4654-8aad-4c4e26d05da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:13.842688 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75fbd19-e0ec-4654-8aad-4c4e26d05da0 admin admin] PATH_INFO: `/v3/projects/3a6d862194d742558f63522efb2b1eaa` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:13.844106 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75fbd19-e0ec-4654-8aad-4c4e26d05da0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a6d862194d742558f63522efb2b1eaa)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:13.846903 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75fbd19-e0ec-4654-8aad-4c4e26d05da0 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:13.896894 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-b75fbd19-e0ec-4654-8aad-4c4e26d05da0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a6d862194d742558f63522efb2b1eaa', 'request_id': 'req-b75fbd19-e0ec-4654-8aad-4c4e26d05da0'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:13.902171 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-b75fbd19-e0ec-4654-8aad-4c4e26d05da0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a6d862194d742558f63522efb2b1eaa', 'request_id': 'req-b75fbd19-e0ec-4654-8aad-4c4e26d05da0'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:13.909862 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-b75fbd19-e0ec-4654-8aad-4c4e26d05da0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a6d862194d742558f63522efb2b1eaa', 'request_id': 'req-b75fbd19-e0ec-4654-8aad-4c4e26d05da0'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:13.921242 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-b75fbd19-e0ec-4654-8aad-4c4e26d05da0 admin admin] The token cache is being invalidate because project 3a6d862194d742558f63522efb2b1eaa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79993) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:29:13.921528 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-b75fbd19-e0ec-4654-8aad-4c4e26d05da0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:13.922154 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-b75fbd19-e0ec-4654-8aad-4c4e26d05da0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:13.923681 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1351/2718] 10.222.0.70 () {58 vars in 1232 bytes} [Tue May 10 19:29:13 2022] DELETE /identity/v3/projects/3a6d862194d742558f63522efb2b1eaa => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:29:13.927736 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433c82ae-5990-40d8-86a2-0c5d7bf3faa2 service neutron] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:13.938033 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433c82ae-5990-40d8-86a2-0c5d7bf3faa2 service neutron] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:13.992766 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602c9442-35a5-4bb9-b152-f995678d50d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:13.994182 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602c9442-35a5-4bb9-b152-f995678d50d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:13.994464 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602c9442-35a5-4bb9-b152-f995678d50d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:13.994734 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602c9442-35a5-4bb9-b152-f995678d50d6 admin admin] PATH_INFO: `/v3/users/5fab0f9df19e470fbd2201092bf1692c` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:13.995924 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602c9442-35a5-4bb9-b152-f995678d50d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5fab0f9df19e470fbd2201092bf1692c)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:13.997953 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602c9442-35a5-4bb9-b152-f995678d50d6 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:14.041688 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-602c9442-35a5-4bb9-b152-f995678d50d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5fab0f9df19e470fbd2201092bf1692c'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:14.053209 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-602c9442-35a5-4bb9-b152-f995678d50d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5fab0f9df19e470fbd2201092bf1692c'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:14.053925 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-602c9442-35a5-4bb9-b152-f995678d50d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5fab0f9df19e470fbd2201092bf1692c'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:14.060898 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-602c9442-35a5-4bb9-b152-f995678d50d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5fab0f9df19e470fbd2201092bf1692c'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:14.068268 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-602c9442-35a5-4bb9-b152-f995678d50d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5fab0f9df19e470fbd2201092bf1692c'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:14.074913 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1368/2719] 10.222.0.70 () {58 vars in 1223 bytes} [Tue May 10 19:29:13 2022] DELETE /identity/v3/users/5fab0f9df19e470fbd2201092bf1692c => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:29:14.419746 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75fbd19-e0ec-4654-8aad-4c4e26d05da0 admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:14.421389 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-b75fbd19-e0ec-4654-8aad-4c4e26d05da0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:29:14.435389 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75fbd19-e0ec-4654-8aad-4c4e26d05da0 admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:14.490131 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97419b31-2582-44c5-a3c9-b5a1e06d969b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:14.490987 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97419b31-2582-44c5-a3c9-b5a1e06d969b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:14.491267 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97419b31-2582-44c5-a3c9-b5a1e06d969b admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:14.491537 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97419b31-2582-44c5-a3c9-b5a1e06d969b admin admin] PATH_INFO: `/v3/projects/fc17e1ca7cea4ee28a052d96b4ac9b70` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:14.492735 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97419b31-2582-44c5-a3c9-b5a1e06d969b admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc17e1ca7cea4ee28a052d96b4ac9b70)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:14.494667 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97419b31-2582-44c5-a3c9-b5a1e06d969b admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:14.537248 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-97419b31-2582-44c5-a3c9-b5a1e06d969b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc17e1ca7cea4ee28a052d96b4ac9b70', 'request_id': 'req-97419b31-2582-44c5-a3c9-b5a1e06d969b'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:14.543076 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-97419b31-2582-44c5-a3c9-b5a1e06d969b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc17e1ca7cea4ee28a052d96b4ac9b70', 'request_id': 'req-97419b31-2582-44c5-a3c9-b5a1e06d969b'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:14.549863 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-97419b31-2582-44c5-a3c9-b5a1e06d969b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc17e1ca7cea4ee28a052d96b4ac9b70', 'request_id': 'req-97419b31-2582-44c5-a3c9-b5a1e06d969b'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:14.560378 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-97419b31-2582-44c5-a3c9-b5a1e06d969b admin admin] The token cache is being invalidate because project fc17e1ca7cea4ee28a052d96b4ac9b70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79993) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:29:14.560696 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-97419b31-2582-44c5-a3c9-b5a1e06d969b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:14.561309 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-97419b31-2582-44c5-a3c9-b5a1e06d969b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:14.562824 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1352/2720] 10.222.0.70 () {58 vars in 1232 bytes} [Tue May 10 19:29:14 2022] DELETE /identity/v3/projects/fc17e1ca7cea4ee28a052d96b4ac9b70 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 19:29:14.569011 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba81ad81-26ec-4d8d-a6ac-b00497bc8838 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:14.569302 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba81ad81-26ec-4d8d-a6ac-b00497bc8838 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:14.569578 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba81ad81-26ec-4d8d-a6ac-b00497bc8838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:14.586470 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-ba81ad81-26ec-4d8d-a6ac-b00497bc8838 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:29:14.588216 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-ba81ad81-26ec-4d8d-a6ac-b00497bc8838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:29:14.643689 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1369/2721] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:29:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:29:14.652028 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441fe702-06b8-4b87-b8fd-e74f043d4126 None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:14.652317 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441fe702-06b8-4b87-b8fd-e74f043d4126 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:14.652628 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441fe702-06b8-4b87-b8fd-e74f043d4126 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:14.670855 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-441fe702-06b8-4b87-b8fd-e74f043d4126 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:29:14.672092 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-441fe702-06b8-4b87-b8fd-e74f043d4126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:29:14.679874 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1353/2722] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:29:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:29:14.683945 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba81ad81-26ec-4d8d-a6ac-b00497bc8838 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:14.694049 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba81ad81-26ec-4d8d-a6ac-b00497bc8838 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:14.699476 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4e85b4-a64a-42f4-bbcf-9c4ec76daf47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:14.700136 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4e85b4-a64a-42f4-bbcf-9c4ec76daf47 admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:14.700450 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4e85b4-a64a-42f4-bbcf-9c4ec76daf47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:14.700747 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4e85b4-a64a-42f4-bbcf-9c4ec76daf47 admin admin] PATH_INFO: `/v3/domains` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:14.701466 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4e85b4-a64a-42f4-bbcf-9c4ec76daf47 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:29:14.701771 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4e85b4-a64a-42f4-bbcf-9c4ec76daf47 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:14.703411 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4e85b4-a64a-42f4-bbcf-9c4ec76daf47 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:14.715330 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1370/2723] 10.222.0.70 () {58 vars in 1152 bytes} [Tue May 10 19:29:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:29:14.719546 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441fe702-06b8-4b87-b8fd-e74f043d4126 None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:14.728526 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441fe702-06b8-4b87-b8fd-e74f043d4126 None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:14.733124 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a09a51b-699e-458a-9e86-6703acedf31f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:14.733825 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a09a51b-699e-458a-9e86-6703acedf31f admin admin] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:14.734134 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a09a51b-699e-458a-9e86-6703acedf31f admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:14.734429 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a09a51b-699e-458a-9e86-6703acedf31f admin admin] PATH_INFO: `/v3/projects` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:14.735163 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a09a51b-699e-458a-9e86-6703acedf31f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:14.737073 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a09a51b-699e-458a-9e86-6703acedf31f admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:14.772574 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1354/2724] 10.222.0.70 () {60 vars in 1152 bytes} [Tue May 10 19:29:14 2022] POST /identity/v3/projects => generated 387 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 19:29:14.777457 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4e85b4-a64a-42f4-bbcf-9c4ec76daf47 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:14.788038 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4e85b4-a64a-42f4-bbcf-9c4ec76daf47 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:14.847192 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c53f79-59c7-437d-b3ab-1348fe0ab273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:14.847871 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c53f79-59c7-437d-b3ab-1348fe0ab273 admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:14.848153 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c53f79-59c7-437d-b3ab-1348fe0ab273 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:14.848452 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c53f79-59c7-437d-b3ab-1348fe0ab273 admin admin] PATH_INFO: `/v3/users` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:14.849150 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c53f79-59c7-437d-b3ab-1348fe0ab273 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:14.851057 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c53f79-59c7-437d-b3ab-1348fe0ab273 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:14.870133 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1371/2725] 10.222.0.70 () {60 vars in 1143 bytes} [Tue May 10 19:29:14 2022] POST /identity/v3/users => generated 294 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:29:14.874379 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a09a51b-699e-458a-9e86-6703acedf31f admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:14.887049 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a09a51b-699e-458a-9e86-6703acedf31f admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:14.896754 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb796546-4df8-4f21-ab64-133d01ee93c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:14.901019 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb796546-4df8-4f21-ab64-133d01ee93c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:14.905444 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb796546-4df8-4f21-ab64-133d01ee93c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:14.905444 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb796546-4df8-4f21-ab64-133d01ee93c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:14.905444 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb796546-4df8-4f21-ab64-133d01ee93c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:14.905444 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb796546-4df8-4f21-ab64-133d01ee93c0 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:14.920479 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1355/2726] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:29:14 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:29:14.924593 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c53f79-59c7-437d-b3ab-1348fe0ab273 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:14.936189 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c53f79-59c7-437d-b3ab-1348fe0ab273 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:14.941729 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3eb0bbc-6864-4990-9cb0-86c5687743e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:14.944618 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eb0bbc-6864-4990-9cb0-86c5687743e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:14.945174 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eb0bbc-6864-4990-9cb0-86c5687743e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:14.945769 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eb0bbc-6864-4990-9cb0-86c5687743e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:14.951144 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3eb0bbc-6864-4990-9cb0-86c5687743e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:14.953521 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3eb0bbc-6864-4990-9cb0-86c5687743e6 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:14.970559 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1372/2727] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:29:14 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:29:14.972904 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb796546-4df8-4f21-ab64-133d01ee93c0 admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:14.984034 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb796546-4df8-4f21-ab64-133d01ee93c0 admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:14.988983 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44247a5d-6791-426b-b07b-5c326bac0a01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:14.990131 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44247a5d-6791-426b-b07b-5c326bac0a01 admin admin] REQUEST_METHOD: `PUT` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:14.990482 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44247a5d-6791-426b-b07b-5c326bac0a01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:14.990826 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44247a5d-6791-426b-b07b-5c326bac0a01 admin admin] PATH_INFO: `/v3/projects/8973232f07ff43b0b99c21512063c7c0/users/003f52e7a8a54d30b5abe5930745aa17/roles/5c07cf5bfbd3427db18428aa50420962` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:15.007427 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44247a5d-6791-426b-b07b-5c326bac0a01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8973232f07ff43b0b99c21512063c7c0, user_id=003f52e7a8a54d30b5abe5930745aa17, role_id=5c07cf5bfbd3427db18428aa50420962)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:15.010719 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44247a5d-6791-426b-b07b-5c326bac0a01 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:15.023065 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1356/2728] 10.222.0.70 () {60 vars in 1482 bytes} [Tue May 10 19:29:14 2022] PUT /identity/v3/projects/8973232f07ff43b0b99c21512063c7c0/users/003f52e7a8a54d30b5abe5930745aa17/roles/5c07cf5bfbd3427db18428aa50420962 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 19:29:15.034280 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4babe4-6a87-4648-a4ea-e08ec8fa3346 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:15.034574 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4babe4-6a87-4648-a4ea-e08ec8fa3346 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:15.035052 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4babe4-6a87-4648-a4ea-e08ec8fa3346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:15.062200 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-2c4babe4-6a87-4648-a4ea-e08ec8fa3346 None None] MFA Rules not processed for user `003f52e7a8a54d30b5abe5930745aa17`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:29:15.063520 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-2c4babe4-6a87-4648-a4ea-e08ec8fa3346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:29:15.137754 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44247a5d-6791-426b-b07b-5c326bac0a01 admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:15.138153 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1373/2729] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:29:15 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:29:15.208339 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44247a5d-6791-426b-b07b-5c326bac0a01 admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:15.213479 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd597dc8-8a30-49ef-9ec1-fc8167bf52a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:15.214174 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd597dc8-8a30-49ef-9ec1-fc8167bf52a6 admin admin] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:15.214440 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd597dc8-8a30-49ef-9ec1-fc8167bf52a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:15.214720 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd597dc8-8a30-49ef-9ec1-fc8167bf52a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:15.215409 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd597dc8-8a30-49ef-9ec1-fc8167bf52a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:15.217628 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd597dc8-8a30-49ef-9ec1-fc8167bf52a6 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:15.245997 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1357/2730] 10.222.0.70 () {60 vars in 1152 bytes} [Tue May 10 19:29:15 2022] POST /identity/v3/projects => generated 387 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 19:29:15.250184 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4babe4-6a87-4648-a4ea-e08ec8fa3346 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:15.261628 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4babe4-6a87-4648-a4ea-e08ec8fa3346 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:15.325196 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9b7d60-3ab6-4e13-a81b-863400432c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:15.325868 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9b7d60-3ab6-4e13-a81b-863400432c8a admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:15.326152 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9b7d60-3ab6-4e13-a81b-863400432c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:15.326423 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9b7d60-3ab6-4e13-a81b-863400432c8a admin admin] PATH_INFO: `/v3/users` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:15.327103 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9b7d60-3ab6-4e13-a81b-863400432c8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:15.329040 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9b7d60-3ab6-4e13-a81b-863400432c8a admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:15.348695 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1374/2731] 10.222.0.70 () {60 vars in 1143 bytes} [Tue May 10 19:29:15 2022] POST /identity/v3/users => generated 300 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 19:29:15.352502 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd597dc8-8a30-49ef-9ec1-fc8167bf52a6 admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:15.362858 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd597dc8-8a30-49ef-9ec1-fc8167bf52a6 admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:15.367425 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d059986-c59f-4d82-a887-06e908c2f74a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:15.368627 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d059986-c59f-4d82-a887-06e908c2f74a admin admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:15.368913 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d059986-c59f-4d82-a887-06e908c2f74a admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:15.369191 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d059986-c59f-4d82-a887-06e908c2f74a admin admin] PATH_INFO: `/v3/roles` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:15.369909 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d059986-c59f-4d82-a887-06e908c2f74a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:15.371661 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d059986-c59f-4d82-a887-06e908c2f74a admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:15.382253 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1358/2732] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:29:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:29:15.386993 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9b7d60-3ab6-4e13-a81b-863400432c8a admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:15.397018 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9b7d60-3ab6-4e13-a81b-863400432c8a admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:15.403215 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badfd576-1234-45ed-b79d-9cd877f6928a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:15.404107 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badfd576-1234-45ed-b79d-9cd877f6928a admin admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:15.404388 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badfd576-1234-45ed-b79d-9cd877f6928a admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:15.404687 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badfd576-1234-45ed-b79d-9cd877f6928a admin admin] PATH_INFO: `/v3/projects/808318cafe9e4ba38108018f93fc397e/users/213254baf17a4d669ac07870622c59bf/roles/634ba284303b4626b5a0402772c68f5c` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:15.421435 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badfd576-1234-45ed-b79d-9cd877f6928a admin admin] RBAC: Authorizing `identity:create_grant(project_id=808318cafe9e4ba38108018f93fc397e, user_id=213254baf17a4d669ac07870622c59bf, role_id=634ba284303b4626b5a0402772c68f5c)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:15.424776 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badfd576-1234-45ed-b79d-9cd877f6928a admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:15.440018 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1375/2733] 10.222.0.70 () {60 vars in 1482 bytes} [Tue May 10 19:29:15 2022] PUT /identity/v3/projects/808318cafe9e4ba38108018f93fc397e/users/213254baf17a4d669ac07870622c59bf/roles/634ba284303b4626b5a0402772c68f5c => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:29:15.444212 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d059986-c59f-4d82-a887-06e908c2f74a admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:15.454180 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d059986-c59f-4d82-a887-06e908c2f74a admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:15.509189 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9705889-e934-4226-9743-8da4ee997f14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:15.509847 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9705889-e934-4226-9743-8da4ee997f14 admin admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:15.510133 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9705889-e934-4226-9743-8da4ee997f14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:15.510408 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9705889-e934-4226-9743-8da4ee997f14 admin admin] PATH_INFO: `/v3/roles` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:15.511120 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9705889-e934-4226-9743-8da4ee997f14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:15.512760 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9705889-e934-4226-9743-8da4ee997f14 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:15.522044 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1359/2734] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:29:15 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:29:15.526150 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badfd576-1234-45ed-b79d-9cd877f6928a admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:15.536116 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badfd576-1234-45ed-b79d-9cd877f6928a admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:15.541311 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c046cc7e-a2fe-4cc4-8d1d-5e743a06f236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:15.542174 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c046cc7e-a2fe-4cc4-8d1d-5e743a06f236 admin admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:15.542449 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c046cc7e-a2fe-4cc4-8d1d-5e743a06f236 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:15.542715 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c046cc7e-a2fe-4cc4-8d1d-5e743a06f236 admin admin] PATH_INFO: `/v3/projects/808318cafe9e4ba38108018f93fc397e/users/213254baf17a4d669ac07870622c59bf/roles/634ba284303b4626b5a0402772c68f5c` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:15.544697 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c046cc7e-a2fe-4cc4-8d1d-5e743a06f236 admin admin] RBAC: Authorizing `identity:create_grant(project_id=808318cafe9e4ba38108018f93fc397e, user_id=213254baf17a4d669ac07870622c59bf, role_id=634ba284303b4626b5a0402772c68f5c)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:15.547287 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c046cc7e-a2fe-4cc4-8d1d-5e743a06f236 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:15.557475 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1376/2735] 10.222.0.70 () {60 vars in 1482 bytes} [Tue May 10 19:29:15 2022] PUT /identity/v3/projects/808318cafe9e4ba38108018f93fc397e/users/213254baf17a4d669ac07870622c59bf/roles/634ba284303b4626b5a0402772c68f5c => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 19:29:15.568791 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f59386-84bf-4de4-bda0-170896c775d6 None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:15.569079 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f59386-84bf-4de4-bda0-170896c775d6 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:15.569358 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f59386-84bf-4de4-bda0-170896c775d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:15.595910 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-85f59386-84bf-4de4-bda0-170896c775d6 None None] MFA Rules not processed for user `213254baf17a4d669ac07870622c59bf`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:29:15.597190 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-85f59386-84bf-4de4-bda0-170896c775d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:29:15.665637 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1360/2736] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:29:15 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:29:15.677246 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c046cc7e-a2fe-4cc4-8d1d-5e743a06f236 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:15.678870 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-c046cc7e-a2fe-4cc4-8d1d-5e743a06f236 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:29:15.735630 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c046cc7e-a2fe-4cc4-8d1d-5e743a06f236 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:15.739261 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab2d18c-8b26-4e6f-8f4a-353ecb1ab03c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15df2a8967aa43299c10e365f4200d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:15.739894 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab2d18c-8b26-4e6f-8f4a-353ecb1ab03c service cinder] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:15.740178 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab2d18c-8b26-4e6f-8f4a-353ecb1ab03c service cinder] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:15.740483 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab2d18c-8b26-4e6f-8f4a-353ecb1ab03c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:15.749778 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab2d18c-8b26-4e6f-8f4a-353ecb1ab03c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:15.751211 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab2d18c-8b26-4e6f-8f4a-353ecb1ab03c service cinder] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:15.760466 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1377/2737] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:29:15 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:29:15.827722 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f59386-84bf-4de4-bda0-170896c775d6 None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:15.888057 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f59386-84bf-4de4-bda0-170896c775d6 None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:15.892638 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fa3e22-dfe8-406b-940b-3188f3fe0ede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:15.893507 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fa3e22-dfe8-406b-940b-3188f3fe0ede admin admin] REQUEST_METHOD: `DELETE` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:15.893788 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fa3e22-dfe8-406b-940b-3188f3fe0ede admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:15.894062 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fa3e22-dfe8-406b-940b-3188f3fe0ede admin admin] PATH_INFO: `/v3/users/003f52e7a8a54d30b5abe5930745aa17` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:15.895269 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fa3e22-dfe8-406b-940b-3188f3fe0ede admin admin] RBAC: Authorizing `identity:delete_user(user_id=003f52e7a8a54d30b5abe5930745aa17)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:15.897222 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fa3e22-dfe8-406b-940b-3188f3fe0ede admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:15.943233 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-18fa3e22-dfe8-406b-940b-3188f3fe0ede admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '003f52e7a8a54d30b5abe5930745aa17'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:15.955183 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-18fa3e22-dfe8-406b-940b-3188f3fe0ede admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '003f52e7a8a54d30b5abe5930745aa17'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:15.962321 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-18fa3e22-dfe8-406b-940b-3188f3fe0ede admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '003f52e7a8a54d30b5abe5930745aa17'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:15.963151 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-18fa3e22-dfe8-406b-940b-3188f3fe0ede admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '003f52e7a8a54d30b5abe5930745aa17'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:15.970436 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-18fa3e22-dfe8-406b-940b-3188f3fe0ede admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '003f52e7a8a54d30b5abe5930745aa17'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:15.976128 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1361/2738] 10.222.0.70 () {58 vars in 1223 bytes} [Tue May 10 19:29:15 2022] DELETE /identity/v3/users/003f52e7a8a54d30b5abe5930745aa17 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:29:15.981215 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069dbc2c-675b-449c-9443-1635723567df None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:15.981675 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069dbc2c-675b-449c-9443-1635723567df None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:15.981783 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069dbc2c-675b-449c-9443-1635723567df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:15.998929 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-069dbc2c-675b-449c-9443-1635723567df None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:29:16.000123 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-069dbc2c-675b-449c-9443-1635723567df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:29:16.061564 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1378/2739] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:29:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:29:16.071261 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fa3e22-dfe8-406b-940b-3188f3fe0ede admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:16.072722 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-18fa3e22-dfe8-406b-940b-3188f3fe0ede admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:29:16.134248 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fa3e22-dfe8-406b-940b-3188f3fe0ede admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:16.137919 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1df2dc3-949f-4d88-870f-8a9536e1cd7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f1dc79540b48c0866478cc48cd8205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:16.138567 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1df2dc3-949f-4d88-870f-8a9536e1cd7d service neutron] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:16.138853 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1df2dc3-949f-4d88-870f-8a9536e1cd7d service neutron] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:16.139133 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1df2dc3-949f-4d88-870f-8a9536e1cd7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:16.148070 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1df2dc3-949f-4d88-870f-8a9536e1cd7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:16.150083 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1df2dc3-949f-4d88-870f-8a9536e1cd7d service neutron] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:16.159296 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1362/2740] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:29:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 19:29:16.445456 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069dbc2c-675b-449c-9443-1635723567df None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:16.449439 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-069dbc2c-675b-449c-9443-1635723567df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:29:16.464527 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069dbc2c-675b-449c-9443-1635723567df None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:16.469608 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829ca4b6-7638-46bd-bd54-397903e1abd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:16.470614 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829ca4b6-7638-46bd-bd54-397903e1abd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:16.470959 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829ca4b6-7638-46bd-bd54-397903e1abd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:16.471248 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829ca4b6-7638-46bd-bd54-397903e1abd1 admin admin] PATH_INFO: `/v3/projects/8973232f07ff43b0b99c21512063c7c0` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:16.472479 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829ca4b6-7638-46bd-bd54-397903e1abd1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8973232f07ff43b0b99c21512063c7c0)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:16.474389 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829ca4b6-7638-46bd-bd54-397903e1abd1 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:16.522932 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-829ca4b6-7638-46bd-bd54-397903e1abd1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8973232f07ff43b0b99c21512063c7c0', 'request_id': 'req-829ca4b6-7638-46bd-bd54-397903e1abd1'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:16.529536 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-829ca4b6-7638-46bd-bd54-397903e1abd1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8973232f07ff43b0b99c21512063c7c0', 'request_id': 'req-829ca4b6-7638-46bd-bd54-397903e1abd1'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:16.536927 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-829ca4b6-7638-46bd-bd54-397903e1abd1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8973232f07ff43b0b99c21512063c7c0', 'request_id': 'req-829ca4b6-7638-46bd-bd54-397903e1abd1'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:16.548742 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-829ca4b6-7638-46bd-bd54-397903e1abd1 admin admin] The token cache is being invalidate because project 8973232f07ff43b0b99c21512063c7c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79994) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:29:16.549031 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-829ca4b6-7638-46bd-bd54-397903e1abd1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:16.549673 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-829ca4b6-7638-46bd-bd54-397903e1abd1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:16.551208 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1379/2741] 10.222.0.70 () {58 vars in 1232 bytes} [Tue May 10 19:29:16 2022] DELETE /identity/v3/projects/8973232f07ff43b0b99c21512063c7c0 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 19:29:16.555983 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1df2dc3-949f-4d88-870f-8a9536e1cd7d service neutron] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:16.566053 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1df2dc3-949f-4d88-870f-8a9536e1cd7d service neutron] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:16.630012 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545e5b4a-3a44-4364-b7ef-bc7b9eaf06ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:16.630882 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545e5b4a-3a44-4364-b7ef-bc7b9eaf06ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:16.631163 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545e5b4a-3a44-4364-b7ef-bc7b9eaf06ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:16.631434 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545e5b4a-3a44-4364-b7ef-bc7b9eaf06ff admin admin] PATH_INFO: `/v3/users/213254baf17a4d669ac07870622c59bf` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:16.632665 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545e5b4a-3a44-4364-b7ef-bc7b9eaf06ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=213254baf17a4d669ac07870622c59bf)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:16.635140 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545e5b4a-3a44-4364-b7ef-bc7b9eaf06ff admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:16.681705 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-545e5b4a-3a44-4364-b7ef-bc7b9eaf06ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '213254baf17a4d669ac07870622c59bf'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:16.694896 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-545e5b4a-3a44-4364-b7ef-bc7b9eaf06ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '213254baf17a4d669ac07870622c59bf'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:16.701969 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-545e5b4a-3a44-4364-b7ef-bc7b9eaf06ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '213254baf17a4d669ac07870622c59bf'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:16.702661 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-545e5b4a-3a44-4364-b7ef-bc7b9eaf06ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '213254baf17a4d669ac07870622c59bf'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:16.709881 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-545e5b4a-3a44-4364-b7ef-bc7b9eaf06ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '213254baf17a4d669ac07870622c59bf'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:16.715714 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1363/2742] 10.222.0.70 () {58 vars in 1223 bytes} [Tue May 10 19:29:16 2022] DELETE /identity/v3/users/213254baf17a4d669ac07870622c59bf => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:29:16.975344 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829ca4b6-7638-46bd-bd54-397903e1abd1 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:16.976838 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-829ca4b6-7638-46bd-bd54-397903e1abd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:29:16.990214 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829ca4b6-7638-46bd-bd54-397903e1abd1 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:17.045732 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5301608-567c-4515-aa5d-1eddcbd3ea99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:17.046583 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5301608-567c-4515-aa5d-1eddcbd3ea99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:17.046857 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5301608-567c-4515-aa5d-1eddcbd3ea99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:17.047120 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5301608-567c-4515-aa5d-1eddcbd3ea99 admin admin] PATH_INFO: `/v3/projects/808318cafe9e4ba38108018f93fc397e` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:17.048281 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5301608-567c-4515-aa5d-1eddcbd3ea99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=808318cafe9e4ba38108018f93fc397e)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:17.050229 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5301608-567c-4515-aa5d-1eddcbd3ea99 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:17.093347 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-d5301608-567c-4515-aa5d-1eddcbd3ea99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '808318cafe9e4ba38108018f93fc397e', 'request_id': 'req-d5301608-567c-4515-aa5d-1eddcbd3ea99'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:17.098503 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-d5301608-567c-4515-aa5d-1eddcbd3ea99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '808318cafe9e4ba38108018f93fc397e', 'request_id': 'req-d5301608-567c-4515-aa5d-1eddcbd3ea99'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:17.106065 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-d5301608-567c-4515-aa5d-1eddcbd3ea99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '808318cafe9e4ba38108018f93fc397e', 'request_id': 'req-d5301608-567c-4515-aa5d-1eddcbd3ea99'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:17.116893 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-d5301608-567c-4515-aa5d-1eddcbd3ea99 admin admin] The token cache is being invalidate because project 808318cafe9e4ba38108018f93fc397e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79994) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:29:17.117177 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-d5301608-567c-4515-aa5d-1eddcbd3ea99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:17.117862 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-d5301608-567c-4515-aa5d-1eddcbd3ea99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:17.119986 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1380/2743] 10.222.0.70 () {58 vars in 1232 bytes} [Tue May 10 19:29:16 2022] DELETE /identity/v3/projects/808318cafe9e4ba38108018f93fc397e => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:29:17.124934 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2312cd04-5301-4726-ad40-3b2cd4cc7e5f None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:17.125388 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2312cd04-5301-4726-ad40-3b2cd4cc7e5f None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:17.125518 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2312cd04-5301-4726-ad40-3b2cd4cc7e5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:17.142842 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-2312cd04-5301-4726-ad40-3b2cd4cc7e5f None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:29:17.144143 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-2312cd04-5301-4726-ad40-3b2cd4cc7e5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:29:17.203684 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1364/2744] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:29:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:29:17.211837 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b334d7-6fd6-4f21-a88d-056663638189 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:17.212130 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b334d7-6fd6-4f21-a88d-056663638189 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:17.212410 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b334d7-6fd6-4f21-a88d-056663638189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:17.232241 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-73b334d7-6fd6-4f21-a88d-056663638189 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:29:17.233690 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-73b334d7-6fd6-4f21-a88d-056663638189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:29:17.244448 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1381/2745] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:29:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:29:17.246790 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2312cd04-5301-4726-ad40-3b2cd4cc7e5f None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:17.257717 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2312cd04-5301-4726-ad40-3b2cd4cc7e5f None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:17.262837 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2370c5eb-264a-43e7-82b5-8fea04945b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:17.263489 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2370c5eb-264a-43e7-82b5-8fea04945b0b admin admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:17.263775 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2370c5eb-264a-43e7-82b5-8fea04945b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:17.264051 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2370c5eb-264a-43e7-82b5-8fea04945b0b admin admin] PATH_INFO: `/v3/domains` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:17.264823 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2370c5eb-264a-43e7-82b5-8fea04945b0b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:29:17.265133 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2370c5eb-264a-43e7-82b5-8fea04945b0b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:17.266742 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2370c5eb-264a-43e7-82b5-8fea04945b0b admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:17.278611 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1365/2746] 10.222.0.70 () {58 vars in 1152 bytes} [Tue May 10 19:29:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:29:17.282903 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b334d7-6fd6-4f21-a88d-056663638189 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:17.291934 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b334d7-6fd6-4f21-a88d-056663638189 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:17.296639 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f818a4af-f383-45d8-821a-d21ac6cf8f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:17.297280 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f818a4af-f383-45d8-821a-d21ac6cf8f4e admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:17.297559 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f818a4af-f383-45d8-821a-d21ac6cf8f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:17.297829 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f818a4af-f383-45d8-821a-d21ac6cf8f4e admin admin] PATH_INFO: `/v3/projects` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:17.298521 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f818a4af-f383-45d8-821a-d21ac6cf8f4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:17.300378 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f818a4af-f383-45d8-821a-d21ac6cf8f4e admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:17.330140 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1382/2747] 10.222.0.70 () {60 vars in 1152 bytes} [Tue May 10 19:29:17 2022] POST /identity/v3/projects => generated 389 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:29:17.331057 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2370c5eb-264a-43e7-82b5-8fea04945b0b admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:17.340958 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2370c5eb-264a-43e7-82b5-8fea04945b0b admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:17.396948 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ce24a2-2e64-476b-8e52-c60870bf19dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:17.397752 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ce24a2-2e64-476b-8e52-c60870bf19dc admin admin] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:17.398061 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ce24a2-2e64-476b-8e52-c60870bf19dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:17.398340 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ce24a2-2e64-476b-8e52-c60870bf19dc admin admin] PATH_INFO: `/v3/users` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:17.399025 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ce24a2-2e64-476b-8e52-c60870bf19dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:17.401021 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ce24a2-2e64-476b-8e52-c60870bf19dc admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:17.425858 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1366/2748] 10.222.0.70 () {60 vars in 1143 bytes} [Tue May 10 19:29:17 2022] POST /identity/v3/users => generated 295 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:29:17.431434 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f818a4af-f383-45d8-821a-d21ac6cf8f4e admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:17.441987 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f818a4af-f383-45d8-821a-d21ac6cf8f4e admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:17.447866 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999eab7b-52ac-4411-b020-429155b2732c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:17.448559 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999eab7b-52ac-4411-b020-429155b2732c admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:17.448842 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999eab7b-52ac-4411-b020-429155b2732c admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:17.449116 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999eab7b-52ac-4411-b020-429155b2732c admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:17.449839 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999eab7b-52ac-4411-b020-429155b2732c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:17.451450 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999eab7b-52ac-4411-b020-429155b2732c admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:17.462202 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1383/2749] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:29:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:29:17.465933 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ce24a2-2e64-476b-8e52-c60870bf19dc admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:17.475571 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ce24a2-2e64-476b-8e52-c60870bf19dc admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:17.483706 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c110481-10cb-48cb-9d88-45187eecd3ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:17.484398 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c110481-10cb-48cb-9d88-45187eecd3ec admin admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:17.484676 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c110481-10cb-48cb-9d88-45187eecd3ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:17.484955 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c110481-10cb-48cb-9d88-45187eecd3ec admin admin] PATH_INFO: `/v3/roles` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:17.485681 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c110481-10cb-48cb-9d88-45187eecd3ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:17.487359 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c110481-10cb-48cb-9d88-45187eecd3ec admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:17.498725 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1367/2750] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:29:17 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:29:17.502959 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999eab7b-52ac-4411-b020-429155b2732c admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:17.513515 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999eab7b-52ac-4411-b020-429155b2732c admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:17.518236 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b66918-68aa-4da2-af2c-b61d42bf4cb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:17.519111 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b66918-68aa-4da2-af2c-b61d42bf4cb3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:17.519392 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b66918-68aa-4da2-af2c-b61d42bf4cb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:17.519663 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b66918-68aa-4da2-af2c-b61d42bf4cb3 admin admin] PATH_INFO: `/v3/projects/eaf1c53d51cb427fa48f51e7e8f0a581/users/28e52019324f49ad95f780d9e105a071/roles/5c07cf5bfbd3427db18428aa50420962` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:17.533755 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b66918-68aa-4da2-af2c-b61d42bf4cb3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eaf1c53d51cb427fa48f51e7e8f0a581, user_id=28e52019324f49ad95f780d9e105a071, role_id=5c07cf5bfbd3427db18428aa50420962)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:17.536388 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b66918-68aa-4da2-af2c-b61d42bf4cb3 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:17.549941 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1384/2751] 10.222.0.70 () {60 vars in 1482 bytes} [Tue May 10 19:29:17 2022] PUT /identity/v3/projects/eaf1c53d51cb427fa48f51e7e8f0a581/users/28e52019324f49ad95f780d9e105a071/roles/5c07cf5bfbd3427db18428aa50420962 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:29:17.560959 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ed409b-3313-40c1-aecb-374ea01788fc None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:17.561246 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ed409b-3313-40c1-aecb-374ea01788fc None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:17.561523 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ed409b-3313-40c1-aecb-374ea01788fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:17.586905 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-d1ed409b-3313-40c1-aecb-374ea01788fc None None] MFA Rules not processed for user `28e52019324f49ad95f780d9e105a071`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:29:17.588083 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-d1ed409b-3313-40c1-aecb-374ea01788fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:29:17.656087 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1368/2752] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:29:17 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:29:17.660679 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b66918-68aa-4da2-af2c-b61d42bf4cb3 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:17.731227 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b66918-68aa-4da2-af2c-b61d42bf4cb3 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:17.736765 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51592ac9-b34a-4215-9279-e63535f129c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:17.737871 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51592ac9-b34a-4215-9279-e63535f129c0 admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:17.738401 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51592ac9-b34a-4215-9279-e63535f129c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:17.738742 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51592ac9-b34a-4215-9279-e63535f129c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:17.739640 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51592ac9-b34a-4215-9279-e63535f129c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:17.742756 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51592ac9-b34a-4215-9279-e63535f129c0 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:17.784168 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1385/2753] 10.222.0.70 () {60 vars in 1152 bytes} [Tue May 10 19:29:17 2022] POST /identity/v3/projects => generated 389 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:29:17.785347 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ed409b-3313-40c1-aecb-374ea01788fc None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:17.798652 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ed409b-3313-40c1-aecb-374ea01788fc None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:17.855964 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db7748f-cacf-4c31-919b-bd21b1c17cba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:17.856677 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db7748f-cacf-4c31-919b-bd21b1c17cba admin admin] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:17.856968 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db7748f-cacf-4c31-919b-bd21b1c17cba admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:17.857242 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db7748f-cacf-4c31-919b-bd21b1c17cba admin admin] PATH_INFO: `/v3/users` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:17.857924 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db7748f-cacf-4c31-919b-bd21b1c17cba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:17.859850 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db7748f-cacf-4c31-919b-bd21b1c17cba admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:17.878703 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1369/2754] 10.222.0.70 () {60 vars in 1143 bytes} [Tue May 10 19:29:17 2022] POST /identity/v3/users => generated 301 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 19:29:17.882789 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51592ac9-b34a-4215-9279-e63535f129c0 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:17.892972 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51592ac9-b34a-4215-9279-e63535f129c0 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:17.897599 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335b7860-7929-4ce5-9fdf-5d504405c5ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:17.898249 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335b7860-7929-4ce5-9fdf-5d504405c5ca admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:17.898534 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335b7860-7929-4ce5-9fdf-5d504405c5ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:17.898812 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335b7860-7929-4ce5-9fdf-5d504405c5ca admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:17.899555 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335b7860-7929-4ce5-9fdf-5d504405c5ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:17.901184 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335b7860-7929-4ce5-9fdf-5d504405c5ca admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:17.911264 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1386/2755] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:29:17 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:29:17.915598 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db7748f-cacf-4c31-919b-bd21b1c17cba admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:17.925222 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db7748f-cacf-4c31-919b-bd21b1c17cba admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:17.929769 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0a2a7e-41c7-4b38-afee-27e942a5d27d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:17.931292 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0a2a7e-41c7-4b38-afee-27e942a5d27d admin admin] REQUEST_METHOD: `PUT` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:17.931571 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0a2a7e-41c7-4b38-afee-27e942a5d27d admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:17.931844 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0a2a7e-41c7-4b38-afee-27e942a5d27d admin admin] PATH_INFO: `/v3/projects/256d97edc1cf4b2092fc7054cb643544/users/9f0a7b598dfd47898489401bf0b78b78/roles/634ba284303b4626b5a0402772c68f5c` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:17.946497 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0a2a7e-41c7-4b38-afee-27e942a5d27d admin admin] RBAC: Authorizing `identity:create_grant(project_id=256d97edc1cf4b2092fc7054cb643544, user_id=9f0a7b598dfd47898489401bf0b78b78, role_id=634ba284303b4626b5a0402772c68f5c)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:17.949197 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0a2a7e-41c7-4b38-afee-27e942a5d27d admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:17.961566 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1370/2756] 10.222.0.70 () {60 vars in 1482 bytes} [Tue May 10 19:29:17 2022] PUT /identity/v3/projects/256d97edc1cf4b2092fc7054cb643544/users/9f0a7b598dfd47898489401bf0b78b78/roles/634ba284303b4626b5a0402772c68f5c => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:29:17.965523 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335b7860-7929-4ce5-9fdf-5d504405c5ca admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:17.975782 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335b7860-7929-4ce5-9fdf-5d504405c5ca admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:18.035373 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985fae15-b0a1-42eb-a618-f87a1dd12749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:18.036136 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985fae15-b0a1-42eb-a618-f87a1dd12749 admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:18.036747 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985fae15-b0a1-42eb-a618-f87a1dd12749 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:18.037237 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985fae15-b0a1-42eb-a618-f87a1dd12749 admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:18.038026 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985fae15-b0a1-42eb-a618-f87a1dd12749 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:18.039678 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985fae15-b0a1-42eb-a618-f87a1dd12749 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:18.053012 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1387/2757] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:29:17 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:29:18.057539 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0a2a7e-41c7-4b38-afee-27e942a5d27d admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:18.068266 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0a2a7e-41c7-4b38-afee-27e942a5d27d admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:18.073072 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11350e40-4ac6-41d7-96bb-6de16b2f1226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:18.073957 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11350e40-4ac6-41d7-96bb-6de16b2f1226 admin admin] REQUEST_METHOD: `PUT` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:18.074243 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11350e40-4ac6-41d7-96bb-6de16b2f1226 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:18.074521 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11350e40-4ac6-41d7-96bb-6de16b2f1226 admin admin] PATH_INFO: `/v3/projects/256d97edc1cf4b2092fc7054cb643544/users/9f0a7b598dfd47898489401bf0b78b78/roles/634ba284303b4626b5a0402772c68f5c` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:18.076507 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11350e40-4ac6-41d7-96bb-6de16b2f1226 admin admin] RBAC: Authorizing `identity:create_grant(project_id=256d97edc1cf4b2092fc7054cb643544, user_id=9f0a7b598dfd47898489401bf0b78b78, role_id=634ba284303b4626b5a0402772c68f5c)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:18.080986 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11350e40-4ac6-41d7-96bb-6de16b2f1226 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:18.090214 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1371/2758] 10.222.0.70 () {60 vars in 1482 bytes} [Tue May 10 19:29:18 2022] PUT /identity/v3/projects/256d97edc1cf4b2092fc7054cb643544/users/9f0a7b598dfd47898489401bf0b78b78/roles/634ba284303b4626b5a0402772c68f5c => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:29:18.101493 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf679ae5-824e-4e33-a3f8-755677fcd370 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:18.102027 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf679ae5-824e-4e33-a3f8-755677fcd370 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:18.103054 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf679ae5-824e-4e33-a3f8-755677fcd370 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:18.128878 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-bf679ae5-824e-4e33-a3f8-755677fcd370 None None] MFA Rules not processed for user `9f0a7b598dfd47898489401bf0b78b78`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:29:18.130341 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-bf679ae5-824e-4e33-a3f8-755677fcd370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:29:18.196548 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1388/2759] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:29:18 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:29:18.207533 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11350e40-4ac6-41d7-96bb-6de16b2f1226 admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:18.209845 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-11350e40-4ac6-41d7-96bb-6de16b2f1226 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:29:18.267605 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11350e40-4ac6-41d7-96bb-6de16b2f1226 admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:18.271302 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59602faa-4eaa-4b09-9abf-4485fe31e3a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15df2a8967aa43299c10e365f4200d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:18.271951 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59602faa-4eaa-4b09-9abf-4485fe31e3a9 service cinder] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:18.272234 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59602faa-4eaa-4b09-9abf-4485fe31e3a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:18.272546 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59602faa-4eaa-4b09-9abf-4485fe31e3a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:18.283641 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59602faa-4eaa-4b09-9abf-4485fe31e3a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:18.283917 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59602faa-4eaa-4b09-9abf-4485fe31e3a9 service cinder] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:18.284786 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf679ae5-824e-4e33-a3f8-755677fcd370 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:18.286206 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-bf679ae5-824e-4e33-a3f8-755677fcd370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:29:18.294158 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1372/2760] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:29:18 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:29:18.351425 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf679ae5-824e-4e33-a3f8-755677fcd370 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:18.356762 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9f77fb-45ec-45cd-ad1f-a17384502c9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:18.357638 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9f77fb-45ec-45cd-ad1f-a17384502c9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:18.357922 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9f77fb-45ec-45cd-ad1f-a17384502c9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:18.358301 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9f77fb-45ec-45cd-ad1f-a17384502c9f admin admin] PATH_INFO: `/v3/users/73e514644a8a421ab7b5388babac2850` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:18.359390 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9f77fb-45ec-45cd-ad1f-a17384502c9f admin admin] RBAC: Authorizing `identity:delete_user(user_id=73e514644a8a421ab7b5388babac2850)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:18.361333 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9f77fb-45ec-45cd-ad1f-a17384502c9f admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:18.409081 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-db9f77fb-45ec-45cd-ad1f-a17384502c9f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73e514644a8a421ab7b5388babac2850'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:18.422176 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-db9f77fb-45ec-45cd-ad1f-a17384502c9f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73e514644a8a421ab7b5388babac2850'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:18.422948 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-db9f77fb-45ec-45cd-ad1f-a17384502c9f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73e514644a8a421ab7b5388babac2850'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:18.423671 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59602faa-4eaa-4b09-9abf-4485fe31e3a9 service cinder] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:18.430792 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-db9f77fb-45ec-45cd-ad1f-a17384502c9f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73e514644a8a421ab7b5388babac2850'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:18.435197 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59602faa-4eaa-4b09-9abf-4485fe31e3a9 service cinder] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:18.437497 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-db9f77fb-45ec-45cd-ad1f-a17384502c9f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73e514644a8a421ab7b5388babac2850'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:18.440095 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c076d2-ab38-4e1a-a1d1-218d509fb3d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:18.441132 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c076d2-ab38-4e1a-a1d1-218d509fb3d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:18.441445 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c076d2-ab38-4e1a-a1d1-218d509fb3d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:18.441860 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c076d2-ab38-4e1a-a1d1-218d509fb3d1 admin admin] PATH_INFO: `/v3/users/28e52019324f49ad95f780d9e105a071` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:18.443510 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c076d2-ab38-4e1a-a1d1-218d509fb3d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=28e52019324f49ad95f780d9e105a071)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:18.443714 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1389/2761] 10.222.0.70 () {58 vars in 1223 bytes} [Tue May 10 19:29:18 2022] DELETE /identity/v3/users/73e514644a8a421ab7b5388babac2850 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:29:18.445484 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c076d2-ab38-4e1a-a1d1-218d509fb3d1 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:18.448597 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0255d0-db51-47b7-9be8-14cbbc75da95 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:18.448928 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0255d0-db51-47b7-9be8-14cbbc75da95 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:18.449204 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0255d0-db51-47b7-9be8-14cbbc75da95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:18.466483 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-6b0255d0-db51-47b7-9be8-14cbbc75da95 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:29:18.467847 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-6b0255d0-db51-47b7-9be8-14cbbc75da95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:29:18.490821 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-d5c076d2-ab38-4e1a-a1d1-218d509fb3d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28e52019324f49ad95f780d9e105a071'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:18.502610 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-d5c076d2-ab38-4e1a-a1d1-218d509fb3d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28e52019324f49ad95f780d9e105a071'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:18.509816 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-d5c076d2-ab38-4e1a-a1d1-218d509fb3d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28e52019324f49ad95f780d9e105a071'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:18.510514 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-d5c076d2-ab38-4e1a-a1d1-218d509fb3d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28e52019324f49ad95f780d9e105a071'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:18.517908 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-d5c076d2-ab38-4e1a-a1d1-218d509fb3d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28e52019324f49ad95f780d9e105a071'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:18.523908 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1373/2762] 10.222.0.70 () {58 vars in 1223 bytes} [Tue May 10 19:29:18 2022] DELETE /identity/v3/users/28e52019324f49ad95f780d9e105a071 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:29:18.525755 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1390/2763] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:29:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:29:18.530206 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc3304c-f0d6-42bc-93a0-47bfe5609719 None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:18.530502 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc3304c-f0d6-42bc-93a0-47bfe5609719 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:18.530786 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc3304c-f0d6-42bc-93a0-47bfe5609719 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:18.535354 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0255d0-db51-47b7-9be8-14cbbc75da95 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:18.536691 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-6b0255d0-db51-47b7-9be8-14cbbc75da95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:29:18.547918 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-efc3304c-f0d6-42bc-93a0-47bfe5609719 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:29:18.549129 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-efc3304c-f0d6-42bc-93a0-47bfe5609719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:29:18.592386 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0255d0-db51-47b7-9be8-14cbbc75da95 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:18.605898 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1374/2764] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:29:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:29:18.615342 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc3304c-f0d6-42bc-93a0-47bfe5609719 None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:18.639406 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34124bb5-8b7a-4968-8023-a83983a831a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f1dc79540b48c0866478cc48cd8205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:18.640176 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34124bb5-8b7a-4968-8023-a83983a831a2 service neutron] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:18.640497 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34124bb5-8b7a-4968-8023-a83983a831a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:18.640806 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34124bb5-8b7a-4968-8023-a83983a831a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:18.650365 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34124bb5-8b7a-4968-8023-a83983a831a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:18.651821 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34124bb5-8b7a-4968-8023-a83983a831a2 service neutron] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:18.661894 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1391/2765] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:29:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 19:29:18.668983 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc3304c-f0d6-42bc-93a0-47bfe5609719 None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:18.672652 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2249c6-b87f-4300-8d90-ab282243f442 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f1dc79540b48c0866478cc48cd8205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:18.673326 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2249c6-b87f-4300-8d90-ab282243f442 service neutron] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:18.673609 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2249c6-b87f-4300-8d90-ab282243f442 service neutron] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:18.673880 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2249c6-b87f-4300-8d90-ab282243f442 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:18.683254 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2249c6-b87f-4300-8d90-ab282243f442 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:18.684724 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2249c6-b87f-4300-8d90-ab282243f442 service neutron] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:18.695831 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1375/2766] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:29:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 19:29:19.111881 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34124bb5-8b7a-4968-8023-a83983a831a2 service neutron] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:19.115592 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-34124bb5-8b7a-4968-8023-a83983a831a2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:29:19.146728 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34124bb5-8b7a-4968-8023-a83983a831a2 service neutron] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:19.154765 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db8087a-03ba-4a9c-9c3d-15afa872b04b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:19.156260 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db8087a-03ba-4a9c-9c3d-15afa872b04b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:19.156961 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db8087a-03ba-4a9c-9c3d-15afa872b04b admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:19.157939 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db8087a-03ba-4a9c-9c3d-15afa872b04b admin admin] PATH_INFO: `/v3/projects/83c453b6f1684a95a669ce73001ba24b` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:19.159374 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db8087a-03ba-4a9c-9c3d-15afa872b04b admin admin] RBAC: Authorizing `identity:delete_project(project_id=83c453b6f1684a95a669ce73001ba24b)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:19.161720 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db8087a-03ba-4a9c-9c3d-15afa872b04b admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:19.212355 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2249c6-b87f-4300-8d90-ab282243f442 service neutron] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:19.213853 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-6b2249c6-b87f-4300-8d90-ab282243f442 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:29:19.232706 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2249c6-b87f-4300-8d90-ab282243f442 service neutron] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:19.249852 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-6db8087a-03ba-4a9c-9c3d-15afa872b04b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83c453b6f1684a95a669ce73001ba24b', 'request_id': 'req-6db8087a-03ba-4a9c-9c3d-15afa872b04b'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:19.256199 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-6db8087a-03ba-4a9c-9c3d-15afa872b04b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83c453b6f1684a95a669ce73001ba24b', 'request_id': 'req-6db8087a-03ba-4a9c-9c3d-15afa872b04b'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:19.269300 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-6db8087a-03ba-4a9c-9c3d-15afa872b04b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83c453b6f1684a95a669ce73001ba24b', 'request_id': 'req-6db8087a-03ba-4a9c-9c3d-15afa872b04b'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:19.281807 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-6db8087a-03ba-4a9c-9c3d-15afa872b04b admin admin] The token cache is being invalidate because project 83c453b6f1684a95a669ce73001ba24b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79994) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:29:19.282253 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-6db8087a-03ba-4a9c-9c3d-15afa872b04b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:19.283113 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-6db8087a-03ba-4a9c-9c3d-15afa872b04b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:19.292522 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1392/2767] 10.222.0.70 () {58 vars in 1232 bytes} [Tue May 10 19:29:19 2022] DELETE /identity/v3/projects/83c453b6f1684a95a669ce73001ba24b => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 19:29:19.306836 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3393c057-5dbb-4c44-8230-f35b108d9081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:19.307481 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3393c057-5dbb-4c44-8230-f35b108d9081 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:19.307767 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3393c057-5dbb-4c44-8230-f35b108d9081 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:19.308041 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3393c057-5dbb-4c44-8230-f35b108d9081 admin admin] PATH_INFO: `/v3/projects/eaf1c53d51cb427fa48f51e7e8f0a581` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:19.309632 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3393c057-5dbb-4c44-8230-f35b108d9081 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eaf1c53d51cb427fa48f51e7e8f0a581)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:19.311600 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3393c057-5dbb-4c44-8230-f35b108d9081 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:19.372012 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-3393c057-5dbb-4c44-8230-f35b108d9081 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eaf1c53d51cb427fa48f51e7e8f0a581', 'request_id': 'req-3393c057-5dbb-4c44-8230-f35b108d9081'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:19.378212 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-3393c057-5dbb-4c44-8230-f35b108d9081 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eaf1c53d51cb427fa48f51e7e8f0a581', 'request_id': 'req-3393c057-5dbb-4c44-8230-f35b108d9081'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:19.388183 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-3393c057-5dbb-4c44-8230-f35b108d9081 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eaf1c53d51cb427fa48f51e7e8f0a581', 'request_id': 'req-3393c057-5dbb-4c44-8230-f35b108d9081'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:19.401087 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-3393c057-5dbb-4c44-8230-f35b108d9081 admin admin] The token cache is being invalidate because project eaf1c53d51cb427fa48f51e7e8f0a581 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79993) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:29:19.401525 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-3393c057-5dbb-4c44-8230-f35b108d9081 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:19.402199 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-3393c057-5dbb-4c44-8230-f35b108d9081 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:19.403773 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1376/2768] 10.222.0.70 () {58 vars in 1232 bytes} [Tue May 10 19:29:19 2022] DELETE /identity/v3/projects/eaf1c53d51cb427fa48f51e7e8f0a581 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 19:29:19.408055 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db8087a-03ba-4a9c-9c3d-15afa872b04b admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:19.409580 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-6db8087a-03ba-4a9c-9c3d-15afa872b04b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:29:19.423706 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db8087a-03ba-4a9c-9c3d-15afa872b04b admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:19.500967 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ec3fa0-3131-4448-8eb6-6b3493a636c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:19.501869 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ec3fa0-3131-4448-8eb6-6b3493a636c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:19.502151 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ec3fa0-3131-4448-8eb6-6b3493a636c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:19.502438 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ec3fa0-3131-4448-8eb6-6b3493a636c5 admin admin] PATH_INFO: `/v3/users/9f0a7b598dfd47898489401bf0b78b78` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:19.503703 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ec3fa0-3131-4448-8eb6-6b3493a636c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f0a7b598dfd47898489401bf0b78b78)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:19.505711 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ec3fa0-3131-4448-8eb6-6b3493a636c5 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:19.563835 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-14ec3fa0-3131-4448-8eb6-6b3493a636c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f0a7b598dfd47898489401bf0b78b78'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:19.575585 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-14ec3fa0-3131-4448-8eb6-6b3493a636c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f0a7b598dfd47898489401bf0b78b78'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:19.576383 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-14ec3fa0-3131-4448-8eb6-6b3493a636c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f0a7b598dfd47898489401bf0b78b78'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:19.584105 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-14ec3fa0-3131-4448-8eb6-6b3493a636c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f0a7b598dfd47898489401bf0b78b78'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:19.591299 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-14ec3fa0-3131-4448-8eb6-6b3493a636c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f0a7b598dfd47898489401bf0b78b78'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:19.597578 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1393/2769] 10.222.0.70 () {58 vars in 1223 bytes} [Tue May 10 19:29:19 2022] DELETE /identity/v3/users/9f0a7b598dfd47898489401bf0b78b78 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 19:29:19.866145 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3393c057-5dbb-4c44-8230-f35b108d9081 admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:19.867601 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-3393c057-5dbb-4c44-8230-f35b108d9081 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:29:19.883747 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3393c057-5dbb-4c44-8230-f35b108d9081 admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:19.938592 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4889d6c5-8d87-48d5-a43e-c46ca4be4d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:19.939454 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4889d6c5-8d87-48d5-a43e-c46ca4be4d0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:19.939756 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4889d6c5-8d87-48d5-a43e-c46ca4be4d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:19.940028 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4889d6c5-8d87-48d5-a43e-c46ca4be4d0e admin admin] PATH_INFO: `/v3/projects/256d97edc1cf4b2092fc7054cb643544` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:19.941309 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4889d6c5-8d87-48d5-a43e-c46ca4be4d0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=256d97edc1cf4b2092fc7054cb643544)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:19.943509 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4889d6c5-8d87-48d5-a43e-c46ca4be4d0e admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:19.987907 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-4889d6c5-8d87-48d5-a43e-c46ca4be4d0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '256d97edc1cf4b2092fc7054cb643544', 'request_id': 'req-4889d6c5-8d87-48d5-a43e-c46ca4be4d0e'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:19.993429 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-4889d6c5-8d87-48d5-a43e-c46ca4be4d0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '256d97edc1cf4b2092fc7054cb643544', 'request_id': 'req-4889d6c5-8d87-48d5-a43e-c46ca4be4d0e'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:20.000196 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-4889d6c5-8d87-48d5-a43e-c46ca4be4d0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '256d97edc1cf4b2092fc7054cb643544', 'request_id': 'req-4889d6c5-8d87-48d5-a43e-c46ca4be4d0e'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:20.011315 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-4889d6c5-8d87-48d5-a43e-c46ca4be4d0e admin admin] The token cache is being invalidate because project 256d97edc1cf4b2092fc7054cb643544 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79993) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:29:20.011593 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-4889d6c5-8d87-48d5-a43e-c46ca4be4d0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:20.012211 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-4889d6c5-8d87-48d5-a43e-c46ca4be4d0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:20.013755 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1377/2770] 10.222.0.70 () {58 vars in 1232 bytes} [Tue May 10 19:29:19 2022] DELETE /identity/v3/projects/256d97edc1cf4b2092fc7054cb643544 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:29:20.018672 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca1f7fa-0031-4cd9-91d1-8a9b5c052b02 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:20.018954 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca1f7fa-0031-4cd9-91d1-8a9b5c052b02 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:20.019265 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca1f7fa-0031-4cd9-91d1-8a9b5c052b02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:20.036676 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-3ca1f7fa-0031-4cd9-91d1-8a9b5c052b02 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:29:20.037853 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-3ca1f7fa-0031-4cd9-91d1-8a9b5c052b02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:29:20.096182 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1394/2771] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:29:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:29:20.103645 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8662ff74-009a-43e3-bc24-4a9c86746348 None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:20.104019 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8662ff74-009a-43e3-bc24-4a9c86746348 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:20.104304 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8662ff74-009a-43e3-bc24-4a9c86746348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:20.122048 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-8662ff74-009a-43e3-bc24-4a9c86746348 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:29:20.123234 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-8662ff74-009a-43e3-bc24-4a9c86746348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:29:20.131004 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1378/2772] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:29:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:29:20.135576 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca1f7fa-0031-4cd9-91d1-8a9b5c052b02 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:20.144912 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca1f7fa-0031-4cd9-91d1-8a9b5c052b02 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:20.150320 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648d27d3-bcdf-411a-95da-c2bb4a2512b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:20.150971 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648d27d3-bcdf-411a-95da-c2bb4a2512b3 admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:20.151258 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648d27d3-bcdf-411a-95da-c2bb4a2512b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:20.151542 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648d27d3-bcdf-411a-95da-c2bb4a2512b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:20.152364 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648d27d3-bcdf-411a-95da-c2bb4a2512b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:29:20.152572 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648d27d3-bcdf-411a-95da-c2bb4a2512b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:20.154149 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648d27d3-bcdf-411a-95da-c2bb4a2512b3 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:20.165573 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1395/2773] 10.222.0.70 () {58 vars in 1152 bytes} [Tue May 10 19:29:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:29:20.169848 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8662ff74-009a-43e3-bc24-4a9c86746348 None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:20.179070 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8662ff74-009a-43e3-bc24-4a9c86746348 None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:20.183910 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c790c4-71d7-4e11-92bc-b3048431d7c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:20.184590 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c790c4-71d7-4e11-92bc-b3048431d7c7 admin admin] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:20.184873 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c790c4-71d7-4e11-92bc-b3048431d7c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:20.185148 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c790c4-71d7-4e11-92bc-b3048431d7c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:20.185842 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c790c4-71d7-4e11-92bc-b3048431d7c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:20.187724 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c790c4-71d7-4e11-92bc-b3048431d7c7 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:20.216906 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1379/2774] 10.222.0.70 () {60 vars in 1152 bytes} [Tue May 10 19:29:20 2022] POST /identity/v3/projects => generated 407 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:29:20.217997 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648d27d3-bcdf-411a-95da-c2bb4a2512b3 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:20.227856 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648d27d3-bcdf-411a-95da-c2bb4a2512b3 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:20.281456 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56037e34-05e0-4deb-afb2-4ec5b3381b88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:20.282125 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56037e34-05e0-4deb-afb2-4ec5b3381b88 admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:20.282402 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56037e34-05e0-4deb-afb2-4ec5b3381b88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:20.282671 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56037e34-05e0-4deb-afb2-4ec5b3381b88 admin admin] PATH_INFO: `/v3/users` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:20.283352 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56037e34-05e0-4deb-afb2-4ec5b3381b88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:20.285286 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56037e34-05e0-4deb-afb2-4ec5b3381b88 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:20.304291 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1396/2775] 10.222.0.70 () {60 vars in 1143 bytes} [Tue May 10 19:29:20 2022] POST /identity/v3/users => generated 304 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:29:20.308763 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c790c4-71d7-4e11-92bc-b3048431d7c7 admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:20.318938 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c790c4-71d7-4e11-92bc-b3048431d7c7 admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:20.324038 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1c2508-a86d-4650-8f40-59d94bc65812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:20.324719 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1c2508-a86d-4650-8f40-59d94bc65812 admin admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:20.325001 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1c2508-a86d-4650-8f40-59d94bc65812 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:20.325284 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1c2508-a86d-4650-8f40-59d94bc65812 admin admin] PATH_INFO: `/v3/roles` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:20.325994 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1c2508-a86d-4650-8f40-59d94bc65812 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:20.327567 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1c2508-a86d-4650-8f40-59d94bc65812 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:20.338433 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1380/2776] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:29:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:29:20.342188 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56037e34-05e0-4deb-afb2-4ec5b3381b88 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:20.352588 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56037e34-05e0-4deb-afb2-4ec5b3381b88 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:20.357269 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc69cf7-60c8-43f4-9fd6-3586fed96d9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:20.357920 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc69cf7-60c8-43f4-9fd6-3586fed96d9c admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:20.358201 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc69cf7-60c8-43f4-9fd6-3586fed96d9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:20.358475 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc69cf7-60c8-43f4-9fd6-3586fed96d9c admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:20.359187 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc69cf7-60c8-43f4-9fd6-3586fed96d9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:20.360841 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc69cf7-60c8-43f4-9fd6-3586fed96d9c admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:20.371820 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1397/2777] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:29:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 19:29:20.375850 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1c2508-a86d-4650-8f40-59d94bc65812 admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:20.386600 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1c2508-a86d-4650-8f40-59d94bc65812 admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:20.391243 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58291e8-805b-4b8a-8a3f-ab2d48b01d74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:20.392111 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58291e8-805b-4b8a-8a3f-ab2d48b01d74 admin admin] REQUEST_METHOD: `PUT` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:20.392391 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58291e8-805b-4b8a-8a3f-ab2d48b01d74 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:20.392699 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58291e8-805b-4b8a-8a3f-ab2d48b01d74 admin admin] PATH_INFO: `/v3/projects/76d668cabcdd4ed9afeddec02f1ab2eb/users/81e2d998651449a7b88794286c3b0e9b/roles/5c07cf5bfbd3427db18428aa50420962` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:20.406866 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58291e8-805b-4b8a-8a3f-ab2d48b01d74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76d668cabcdd4ed9afeddec02f1ab2eb, user_id=81e2d998651449a7b88794286c3b0e9b, role_id=5c07cf5bfbd3427db18428aa50420962)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:20.409618 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58291e8-805b-4b8a-8a3f-ab2d48b01d74 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:20.421757 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1381/2778] 10.222.0.70 () {60 vars in 1482 bytes} [Tue May 10 19:29:20 2022] PUT /identity/v3/projects/76d668cabcdd4ed9afeddec02f1ab2eb/users/81e2d998651449a7b88794286c3b0e9b/roles/5c07cf5bfbd3427db18428aa50420962 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:29:20.432684 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f53349-1a06-4b1f-9af4-4eecaceeb3ee None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:20.436918 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f53349-1a06-4b1f-9af4-4eecaceeb3ee None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:20.437461 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f53349-1a06-4b1f-9af4-4eecaceeb3ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:20.467190 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-a3f53349-1a06-4b1f-9af4-4eecaceeb3ee None None] MFA Rules not processed for user `81e2d998651449a7b88794286c3b0e9b`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:29:20.468557 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-a3f53349-1a06-4b1f-9af4-4eecaceeb3ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:29:20.534330 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1398/2779] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:29:20 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:29:20.538795 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58291e8-805b-4b8a-8a3f-ab2d48b01d74 admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:20.598082 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58291e8-805b-4b8a-8a3f-ab2d48b01d74 admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:20.603328 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930af999-75c0-4076-88eb-20d66bec39e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:20.603911 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930af999-75c0-4076-88eb-20d66bec39e1 admin admin] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:20.604191 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930af999-75c0-4076-88eb-20d66bec39e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:20.604488 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930af999-75c0-4076-88eb-20d66bec39e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:20.605159 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930af999-75c0-4076-88eb-20d66bec39e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:20.607032 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930af999-75c0-4076-88eb-20d66bec39e1 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:20.630811 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1382/2780] 10.222.0.70 () {60 vars in 1152 bytes} [Tue May 10 19:29:20 2022] POST /identity/v3/projects => generated 409 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:29:20.634864 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f53349-1a06-4b1f-9af4-4eecaceeb3ee None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:20.646477 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f53349-1a06-4b1f-9af4-4eecaceeb3ee None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:20.713590 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901bba7f-0b67-469d-842e-0944a451d7d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:20.714808 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901bba7f-0b67-469d-842e-0944a451d7d3 admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:20.715090 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901bba7f-0b67-469d-842e-0944a451d7d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:20.715364 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901bba7f-0b67-469d-842e-0944a451d7d3 admin admin] PATH_INFO: `/v3/users` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:20.716156 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901bba7f-0b67-469d-842e-0944a451d7d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:20.718105 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901bba7f-0b67-469d-842e-0944a451d7d3 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:20.739231 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1399/2781] 10.222.0.70 () {60 vars in 1143 bytes} [Tue May 10 19:29:20 2022] POST /identity/v3/users => generated 311 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 19:29:20.743048 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930af999-75c0-4076-88eb-20d66bec39e1 admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:20.753856 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930af999-75c0-4076-88eb-20d66bec39e1 admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:20.759027 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1012c5-6051-4d69-b7b7-01617f07df5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:20.759868 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1012c5-6051-4d69-b7b7-01617f07df5c admin admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:20.760201 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1012c5-6051-4d69-b7b7-01617f07df5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:20.760501 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1012c5-6051-4d69-b7b7-01617f07df5c admin admin] PATH_INFO: `/v3/roles` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:20.761215 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1012c5-6051-4d69-b7b7-01617f07df5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:20.762806 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1012c5-6051-4d69-b7b7-01617f07df5c admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:20.773652 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1383/2782] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:29:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:29:20.778283 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901bba7f-0b67-469d-842e-0944a451d7d3 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:20.788548 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901bba7f-0b67-469d-842e-0944a451d7d3 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:20.793261 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af59adf-3e9a-4395-833a-038bc3047771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:20.794143 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af59adf-3e9a-4395-833a-038bc3047771 admin admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:20.794429 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af59adf-3e9a-4395-833a-038bc3047771 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:20.794703 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af59adf-3e9a-4395-833a-038bc3047771 admin admin] PATH_INFO: `/v3/projects/4d7d3c5122ed45ee87231c465cb7fd71/users/bb43b38027924c838ad8613e917083ab/roles/634ba284303b4626b5a0402772c68f5c` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:20.810985 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af59adf-3e9a-4395-833a-038bc3047771 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d7d3c5122ed45ee87231c465cb7fd71, user_id=bb43b38027924c838ad8613e917083ab, role_id=634ba284303b4626b5a0402772c68f5c)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:20.813676 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af59adf-3e9a-4395-833a-038bc3047771 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:20.827880 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1400/2783] 10.222.0.70 () {60 vars in 1482 bytes} [Tue May 10 19:29:20 2022] PUT /identity/v3/projects/4d7d3c5122ed45ee87231c465cb7fd71/users/bb43b38027924c838ad8613e917083ab/roles/634ba284303b4626b5a0402772c68f5c => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:29:20.831892 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1012c5-6051-4d69-b7b7-01617f07df5c admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:20.842930 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1012c5-6051-4d69-b7b7-01617f07df5c admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:20.898470 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3963eed-039d-4234-be78-092e25e6af48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:20.899692 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3963eed-039d-4234-be78-092e25e6af48 admin admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:20.899986 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3963eed-039d-4234-be78-092e25e6af48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:20.900264 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3963eed-039d-4234-be78-092e25e6af48 admin admin] PATH_INFO: `/v3/roles` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:20.901032 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3963eed-039d-4234-be78-092e25e6af48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:20.902672 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3963eed-039d-4234-be78-092e25e6af48 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:20.912437 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1384/2784] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:29:20 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:29:20.916476 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af59adf-3e9a-4395-833a-038bc3047771 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:20.926355 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af59adf-3e9a-4395-833a-038bc3047771 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:20.930881 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4325183-7337-4302-91d2-4fd047c8d547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:20.931754 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4325183-7337-4302-91d2-4fd047c8d547 admin admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:20.932030 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4325183-7337-4302-91d2-4fd047c8d547 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:20.932295 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4325183-7337-4302-91d2-4fd047c8d547 admin admin] PATH_INFO: `/v3/projects/4d7d3c5122ed45ee87231c465cb7fd71/users/bb43b38027924c838ad8613e917083ab/roles/634ba284303b4626b5a0402772c68f5c` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:20.934247 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4325183-7337-4302-91d2-4fd047c8d547 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d7d3c5122ed45ee87231c465cb7fd71, user_id=bb43b38027924c838ad8613e917083ab, role_id=634ba284303b4626b5a0402772c68f5c)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:20.936875 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4325183-7337-4302-91d2-4fd047c8d547 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:20.948976 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1401/2785] 10.222.0.70 () {60 vars in 1482 bytes} [Tue May 10 19:29:20 2022] PUT /identity/v3/projects/4d7d3c5122ed45ee87231c465cb7fd71/users/bb43b38027924c838ad8613e917083ab/roles/634ba284303b4626b5a0402772c68f5c => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:29:20.959978 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6f52e5-e6a4-4859-88e8-a6b883bdbca9 None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:20.960369 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6f52e5-e6a4-4859-88e8-a6b883bdbca9 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:20.960749 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6f52e5-e6a4-4859-88e8-a6b883bdbca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:20.990128 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-9a6f52e5-e6a4-4859-88e8-a6b883bdbca9 None None] MFA Rules not processed for user `bb43b38027924c838ad8613e917083ab`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:29:20.991337 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-9a6f52e5-e6a4-4859-88e8-a6b883bdbca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:29:21.062967 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1385/2786] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:29:20 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:29:21.074891 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4325183-7337-4302-91d2-4fd047c8d547 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:21.076886 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-e4325183-7337-4302-91d2-4fd047c8d547 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:29:21.138347 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4325183-7337-4302-91d2-4fd047c8d547 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:21.142179 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990b43f9-cfd5-4484-98bc-fc7f626256c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15df2a8967aa43299c10e365f4200d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:21.142833 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990b43f9-cfd5-4484-98bc-fc7f626256c1 service cinder] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:21.143120 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990b43f9-cfd5-4484-98bc-fc7f626256c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:21.143400 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990b43f9-cfd5-4484-98bc-fc7f626256c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:21.155647 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990b43f9-cfd5-4484-98bc-fc7f626256c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:21.157309 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990b43f9-cfd5-4484-98bc-fc7f626256c1 service cinder] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:21.167829 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1402/2787] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:29:21 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:29:21.331386 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6f52e5-e6a4-4859-88e8-a6b883bdbca9 None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:21.341028 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6f52e5-e6a4-4859-88e8-a6b883bdbca9 None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:21.344617 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616c6c3d-088a-44b8-aaf6-53848344d9b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15df2a8967aa43299c10e365f4200d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:21.345296 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616c6c3d-088a-44b8-aaf6-53848344d9b8 service cinder] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:21.345620 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616c6c3d-088a-44b8-aaf6-53848344d9b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:21.345900 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616c6c3d-088a-44b8-aaf6-53848344d9b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:21.418135 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616c6c3d-088a-44b8-aaf6-53848344d9b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:21.420148 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616c6c3d-088a-44b8-aaf6-53848344d9b8 service cinder] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:21.432697 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1386/2788] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:29:21 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:29:21.858058 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990b43f9-cfd5-4484-98bc-fc7f626256c1 service cinder] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:21.859511 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-990b43f9-cfd5-4484-98bc-fc7f626256c1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:29:21.922106 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990b43f9-cfd5-4484-98bc-fc7f626256c1 service cinder] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:21.926507 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bc7128-ee0b-4ae4-b78f-9e41db0b1c2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:21.927368 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bc7128-ee0b-4ae4-b78f-9e41db0b1c2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:21.927649 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bc7128-ee0b-4ae4-b78f-9e41db0b1c2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:21.927923 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bc7128-ee0b-4ae4-b78f-9e41db0b1c2b admin admin] PATH_INFO: `/v3/users/0faac63a621b4e3ab202df8c24b44c0a` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:21.929216 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bc7128-ee0b-4ae4-b78f-9e41db0b1c2b admin admin] RBAC: Authorizing `identity:delete_user(user_id=0faac63a621b4e3ab202df8c24b44c0a)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:21.931642 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bc7128-ee0b-4ae4-b78f-9e41db0b1c2b admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:21.976184 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-94bc7128-ee0b-4ae4-b78f-9e41db0b1c2b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0faac63a621b4e3ab202df8c24b44c0a'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:21.987352 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-94bc7128-ee0b-4ae4-b78f-9e41db0b1c2b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0faac63a621b4e3ab202df8c24b44c0a'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:21.988600 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-94bc7128-ee0b-4ae4-b78f-9e41db0b1c2b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0faac63a621b4e3ab202df8c24b44c0a'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:21.996051 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-94bc7128-ee0b-4ae4-b78f-9e41db0b1c2b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0faac63a621b4e3ab202df8c24b44c0a'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:22.002858 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-94bc7128-ee0b-4ae4-b78f-9e41db0b1c2b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0faac63a621b4e3ab202df8c24b44c0a'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:22.009435 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1403/2789] 10.222.0.70 () {58 vars in 1223 bytes} [Tue May 10 19:29:21 2022] DELETE /identity/v3/users/0faac63a621b4e3ab202df8c24b44c0a => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 19:29:22.176331 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616c6c3d-088a-44b8-aaf6-53848344d9b8 service cinder] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:22.187665 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616c6c3d-088a-44b8-aaf6-53848344d9b8 service cinder] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:22.241617 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd4be5d-dbf8-455e-b2b6-94d913c02202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:22.242476 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd4be5d-dbf8-455e-b2b6-94d913c02202 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:22.242755 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd4be5d-dbf8-455e-b2b6-94d913c02202 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:22.243107 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd4be5d-dbf8-455e-b2b6-94d913c02202 admin admin] PATH_INFO: `/v3/projects/7f3f42959f7e488398ba38d0750f669c` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:22.244264 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd4be5d-dbf8-455e-b2b6-94d913c02202 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f3f42959f7e488398ba38d0750f669c)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:22.246266 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd4be5d-dbf8-455e-b2b6-94d913c02202 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:22.290547 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-2cd4be5d-dbf8-455e-b2b6-94d913c02202 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f3f42959f7e488398ba38d0750f669c', 'request_id': 'req-2cd4be5d-dbf8-455e-b2b6-94d913c02202'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:22.296209 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-2cd4be5d-dbf8-455e-b2b6-94d913c02202 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f3f42959f7e488398ba38d0750f669c', 'request_id': 'req-2cd4be5d-dbf8-455e-b2b6-94d913c02202'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:22.303189 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-2cd4be5d-dbf8-455e-b2b6-94d913c02202 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f3f42959f7e488398ba38d0750f669c', 'request_id': 'req-2cd4be5d-dbf8-455e-b2b6-94d913c02202'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:22.313641 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-2cd4be5d-dbf8-455e-b2b6-94d913c02202 admin admin] The token cache is being invalidate because project 7f3f42959f7e488398ba38d0750f669c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79993) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:29:22.313926 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-2cd4be5d-dbf8-455e-b2b6-94d913c02202 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:22.314535 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-2cd4be5d-dbf8-455e-b2b6-94d913c02202 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:22.316062 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1387/2790] 10.222.0.70 () {58 vars in 1232 bytes} [Tue May 10 19:29:22 2022] DELETE /identity/v3/projects/7f3f42959f7e488398ba38d0750f669c => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:29:22.320550 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bc7128-ee0b-4ae4-b78f-9e41db0b1c2b admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:22.322577 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-94bc7128-ee0b-4ae4-b78f-9e41db0b1c2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:29:22.335737 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bc7128-ee0b-4ae4-b78f-9e41db0b1c2b admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:22.389174 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fe4c26-ce7e-4390-a4ee-559873fd9e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:22.390039 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fe4c26-ce7e-4390-a4ee-559873fd9e95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:22.390321 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fe4c26-ce7e-4390-a4ee-559873fd9e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:22.390595 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fe4c26-ce7e-4390-a4ee-559873fd9e95 admin admin] PATH_INFO: `/v3/users/d3fff3fe059e49a59f8f86b46353f3b2` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:22.391757 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fe4c26-ce7e-4390-a4ee-559873fd9e95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3fff3fe059e49a59f8f86b46353f3b2)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:22.393685 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fe4c26-ce7e-4390-a4ee-559873fd9e95 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:22.437423 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-e7fe4c26-ce7e-4390-a4ee-559873fd9e95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3fff3fe059e49a59f8f86b46353f3b2'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:22.449435 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-e7fe4c26-ce7e-4390-a4ee-559873fd9e95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3fff3fe059e49a59f8f86b46353f3b2'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:22.450082 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-e7fe4c26-ce7e-4390-a4ee-559873fd9e95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3fff3fe059e49a59f8f86b46353f3b2'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:22.457576 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-e7fe4c26-ce7e-4390-a4ee-559873fd9e95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3fff3fe059e49a59f8f86b46353f3b2'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:22.464898 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-e7fe4c26-ce7e-4390-a4ee-559873fd9e95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3fff3fe059e49a59f8f86b46353f3b2'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:22.470594 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1404/2791] 10.222.0.70 () {58 vars in 1223 bytes} [Tue May 10 19:29:22 2022] DELETE /identity/v3/users/d3fff3fe059e49a59f8f86b46353f3b2 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:29:22.640857 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd4be5d-dbf8-455e-b2b6-94d913c02202 admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:22.642681 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-2cd4be5d-dbf8-455e-b2b6-94d913c02202 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:29:22.662290 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd4be5d-dbf8-455e-b2b6-94d913c02202 admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:22.720186 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ed35b7-0737-4fab-8d35-c6d431c838d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:22.720982 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ed35b7-0737-4fab-8d35-c6d431c838d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:22.721268 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ed35b7-0737-4fab-8d35-c6d431c838d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:22.721547 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ed35b7-0737-4fab-8d35-c6d431c838d8 admin admin] PATH_INFO: `/v3/projects/c7850f159ae04e78bceb1b2f9550d492` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:22.722723 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ed35b7-0737-4fab-8d35-c6d431c838d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7850f159ae04e78bceb1b2f9550d492)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:22.724713 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ed35b7-0737-4fab-8d35-c6d431c838d8 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:22.769180 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-67ed35b7-0737-4fab-8d35-c6d431c838d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7850f159ae04e78bceb1b2f9550d492', 'request_id': 'req-67ed35b7-0737-4fab-8d35-c6d431c838d8'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:22.774552 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-67ed35b7-0737-4fab-8d35-c6d431c838d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7850f159ae04e78bceb1b2f9550d492', 'request_id': 'req-67ed35b7-0737-4fab-8d35-c6d431c838d8'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:22.781757 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-67ed35b7-0737-4fab-8d35-c6d431c838d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7850f159ae04e78bceb1b2f9550d492', 'request_id': 'req-67ed35b7-0737-4fab-8d35-c6d431c838d8'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:22.792755 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-67ed35b7-0737-4fab-8d35-c6d431c838d8 admin admin] The token cache is being invalidate because project c7850f159ae04e78bceb1b2f9550d492 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79993) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:29:22.793057 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-67ed35b7-0737-4fab-8d35-c6d431c838d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:22.793674 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-67ed35b7-0737-4fab-8d35-c6d431c838d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:22.795309 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1388/2792] 10.222.0.70 () {58 vars in 1232 bytes} [Tue May 10 19:29:22 2022] DELETE /identity/v3/projects/c7850f159ae04e78bceb1b2f9550d492 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 19:29:22.800209 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1877bca5-b668-4da1-8e01-49b2f3324311 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:22.800531 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1877bca5-b668-4da1-8e01-49b2f3324311 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:22.800812 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1877bca5-b668-4da1-8e01-49b2f3324311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:22.822007 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-1877bca5-b668-4da1-8e01-49b2f3324311 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:29:22.823402 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-1877bca5-b668-4da1-8e01-49b2f3324311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:29:22.881148 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1405/2793] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:29:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:29:22.889542 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee6493d-f316-4273-b10a-128d1bbcc30d None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:22.889888 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee6493d-f316-4273-b10a-128d1bbcc30d None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:22.890103 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee6493d-f316-4273-b10a-128d1bbcc30d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:22.909671 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-3ee6493d-f316-4273-b10a-128d1bbcc30d None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:29:22.910929 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-3ee6493d-f316-4273-b10a-128d1bbcc30d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:29:22.919501 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1389/2794] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:29:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:29:22.923712 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1877bca5-b668-4da1-8e01-49b2f3324311 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:22.934035 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1877bca5-b668-4da1-8e01-49b2f3324311 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:22.939342 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ced859b-25a6-48f6-b7ca-b8f55d7020cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:22.940182 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ced859b-25a6-48f6-b7ca-b8f55d7020cb admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:22.940504 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ced859b-25a6-48f6-b7ca-b8f55d7020cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:22.940815 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ced859b-25a6-48f6-b7ca-b8f55d7020cb admin admin] PATH_INFO: `/v3/domains` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:22.941636 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ced859b-25a6-48f6-b7ca-b8f55d7020cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:29:22.943135 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ced859b-25a6-48f6-b7ca-b8f55d7020cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:22.944513 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ced859b-25a6-48f6-b7ca-b8f55d7020cb admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:22.963091 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1406/2795] 10.222.0.70 () {58 vars in 1152 bytes} [Tue May 10 19:29:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:29:22.963612 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee6493d-f316-4273-b10a-128d1bbcc30d None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:22.973917 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee6493d-f316-4273-b10a-128d1bbcc30d None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:22.979310 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a163af27-9258-457c-afda-fce24fc641bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:22.980069 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a163af27-9258-457c-afda-fce24fc641bb admin admin] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:22.980484 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a163af27-9258-457c-afda-fce24fc641bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:22.980842 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a163af27-9258-457c-afda-fce24fc641bb admin admin] PATH_INFO: `/v3/projects` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:22.982058 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a163af27-9258-457c-afda-fce24fc641bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:22.984563 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a163af27-9258-457c-afda-fce24fc641bb admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:23.010638 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1390/2796] 10.222.0.70 () {60 vars in 1152 bytes} [Tue May 10 19:29:22 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:29:23.014603 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ced859b-25a6-48f6-b7ca-b8f55d7020cb admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:23.024303 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ced859b-25a6-48f6-b7ca-b8f55d7020cb admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:23.079851 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1510e8-9f9a-4c48-8549-f867c9c4189e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:23.080547 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1510e8-9f9a-4c48-8549-f867c9c4189e admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:23.080824 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1510e8-9f9a-4c48-8549-f867c9c4189e admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:23.081093 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1510e8-9f9a-4c48-8549-f867c9c4189e admin admin] PATH_INFO: `/v3/users` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:23.081782 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1510e8-9f9a-4c48-8549-f867c9c4189e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:23.083673 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1510e8-9f9a-4c48-8549-f867c9c4189e admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:23.104605 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1407/2797] 10.222.0.70 () {60 vars in 1143 bytes} [Tue May 10 19:29:23 2022] POST /identity/v3/users => generated 293 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:29:23.108693 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a163af27-9258-457c-afda-fce24fc641bb admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:23.119181 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a163af27-9258-457c-afda-fce24fc641bb admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:23.123722 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7ab23e-e1fe-4e4b-9390-5d5169cd7299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:23.124373 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7ab23e-e1fe-4e4b-9390-5d5169cd7299 admin admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:23.124684 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7ab23e-e1fe-4e4b-9390-5d5169cd7299 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:23.124957 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7ab23e-e1fe-4e4b-9390-5d5169cd7299 admin admin] PATH_INFO: `/v3/roles` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:23.125696 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7ab23e-e1fe-4e4b-9390-5d5169cd7299 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:23.127280 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7ab23e-e1fe-4e4b-9390-5d5169cd7299 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:23.137392 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1391/2798] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:29:23 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:29:23.141281 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1510e8-9f9a-4c48-8549-f867c9c4189e admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:23.151543 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1510e8-9f9a-4c48-8549-f867c9c4189e admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:23.156242 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ced068-62cf-44a2-ac40-b767c9b98b1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:23.156937 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ced068-62cf-44a2-ac40-b767c9b98b1f admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:23.157219 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ced068-62cf-44a2-ac40-b767c9b98b1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:23.157536 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ced068-62cf-44a2-ac40-b767c9b98b1f admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:23.158201 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ced068-62cf-44a2-ac40-b767c9b98b1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:23.159782 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ced068-62cf-44a2-ac40-b767c9b98b1f admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:23.170149 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1408/2799] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:29:23 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:29:23.174335 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7ab23e-e1fe-4e4b-9390-5d5169cd7299 admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:23.185593 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7ab23e-e1fe-4e4b-9390-5d5169cd7299 admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:23.200784 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650ad6f5-200f-48eb-bfd0-e33f038c7a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:23.201682 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650ad6f5-200f-48eb-bfd0-e33f038c7a4a admin admin] REQUEST_METHOD: `PUT` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:23.201965 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650ad6f5-200f-48eb-bfd0-e33f038c7a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:23.202241 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650ad6f5-200f-48eb-bfd0-e33f038c7a4a admin admin] PATH_INFO: `/v3/projects/c3b67e5946a14d1595c7e17760a8188a/users/77a28d0e51c94045b828291d895314f2/roles/5c07cf5bfbd3427db18428aa50420962` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:23.219041 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650ad6f5-200f-48eb-bfd0-e33f038c7a4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3b67e5946a14d1595c7e17760a8188a, user_id=77a28d0e51c94045b828291d895314f2, role_id=5c07cf5bfbd3427db18428aa50420962)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:23.222129 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650ad6f5-200f-48eb-bfd0-e33f038c7a4a admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:23.236620 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1392/2800] 10.222.0.70 () {60 vars in 1482 bytes} [Tue May 10 19:29:23 2022] PUT /identity/v3/projects/c3b67e5946a14d1595c7e17760a8188a/users/77a28d0e51c94045b828291d895314f2/roles/5c07cf5bfbd3427db18428aa50420962 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:29:23.247297 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe480ba-dd08-4129-9ce5-91f1644ceb17 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:23.247595 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe480ba-dd08-4129-9ce5-91f1644ceb17 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:23.247874 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe480ba-dd08-4129-9ce5-91f1644ceb17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:23.280295 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-bfe480ba-dd08-4129-9ce5-91f1644ceb17 None None] MFA Rules not processed for user `77a28d0e51c94045b828291d895314f2`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:29:23.281529 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-bfe480ba-dd08-4129-9ce5-91f1644ceb17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:29:23.342336 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1409/2801] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:29:23 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:29:23.346842 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650ad6f5-200f-48eb-bfd0-e33f038c7a4a admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:23.405530 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650ad6f5-200f-48eb-bfd0-e33f038c7a4a admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:23.410094 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dbe291-a70a-4f50-84dd-fc12d4c86966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:23.410745 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dbe291-a70a-4f50-84dd-fc12d4c86966 admin admin] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:23.411031 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dbe291-a70a-4f50-84dd-fc12d4c86966 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:23.411310 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dbe291-a70a-4f50-84dd-fc12d4c86966 admin admin] PATH_INFO: `/v3/projects` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:23.412002 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dbe291-a70a-4f50-84dd-fc12d4c86966 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:23.413972 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dbe291-a70a-4f50-84dd-fc12d4c86966 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:23.437855 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1393/2802] 10.222.0.70 () {60 vars in 1152 bytes} [Tue May 10 19:29:23 2022] POST /identity/v3/projects => generated 383 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:29:23.441869 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe480ba-dd08-4129-9ce5-91f1644ceb17 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:23.452391 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe480ba-dd08-4129-9ce5-91f1644ceb17 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:23.507636 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4693712c-323a-4dd4-90b7-3c5d4a6f7f3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:23.508221 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4693712c-323a-4dd4-90b7-3c5d4a6f7f3d admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:23.508541 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4693712c-323a-4dd4-90b7-3c5d4a6f7f3d admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:23.508820 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4693712c-323a-4dd4-90b7-3c5d4a6f7f3d admin admin] PATH_INFO: `/v3/users` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:23.509596 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4693712c-323a-4dd4-90b7-3c5d4a6f7f3d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:23.511526 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4693712c-323a-4dd4-90b7-3c5d4a6f7f3d admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:23.532895 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1410/2803] 10.222.0.70 () {60 vars in 1143 bytes} [Tue May 10 19:29:23 2022] POST /identity/v3/users => generated 298 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 19:29:23.536941 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dbe291-a70a-4f50-84dd-fc12d4c86966 admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:23.547725 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dbe291-a70a-4f50-84dd-fc12d4c86966 admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:23.552661 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50df16a-358a-42e4-8c36-ad415a9163ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:23.553323 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50df16a-358a-42e4-8c36-ad415a9163ac admin admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:23.553609 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50df16a-358a-42e4-8c36-ad415a9163ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:23.553886 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50df16a-358a-42e4-8c36-ad415a9163ac admin admin] PATH_INFO: `/v3/roles` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:23.554605 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50df16a-358a-42e4-8c36-ad415a9163ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:23.556194 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50df16a-358a-42e4-8c36-ad415a9163ac admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:23.566443 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1394/2804] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:29:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:29:23.570761 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4693712c-323a-4dd4-90b7-3c5d4a6f7f3d admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:23.580388 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4693712c-323a-4dd4-90b7-3c5d4a6f7f3d admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:23.584964 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8886266-7e3f-4816-8efb-36f71e33123c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:23.585834 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8886266-7e3f-4816-8efb-36f71e33123c admin admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:23.586116 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8886266-7e3f-4816-8efb-36f71e33123c admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:23.586390 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8886266-7e3f-4816-8efb-36f71e33123c admin admin] PATH_INFO: `/v3/projects/ea458785fa2247a29c7983083d52b599/users/55250c78266248a1ba939bd5d0972722/roles/634ba284303b4626b5a0402772c68f5c` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:23.601059 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8886266-7e3f-4816-8efb-36f71e33123c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea458785fa2247a29c7983083d52b599, user_id=55250c78266248a1ba939bd5d0972722, role_id=634ba284303b4626b5a0402772c68f5c)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:23.604274 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8886266-7e3f-4816-8efb-36f71e33123c admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:23.617019 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1411/2805] 10.222.0.70 () {60 vars in 1482 bytes} [Tue May 10 19:29:23 2022] PUT /identity/v3/projects/ea458785fa2247a29c7983083d52b599/users/55250c78266248a1ba939bd5d0972722/roles/634ba284303b4626b5a0402772c68f5c => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:29:23.621023 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50df16a-358a-42e4-8c36-ad415a9163ac admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:23.631881 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50df16a-358a-42e4-8c36-ad415a9163ac admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:23.684891 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf3cdd6-cdea-4918-ad9c-4ace7b8535e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:23.685728 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf3cdd6-cdea-4918-ad9c-4ace7b8535e9 admin admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:23.685870 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf3cdd6-cdea-4918-ad9c-4ace7b8535e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:23.686162 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf3cdd6-cdea-4918-ad9c-4ace7b8535e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:23.687123 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf3cdd6-cdea-4918-ad9c-4ace7b8535e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:23.689424 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf3cdd6-cdea-4918-ad9c-4ace7b8535e9 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:23.702218 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1395/2806] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:29:23 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 19:29:23.706378 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8886266-7e3f-4816-8efb-36f71e33123c admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:23.716869 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8886266-7e3f-4816-8efb-36f71e33123c admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:23.721373 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd62c56-1c52-412c-b857-5f4d0ce78de2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:23.722241 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd62c56-1c52-412c-b857-5f4d0ce78de2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:23.722520 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd62c56-1c52-412c-b857-5f4d0ce78de2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:23.722790 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd62c56-1c52-412c-b857-5f4d0ce78de2 admin admin] PATH_INFO: `/v3/projects/ea458785fa2247a29c7983083d52b599/users/55250c78266248a1ba939bd5d0972722/roles/634ba284303b4626b5a0402772c68f5c` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:23.724811 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd62c56-1c52-412c-b857-5f4d0ce78de2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea458785fa2247a29c7983083d52b599, user_id=55250c78266248a1ba939bd5d0972722, role_id=634ba284303b4626b5a0402772c68f5c)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:23.727440 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd62c56-1c52-412c-b857-5f4d0ce78de2 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:23.737440 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1412/2807] 10.222.0.70 () {60 vars in 1482 bytes} [Tue May 10 19:29:23 2022] PUT /identity/v3/projects/ea458785fa2247a29c7983083d52b599/users/55250c78266248a1ba939bd5d0972722/roles/634ba284303b4626b5a0402772c68f5c => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 19:29:23.748193 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6649534-779f-4328-be61-020364b9e62b None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:23.748512 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6649534-779f-4328-be61-020364b9e62b None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:23.748796 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6649534-779f-4328-be61-020364b9e62b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:23.775416 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-d6649534-779f-4328-be61-020364b9e62b None None] MFA Rules not processed for user `55250c78266248a1ba939bd5d0972722`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:29:23.776602 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-d6649534-779f-4328-be61-020364b9e62b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:29:23.845112 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1396/2808] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:29:23 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:29:23.856458 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd62c56-1c52-412c-b857-5f4d0ce78de2 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:23.858175 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-bfd62c56-1c52-412c-b857-5f4d0ce78de2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:29:23.913076 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd62c56-1c52-412c-b857-5f4d0ce78de2 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:23.916688 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738ba3b6-be6c-4b06-a379-e327eff21753 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15df2a8967aa43299c10e365f4200d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:23.917312 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738ba3b6-be6c-4b06-a379-e327eff21753 service cinder] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:23.917589 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738ba3b6-be6c-4b06-a379-e327eff21753 service cinder] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:23.917857 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738ba3b6-be6c-4b06-a379-e327eff21753 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:23.970921 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738ba3b6-be6c-4b06-a379-e327eff21753 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:23.972343 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738ba3b6-be6c-4b06-a379-e327eff21753 service cinder] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:23.980925 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1413/2809] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:29:23 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:29:28.725268 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6649534-779f-4328-be61-020364b9e62b None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:28.726662 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-d6649534-779f-4328-be61-020364b9e62b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:29:28.787138 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6649534-779f-4328-be61-020364b9e62b None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:28.791780 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d618eba-4f20-4b1f-95c0-633f57e13825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:28.792676 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d618eba-4f20-4b1f-95c0-633f57e13825 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:28.792960 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d618eba-4f20-4b1f-95c0-633f57e13825 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:28.793233 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d618eba-4f20-4b1f-95c0-633f57e13825 admin admin] PATH_INFO: `/v3/users/81e2d998651449a7b88794286c3b0e9b` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:28.794427 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d618eba-4f20-4b1f-95c0-633f57e13825 admin admin] RBAC: Authorizing `identity:delete_user(user_id=81e2d998651449a7b88794286c3b0e9b)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:28.796368 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d618eba-4f20-4b1f-95c0-633f57e13825 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:28.847494 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-1d618eba-4f20-4b1f-95c0-633f57e13825 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81e2d998651449a7b88794286c3b0e9b'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:28.859376 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-1d618eba-4f20-4b1f-95c0-633f57e13825 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81e2d998651449a7b88794286c3b0e9b'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:28.865950 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-1d618eba-4f20-4b1f-95c0-633f57e13825 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81e2d998651449a7b88794286c3b0e9b'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:28.866616 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-1d618eba-4f20-4b1f-95c0-633f57e13825 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81e2d998651449a7b88794286c3b0e9b'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:28.874117 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-1d618eba-4f20-4b1f-95c0-633f57e13825 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81e2d998651449a7b88794286c3b0e9b'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:28.880347 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1397/2810] 10.222.0.70 () {58 vars in 1223 bytes} [Tue May 10 19:29:28 2022] DELETE /identity/v3/users/81e2d998651449a7b88794286c3b0e9b => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:29:28.885100 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a37281-e2d5-442f-a256-e5ce4cb7a918 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:28.885595 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a37281-e2d5-442f-a256-e5ce4cb7a918 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:28.885697 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a37281-e2d5-442f-a256-e5ce4cb7a918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:28.907290 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-78a37281-e2d5-442f-a256-e5ce4cb7a918 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:29:28.908524 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-78a37281-e2d5-442f-a256-e5ce4cb7a918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:29:28.965543 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1414/2811] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:29:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:29:28.975341 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d618eba-4f20-4b1f-95c0-633f57e13825 admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:28.976731 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-1d618eba-4f20-4b1f-95c0-633f57e13825 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:29:29.031348 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d618eba-4f20-4b1f-95c0-633f57e13825 admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:29.034982 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03218f99-8443-49a5-912b-c9ae084e7a93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f1dc79540b48c0866478cc48cd8205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:29.035621 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03218f99-8443-49a5-912b-c9ae084e7a93 service neutron] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:29.035905 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03218f99-8443-49a5-912b-c9ae084e7a93 service neutron] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:29.036180 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03218f99-8443-49a5-912b-c9ae084e7a93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:29.046419 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03218f99-8443-49a5-912b-c9ae084e7a93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:29.047849 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03218f99-8443-49a5-912b-c9ae084e7a93 service neutron] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:29.057606 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1398/2812] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:29:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:29:29.139610 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a37281-e2d5-442f-a256-e5ce4cb7a918 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:29.141038 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-78a37281-e2d5-442f-a256-e5ce4cb7a918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:29:29.205323 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a37281-e2d5-442f-a256-e5ce4cb7a918 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:29.209103 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d2aa48-d70a-4030-a2c8-c41a339150b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15df2a8967aa43299c10e365f4200d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:29.209763 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d2aa48-d70a-4030-a2c8-c41a339150b2 service cinder] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:29.210047 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d2aa48-d70a-4030-a2c8-c41a339150b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:29.210381 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d2aa48-d70a-4030-a2c8-c41a339150b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:29.212171 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-82d2aa48-d70a-4030-a2c8-c41a339150b2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:29:29.273369 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d2aa48-d70a-4030-a2c8-c41a339150b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:29.275311 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d2aa48-d70a-4030-a2c8-c41a339150b2 service cinder] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:29.284712 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1415/2813] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:29:29 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:29:29.326356 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03218f99-8443-49a5-912b-c9ae084e7a93 service neutron] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:29.327934 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-03218f99-8443-49a5-912b-c9ae084e7a93 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:29:29.342082 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03218f99-8443-49a5-912b-c9ae084e7a93 service neutron] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:29.347393 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459a7717-6fba-4281-b0c0-f3aad5357680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:29.348327 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459a7717-6fba-4281-b0c0-f3aad5357680 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:29.348779 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459a7717-6fba-4281-b0c0-f3aad5357680 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:29.349198 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459a7717-6fba-4281-b0c0-f3aad5357680 admin admin] PATH_INFO: `/v3/projects/76d668cabcdd4ed9afeddec02f1ab2eb` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:29.350532 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459a7717-6fba-4281-b0c0-f3aad5357680 admin admin] RBAC: Authorizing `identity:delete_project(project_id=76d668cabcdd4ed9afeddec02f1ab2eb)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:29.352769 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459a7717-6fba-4281-b0c0-f3aad5357680 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:29.412679 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-459a7717-6fba-4281-b0c0-f3aad5357680 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76d668cabcdd4ed9afeddec02f1ab2eb', 'request_id': 'req-459a7717-6fba-4281-b0c0-f3aad5357680'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:29.418103 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-459a7717-6fba-4281-b0c0-f3aad5357680 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76d668cabcdd4ed9afeddec02f1ab2eb', 'request_id': 'req-459a7717-6fba-4281-b0c0-f3aad5357680'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:29.425727 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-459a7717-6fba-4281-b0c0-f3aad5357680 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76d668cabcdd4ed9afeddec02f1ab2eb', 'request_id': 'req-459a7717-6fba-4281-b0c0-f3aad5357680'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:29.438296 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-459a7717-6fba-4281-b0c0-f3aad5357680 admin admin] The token cache is being invalidate because project 76d668cabcdd4ed9afeddec02f1ab2eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79993) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:29:29.438643 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-459a7717-6fba-4281-b0c0-f3aad5357680 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:29.439352 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-459a7717-6fba-4281-b0c0-f3aad5357680 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:29.441060 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1399/2814] 10.222.0.70 () {58 vars in 1232 bytes} [Tue May 10 19:29:29 2022] DELETE /identity/v3/projects/76d668cabcdd4ed9afeddec02f1ab2eb => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:29:29.445245 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d2aa48-d70a-4030-a2c8-c41a339150b2 service cinder] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:29.456644 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d2aa48-d70a-4030-a2c8-c41a339150b2 service cinder] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:29.513695 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd06789-aaa8-4457-b848-600d1c2f61ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:29.514595 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd06789-aaa8-4457-b848-600d1c2f61ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:29.514878 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd06789-aaa8-4457-b848-600d1c2f61ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:29.515151 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd06789-aaa8-4457-b848-600d1c2f61ea admin admin] PATH_INFO: `/v3/users/bb43b38027924c838ad8613e917083ab` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:29.516358 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd06789-aaa8-4457-b848-600d1c2f61ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb43b38027924c838ad8613e917083ab)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:29.518308 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd06789-aaa8-4457-b848-600d1c2f61ea admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:29.581367 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-afd06789-aaa8-4457-b848-600d1c2f61ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb43b38027924c838ad8613e917083ab'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:29.592755 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-afd06789-aaa8-4457-b848-600d1c2f61ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb43b38027924c838ad8613e917083ab'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:29.593515 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-afd06789-aaa8-4457-b848-600d1c2f61ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb43b38027924c838ad8613e917083ab'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:29.602968 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-afd06789-aaa8-4457-b848-600d1c2f61ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb43b38027924c838ad8613e917083ab'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:29.609797 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-afd06789-aaa8-4457-b848-600d1c2f61ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb43b38027924c838ad8613e917083ab'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:29.615917 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1416/2815] 10.222.0.70 () {58 vars in 1223 bytes} [Tue May 10 19:29:29 2022] DELETE /identity/v3/users/bb43b38027924c838ad8613e917083ab => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:29:29.877853 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459a7717-6fba-4281-b0c0-f3aad5357680 admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:29.879358 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-459a7717-6fba-4281-b0c0-f3aad5357680 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:29:29.891802 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459a7717-6fba-4281-b0c0-f3aad5357680 admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:29.949529 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e16cd3c-7006-49fd-a3e1-672aa23c46d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:29.950500 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e16cd3c-7006-49fd-a3e1-672aa23c46d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:29.950786 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e16cd3c-7006-49fd-a3e1-672aa23c46d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:29.951062 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e16cd3c-7006-49fd-a3e1-672aa23c46d2 admin admin] PATH_INFO: `/v3/projects/4d7d3c5122ed45ee87231c465cb7fd71` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:29.952244 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e16cd3c-7006-49fd-a3e1-672aa23c46d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d7d3c5122ed45ee87231c465cb7fd71)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:29.954220 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e16cd3c-7006-49fd-a3e1-672aa23c46d2 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:29.998721 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-7e16cd3c-7006-49fd-a3e1-672aa23c46d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d7d3c5122ed45ee87231c465cb7fd71', 'request_id': 'req-7e16cd3c-7006-49fd-a3e1-672aa23c46d2'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:30.003873 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-7e16cd3c-7006-49fd-a3e1-672aa23c46d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d7d3c5122ed45ee87231c465cb7fd71', 'request_id': 'req-7e16cd3c-7006-49fd-a3e1-672aa23c46d2'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:30.010934 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-7e16cd3c-7006-49fd-a3e1-672aa23c46d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d7d3c5122ed45ee87231c465cb7fd71', 'request_id': 'req-7e16cd3c-7006-49fd-a3e1-672aa23c46d2'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:30.021519 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-7e16cd3c-7006-49fd-a3e1-672aa23c46d2 admin admin] The token cache is being invalidate because project 4d7d3c5122ed45ee87231c465cb7fd71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79993) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:29:30.021803 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-7e16cd3c-7006-49fd-a3e1-672aa23c46d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:30.022419 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-7e16cd3c-7006-49fd-a3e1-672aa23c46d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:30.023932 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1400/2816] 10.222.0.70 () {58 vars in 1232 bytes} [Tue May 10 19:29:29 2022] DELETE /identity/v3/projects/4d7d3c5122ed45ee87231c465cb7fd71 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:29:30.029263 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b53473-decf-4f17-b277-21b4039fd481 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:30.029720 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b53473-decf-4f17-b277-21b4039fd481 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:30.029877 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b53473-decf-4f17-b277-21b4039fd481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:30.047251 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-50b53473-decf-4f17-b277-21b4039fd481 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:29:30.048461 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-50b53473-decf-4f17-b277-21b4039fd481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:29:30.104720 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1417/2817] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:29:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:29:30.112874 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d5b88a-553b-47a1-892b-2210bd19e54f None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:30.113161 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d5b88a-553b-47a1-892b-2210bd19e54f None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:30.113434 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d5b88a-553b-47a1-892b-2210bd19e54f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:30.132977 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-01d5b88a-553b-47a1-892b-2210bd19e54f None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:29:30.134746 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-01d5b88a-553b-47a1-892b-2210bd19e54f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:29:30.142728 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1401/2818] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:29:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:29:30.146817 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b53473-decf-4f17-b277-21b4039fd481 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:30.156293 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b53473-decf-4f17-b277-21b4039fd481 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:30.160913 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a9e890-1336-40b1-a902-7899021b733d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:30.161555 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a9e890-1336-40b1-a902-7899021b733d admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:30.161839 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a9e890-1336-40b1-a902-7899021b733d admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:30.162105 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a9e890-1336-40b1-a902-7899021b733d admin admin] PATH_INFO: `/v3/domains` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:30.162812 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a9e890-1336-40b1-a902-7899021b733d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:29:30.163112 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a9e890-1336-40b1-a902-7899021b733d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:30.164722 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a9e890-1336-40b1-a902-7899021b733d admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:30.175673 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1418/2819] 10.222.0.70 () {58 vars in 1152 bytes} [Tue May 10 19:29:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:29:30.179899 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d5b88a-553b-47a1-892b-2210bd19e54f None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:30.189671 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d5b88a-553b-47a1-892b-2210bd19e54f None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:30.194679 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6eab0a-6e5b-453e-b5de-f734f3a7aa4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:30.195321 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6eab0a-6e5b-453e-b5de-f734f3a7aa4c admin admin] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:30.195604 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6eab0a-6e5b-453e-b5de-f734f3a7aa4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:30.195891 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6eab0a-6e5b-453e-b5de-f734f3a7aa4c admin admin] PATH_INFO: `/v3/projects` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:30.197158 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6eab0a-6e5b-453e-b5de-f734f3a7aa4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:30.199056 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6eab0a-6e5b-453e-b5de-f734f3a7aa4c admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:30.223046 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1402/2820] 10.222.0.70 () {60 vars in 1152 bytes} [Tue May 10 19:29:30 2022] POST /identity/v3/projects => generated 373 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:29:30.227037 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a9e890-1336-40b1-a902-7899021b733d admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:30.236598 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a9e890-1336-40b1-a902-7899021b733d admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:30.290593 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f957c9c-5625-4fb7-ad55-a910a0159334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:30.291246 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f957c9c-5625-4fb7-ad55-a910a0159334 admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:30.291554 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f957c9c-5625-4fb7-ad55-a910a0159334 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:30.291823 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f957c9c-5625-4fb7-ad55-a910a0159334 admin admin] PATH_INFO: `/v3/users` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:30.292538 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f957c9c-5625-4fb7-ad55-a910a0159334 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:30.294438 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f957c9c-5625-4fb7-ad55-a910a0159334 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:30.313335 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1419/2821] 10.222.0.70 () {60 vars in 1143 bytes} [Tue May 10 19:29:30 2022] POST /identity/v3/users => generated 287 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:29:30.317366 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6eab0a-6e5b-453e-b5de-f734f3a7aa4c admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:30.328046 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6eab0a-6e5b-453e-b5de-f734f3a7aa4c admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:30.332660 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13889514-b41e-4a50-81a8-7e00749eefe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:30.333307 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13889514-b41e-4a50-81a8-7e00749eefe2 admin admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:30.333593 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13889514-b41e-4a50-81a8-7e00749eefe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:30.333871 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13889514-b41e-4a50-81a8-7e00749eefe2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:30.334584 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13889514-b41e-4a50-81a8-7e00749eefe2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:30.336172 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13889514-b41e-4a50-81a8-7e00749eefe2 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:30.346087 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1403/2822] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:29:30 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:29:30.349776 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f957c9c-5625-4fb7-ad55-a910a0159334 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:30.359247 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f957c9c-5625-4fb7-ad55-a910a0159334 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:30.363840 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61e22d3-d8ce-4358-8bee-eb84dc608176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:30.364514 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61e22d3-d8ce-4358-8bee-eb84dc608176 admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:30.364796 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61e22d3-d8ce-4358-8bee-eb84dc608176 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:30.365065 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61e22d3-d8ce-4358-8bee-eb84dc608176 admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:30.365769 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61e22d3-d8ce-4358-8bee-eb84dc608176 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:30.367327 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61e22d3-d8ce-4358-8bee-eb84dc608176 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:30.377309 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1420/2823] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:29:30 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:29:30.381225 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13889514-b41e-4a50-81a8-7e00749eefe2 admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:30.391467 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13889514-b41e-4a50-81a8-7e00749eefe2 admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:30.395904 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012c4182-333b-46b1-8834-286e124477fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:30.396806 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012c4182-333b-46b1-8834-286e124477fc admin admin] REQUEST_METHOD: `PUT` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:30.397141 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012c4182-333b-46b1-8834-286e124477fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:30.397421 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012c4182-333b-46b1-8834-286e124477fc admin admin] PATH_INFO: `/v3/projects/a0f16702b4804d5db5dc0ad7484ce217/users/d68b3efa34434c59b8799106f0b4e79c/roles/5c07cf5bfbd3427db18428aa50420962` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:30.411251 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012c4182-333b-46b1-8834-286e124477fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0f16702b4804d5db5dc0ad7484ce217, user_id=d68b3efa34434c59b8799106f0b4e79c, role_id=5c07cf5bfbd3427db18428aa50420962)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:30.413932 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012c4182-333b-46b1-8834-286e124477fc admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:30.427758 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1404/2824] 10.222.0.70 () {60 vars in 1482 bytes} [Tue May 10 19:29:30 2022] PUT /identity/v3/projects/a0f16702b4804d5db5dc0ad7484ce217/users/d68b3efa34434c59b8799106f0b4e79c/roles/5c07cf5bfbd3427db18428aa50420962 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:29:30.439542 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82109f8-3154-4362-a358-41101ad06446 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:30.439837 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82109f8-3154-4362-a358-41101ad06446 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:30.440120 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82109f8-3154-4362-a358-41101ad06446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:30.465998 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-c82109f8-3154-4362-a358-41101ad06446 None None] MFA Rules not processed for user `d68b3efa34434c59b8799106f0b4e79c`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:29:30.467185 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-c82109f8-3154-4362-a358-41101ad06446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:29:30.533449 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1421/2825] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:29:30 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:29:30.538489 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012c4182-333b-46b1-8834-286e124477fc admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:30.601685 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012c4182-333b-46b1-8834-286e124477fc admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:30.606601 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597b8773-9cd8-4eb6-9f46-8f399378f367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:30.607254 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597b8773-9cd8-4eb6-9f46-8f399378f367 admin admin] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:30.607538 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597b8773-9cd8-4eb6-9f46-8f399378f367 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:30.607816 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597b8773-9cd8-4eb6-9f46-8f399378f367 admin admin] PATH_INFO: `/v3/projects` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:30.608531 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597b8773-9cd8-4eb6-9f46-8f399378f367 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:30.610416 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597b8773-9cd8-4eb6-9f46-8f399378f367 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:30.638867 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1405/2826] 10.222.0.70 () {60 vars in 1152 bytes} [Tue May 10 19:29:30 2022] POST /identity/v3/projects => generated 377 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:29:30.639932 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82109f8-3154-4362-a358-41101ad06446 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:30.651144 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82109f8-3154-4362-a358-41101ad06446 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:30.706680 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32890ff3-e660-4ef5-818e-da0c8672df17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:30.707357 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32890ff3-e660-4ef5-818e-da0c8672df17 admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:30.707641 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32890ff3-e660-4ef5-818e-da0c8672df17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:30.707919 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32890ff3-e660-4ef5-818e-da0c8672df17 admin admin] PATH_INFO: `/v3/users` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:30.708652 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32890ff3-e660-4ef5-818e-da0c8672df17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:30.710628 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32890ff3-e660-4ef5-818e-da0c8672df17 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:30.734944 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1422/2827] 10.222.0.70 () {60 vars in 1143 bytes} [Tue May 10 19:29:30 2022] POST /identity/v3/users => generated 289 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:29:30.737831 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597b8773-9cd8-4eb6-9f46-8f399378f367 admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:30.748690 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597b8773-9cd8-4eb6-9f46-8f399378f367 admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:30.753676 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db25daa4-6f92-459b-988d-2d7376196f65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:30.754341 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db25daa4-6f92-459b-988d-2d7376196f65 admin admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:30.754630 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db25daa4-6f92-459b-988d-2d7376196f65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:30.754907 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db25daa4-6f92-459b-988d-2d7376196f65 admin admin] PATH_INFO: `/v3/roles` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:30.755628 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db25daa4-6f92-459b-988d-2d7376196f65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:30.757798 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db25daa4-6f92-459b-988d-2d7376196f65 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:30.775005 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1406/2828] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:29:30 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:29:30.776088 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32890ff3-e660-4ef5-818e-da0c8672df17 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:30.787307 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32890ff3-e660-4ef5-818e-da0c8672df17 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:30.792651 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87a8ef6-10dc-43b4-87bf-d5e300635f2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:30.793316 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87a8ef6-10dc-43b4-87bf-d5e300635f2e admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:30.793599 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87a8ef6-10dc-43b4-87bf-d5e300635f2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:30.793873 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87a8ef6-10dc-43b4-87bf-d5e300635f2e admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:30.794594 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87a8ef6-10dc-43b4-87bf-d5e300635f2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:30.796158 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87a8ef6-10dc-43b4-87bf-d5e300635f2e admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:30.807418 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1423/2829] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:29:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:29:30.811799 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db25daa4-6f92-459b-988d-2d7376196f65 admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:30.823333 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db25daa4-6f92-459b-988d-2d7376196f65 admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:30.830036 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500bfa0d-fdb6-4086-8284-c9469301c72c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:30.830891 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500bfa0d-fdb6-4086-8284-c9469301c72c admin admin] REQUEST_METHOD: `PUT` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:30.831270 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500bfa0d-fdb6-4086-8284-c9469301c72c admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:30.831606 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500bfa0d-fdb6-4086-8284-c9469301c72c admin admin] PATH_INFO: `/v3/projects/b4c6953fe2e74de4b37965a3ede8da9c/users/d7c877979e8447d29e3810a383bcf2fc/roles/5c07cf5bfbd3427db18428aa50420962` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:30.853234 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500bfa0d-fdb6-4086-8284-c9469301c72c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4c6953fe2e74de4b37965a3ede8da9c, user_id=d7c877979e8447d29e3810a383bcf2fc, role_id=5c07cf5bfbd3427db18428aa50420962)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:30.857423 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500bfa0d-fdb6-4086-8284-c9469301c72c admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:30.873654 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1407/2830] 10.222.0.70 () {60 vars in 1482 bytes} [Tue May 10 19:29:30 2022] PUT /identity/v3/projects/b4c6953fe2e74de4b37965a3ede8da9c/users/d7c877979e8447d29e3810a383bcf2fc/roles/5c07cf5bfbd3427db18428aa50420962 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:29:30.884876 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96fa913-e4c5-458c-b2fa-d130d70436b2 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:30.885241 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96fa913-e4c5-458c-b2fa-d130d70436b2 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:30.885521 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96fa913-e4c5-458c-b2fa-d130d70436b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:30.912153 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-f96fa913-e4c5-458c-b2fa-d130d70436b2 None None] MFA Rules not processed for user `d7c877979e8447d29e3810a383bcf2fc`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:29:30.913317 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-f96fa913-e4c5-458c-b2fa-d130d70436b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:29:30.984836 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1424/2831] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:29:30 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:29:30.989849 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500bfa0d-fdb6-4086-8284-c9469301c72c admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:31.053318 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500bfa0d-fdb6-4086-8284-c9469301c72c admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:31.058494 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb55a24-822c-4d36-815d-1f5d76a36d4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:31.059154 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb55a24-822c-4d36-815d-1f5d76a36d4c admin admin] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:31.059441 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb55a24-822c-4d36-815d-1f5d76a36d4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:31.059758 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb55a24-822c-4d36-815d-1f5d76a36d4c admin admin] PATH_INFO: `/v3/projects` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:31.060583 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb55a24-822c-4d36-815d-1f5d76a36d4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:31.062650 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb55a24-822c-4d36-815d-1f5d76a36d4c admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:31.088364 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1408/2832] 10.222.0.70 () {60 vars in 1152 bytes} [Tue May 10 19:29:30 2022] POST /identity/v3/projects => generated 377 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 19:29:31.092453 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96fa913-e4c5-458c-b2fa-d130d70436b2 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:31.102859 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96fa913-e4c5-458c-b2fa-d130d70436b2 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:31.155371 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362035dc-67e8-4704-a359-1a11d397076d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:31.156037 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362035dc-67e8-4704-a359-1a11d397076d admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:31.156321 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362035dc-67e8-4704-a359-1a11d397076d admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:31.156631 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362035dc-67e8-4704-a359-1a11d397076d admin admin] PATH_INFO: `/v3/users` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:31.157316 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362035dc-67e8-4704-a359-1a11d397076d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:31.159923 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362035dc-67e8-4704-a359-1a11d397076d admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:31.183381 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1425/2833] 10.222.0.70 () {60 vars in 1143 bytes} [Tue May 10 19:29:31 2022] POST /identity/v3/users => generated 295 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:29:31.191660 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb55a24-822c-4d36-815d-1f5d76a36d4c admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:31.204679 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb55a24-822c-4d36-815d-1f5d76a36d4c admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:31.209355 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6204fa6f-157d-48e1-bfcf-2a573f6ad590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:31.210016 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6204fa6f-157d-48e1-bfcf-2a573f6ad590 admin admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:31.210303 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6204fa6f-157d-48e1-bfcf-2a573f6ad590 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:31.210582 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6204fa6f-157d-48e1-bfcf-2a573f6ad590 admin admin] PATH_INFO: `/v3/roles` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:31.211302 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6204fa6f-157d-48e1-bfcf-2a573f6ad590 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:31.212972 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6204fa6f-157d-48e1-bfcf-2a573f6ad590 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:31.223240 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1409/2834] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:29:31 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 19:29:31.227908 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362035dc-67e8-4704-a359-1a11d397076d admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:31.237979 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362035dc-67e8-4704-a359-1a11d397076d admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:31.242611 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce68ce8f-4cc3-41d0-a394-4f59dcf55703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:31.244072 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce68ce8f-4cc3-41d0-a394-4f59dcf55703 admin admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:31.244356 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce68ce8f-4cc3-41d0-a394-4f59dcf55703 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:31.244668 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce68ce8f-4cc3-41d0-a394-4f59dcf55703 admin admin] PATH_INFO: `/v3/projects/c6949da13f064eaca7d1266c02679771/users/0528ad4d80aa4dc095a932c9208c65e5/roles/634ba284303b4626b5a0402772c68f5c` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:31.258833 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce68ce8f-4cc3-41d0-a394-4f59dcf55703 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6949da13f064eaca7d1266c02679771, user_id=0528ad4d80aa4dc095a932c9208c65e5, role_id=634ba284303b4626b5a0402772c68f5c)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:31.261585 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce68ce8f-4cc3-41d0-a394-4f59dcf55703 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:31.273850 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1426/2835] 10.222.0.70 () {60 vars in 1482 bytes} [Tue May 10 19:29:31 2022] PUT /identity/v3/projects/c6949da13f064eaca7d1266c02679771/users/0528ad4d80aa4dc095a932c9208c65e5/roles/634ba284303b4626b5a0402772c68f5c => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:29:31.277663 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6204fa6f-157d-48e1-bfcf-2a573f6ad590 admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:31.287508 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6204fa6f-157d-48e1-bfcf-2a573f6ad590 admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:31.341033 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a342b627-8a09-4184-989c-a44436d6fe3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:31.341688 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a342b627-8a09-4184-989c-a44436d6fe3f admin admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:31.341969 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a342b627-8a09-4184-989c-a44436d6fe3f admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:31.342254 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a342b627-8a09-4184-989c-a44436d6fe3f admin admin] PATH_INFO: `/v3/roles` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:31.342964 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a342b627-8a09-4184-989c-a44436d6fe3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:31.344621 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a342b627-8a09-4184-989c-a44436d6fe3f admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:31.354345 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1410/2836] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:29:31 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:29:31.358682 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce68ce8f-4cc3-41d0-a394-4f59dcf55703 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:31.369351 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce68ce8f-4cc3-41d0-a394-4f59dcf55703 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:31.373976 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a95a728-a60b-4702-9431-668180b66c76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:31.374844 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a95a728-a60b-4702-9431-668180b66c76 admin admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:31.375124 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a95a728-a60b-4702-9431-668180b66c76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:31.375413 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a95a728-a60b-4702-9431-668180b66c76 admin admin] PATH_INFO: `/v3/projects/c6949da13f064eaca7d1266c02679771/users/0528ad4d80aa4dc095a932c9208c65e5/roles/634ba284303b4626b5a0402772c68f5c` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:31.377396 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a95a728-a60b-4702-9431-668180b66c76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6949da13f064eaca7d1266c02679771, user_id=0528ad4d80aa4dc095a932c9208c65e5, role_id=634ba284303b4626b5a0402772c68f5c)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:31.380042 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a95a728-a60b-4702-9431-668180b66c76 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:31.389928 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1427/2837] 10.222.0.70 () {60 vars in 1482 bytes} [Tue May 10 19:29:31 2022] PUT /identity/v3/projects/c6949da13f064eaca7d1266c02679771/users/0528ad4d80aa4dc095a932c9208c65e5/roles/634ba284303b4626b5a0402772c68f5c => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:29:31.399964 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bc091d-2258-41eb-bf2d-02bd1cb8fcb0 None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:31.400276 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bc091d-2258-41eb-bf2d-02bd1cb8fcb0 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:31.400583 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bc091d-2258-41eb-bf2d-02bd1cb8fcb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:31.426835 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-24bc091d-2258-41eb-bf2d-02bd1cb8fcb0 None None] MFA Rules not processed for user `0528ad4d80aa4dc095a932c9208c65e5`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:29:31.428021 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-24bc091d-2258-41eb-bf2d-02bd1cb8fcb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:29:31.495080 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1411/2838] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:29:31 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:29:31.506191 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a95a728-a60b-4702-9431-668180b66c76 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:31.507940 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-7a95a728-a60b-4702-9431-668180b66c76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:29:31.563838 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a95a728-a60b-4702-9431-668180b66c76 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:31.567394 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b083446-5751-4b07-9a16-331fd2e1adc8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15df2a8967aa43299c10e365f4200d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:31.568311 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b083446-5751-4b07-9a16-331fd2e1adc8 service cinder] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:31.568615 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b083446-5751-4b07-9a16-331fd2e1adc8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:31.568889 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b083446-5751-4b07-9a16-331fd2e1adc8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:31.623150 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b083446-5751-4b07-9a16-331fd2e1adc8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:31.624615 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b083446-5751-4b07-9a16-331fd2e1adc8 service cinder] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:31.633322 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1428/2839] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:29:31 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:29:33.095044 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bc091d-2258-41eb-bf2d-02bd1cb8fcb0 None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:33.096671 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-24bc091d-2258-41eb-bf2d-02bd1cb8fcb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:29:33.109349 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bc091d-2258-41eb-bf2d-02bd1cb8fcb0 None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:33.112810 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf6eccb-1a71-4dc6-ba22-14f0b3356784 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15df2a8967aa43299c10e365f4200d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:33.113477 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf6eccb-1a71-4dc6-ba22-14f0b3356784 service cinder] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:33.114030 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf6eccb-1a71-4dc6-ba22-14f0b3356784 service cinder] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:33.114312 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf6eccb-1a71-4dc6-ba22-14f0b3356784 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:33.175393 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf6eccb-1a71-4dc6-ba22-14f0b3356784 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:33.176790 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf6eccb-1a71-4dc6-ba22-14f0b3356784 service cinder] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:33.185908 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1412/2840] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:29:33 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:29:33.703073 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b083446-5751-4b07-9a16-331fd2e1adc8 service cinder] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:33.712284 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b083446-5751-4b07-9a16-331fd2e1adc8 service cinder] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:33.715846 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b06236-1805-41b4-9231-7622307fe092 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15df2a8967aa43299c10e365f4200d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:33.716506 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b06236-1805-41b4-9231-7622307fe092 service cinder] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:33.716788 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b06236-1805-41b4-9231-7622307fe092 service cinder] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:33.717061 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b06236-1805-41b4-9231-7622307fe092 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:33.725647 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b06236-1805-41b4-9231-7622307fe092 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:33.727060 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b06236-1805-41b4-9231-7622307fe092 service cinder] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:33.736330 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1429/2841] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:29:33 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:29:34.175084 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf6eccb-1a71-4dc6-ba22-14f0b3356784 service cinder] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:34.176493 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-acf6eccb-1a71-4dc6-ba22-14f0b3356784 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:29:34.233263 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b06236-1805-41b4-9231-7622307fe092 service cinder] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:34.238091 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf6eccb-1a71-4dc6-ba22-14f0b3356784 service cinder] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:34.241671 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b06236-1805-41b4-9231-7622307fe092 service cinder] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:34.242648 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80a6096-1910-43d5-bfb5-9953f2f83aaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:34.244062 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80a6096-1910-43d5-bfb5-9953f2f83aaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:34.244400 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80a6096-1910-43d5-bfb5-9953f2f83aaa admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:34.244642 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80a6096-1910-43d5-bfb5-9953f2f83aaa admin admin] PATH_INFO: `/v3/users/77a28d0e51c94045b828291d895314f2` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:34.245809 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80a6096-1910-43d5-bfb5-9953f2f83aaa admin admin] RBAC: Authorizing `identity:delete_user(user_id=77a28d0e51c94045b828291d895314f2)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:34.245994 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5194d8-dd83-46fc-9546-8cdff0326fa1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15df2a8967aa43299c10e365f4200d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:34.246626 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5194d8-dd83-46fc-9546-8cdff0326fa1 service cinder] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:34.246904 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5194d8-dd83-46fc-9546-8cdff0326fa1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:34.247174 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5194d8-dd83-46fc-9546-8cdff0326fa1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:34.247719 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80a6096-1910-43d5-bfb5-9953f2f83aaa admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:34.249098 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-fc5194d8-dd83-46fc-9546-8cdff0326fa1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:29:34.293098 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-e80a6096-1910-43d5-bfb5-9953f2f83aaa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77a28d0e51c94045b828291d895314f2'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:34.304779 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-e80a6096-1910-43d5-bfb5-9953f2f83aaa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77a28d0e51c94045b828291d895314f2'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:34.307263 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5194d8-dd83-46fc-9546-8cdff0326fa1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:34.308899 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5194d8-dd83-46fc-9546-8cdff0326fa1 service cinder] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:34.311969 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-e80a6096-1910-43d5-bfb5-9953f2f83aaa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77a28d0e51c94045b828291d895314f2'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:34.312656 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-e80a6096-1910-43d5-bfb5-9953f2f83aaa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77a28d0e51c94045b828291d895314f2'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:34.319386 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1430/2842] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:29:34 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 19:29:34.321308 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-e80a6096-1910-43d5-bfb5-9953f2f83aaa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77a28d0e51c94045b828291d895314f2'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:34.327529 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1413/2843] 10.222.0.70 () {58 vars in 1223 bytes} [Tue May 10 19:29:34 2022] DELETE /identity/v3/users/77a28d0e51c94045b828291d895314f2 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:29:34.332092 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5646aca6-3067-4ae2-8404-3690e0b165db None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:34.332382 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5646aca6-3067-4ae2-8404-3690e0b165db None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:34.332679 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5646aca6-3067-4ae2-8404-3690e0b165db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:34.349368 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-5646aca6-3067-4ae2-8404-3690e0b165db None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:29:34.350563 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-5646aca6-3067-4ae2-8404-3690e0b165db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:29:34.408677 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1431/2844] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:29:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:29:34.419226 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80a6096-1910-43d5-bfb5-9953f2f83aaa admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:34.420888 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-e80a6096-1910-43d5-bfb5-9953f2f83aaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:29:34.482413 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80a6096-1910-43d5-bfb5-9953f2f83aaa admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:34.486376 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd359adb-0c16-4c4f-a4c3-2c9d17a96a66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f1dc79540b48c0866478cc48cd8205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:34.487008 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd359adb-0c16-4c4f-a4c3-2c9d17a96a66 service neutron] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:34.487264 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd359adb-0c16-4c4f-a4c3-2c9d17a96a66 service neutron] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:34.487543 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd359adb-0c16-4c4f-a4c3-2c9d17a96a66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:34.501852 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd359adb-0c16-4c4f-a4c3-2c9d17a96a66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:34.503349 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd359adb-0c16-4c4f-a4c3-2c9d17a96a66 service neutron] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:34.513097 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1414/2845] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:29:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:29:34.768337 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5646aca6-3067-4ae2-8404-3690e0b165db None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:34.769854 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-5646aca6-3067-4ae2-8404-3690e0b165db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:29:34.782107 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5646aca6-3067-4ae2-8404-3690e0b165db None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:34.786899 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6348d580-8fe9-48f9-ad4d-33d770ad8d5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:34.788067 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6348d580-8fe9-48f9-ad4d-33d770ad8d5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:34.788593 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6348d580-8fe9-48f9-ad4d-33d770ad8d5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:34.789086 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6348d580-8fe9-48f9-ad4d-33d770ad8d5a admin admin] PATH_INFO: `/v3/projects/c3b67e5946a14d1595c7e17760a8188a` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:34.791416 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6348d580-8fe9-48f9-ad4d-33d770ad8d5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3b67e5946a14d1595c7e17760a8188a)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:34.794121 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6348d580-8fe9-48f9-ad4d-33d770ad8d5a admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:34.841935 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-6348d580-8fe9-48f9-ad4d-33d770ad8d5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3b67e5946a14d1595c7e17760a8188a', 'request_id': 'req-6348d580-8fe9-48f9-ad4d-33d770ad8d5a'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:34.847179 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-6348d580-8fe9-48f9-ad4d-33d770ad8d5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3b67e5946a14d1595c7e17760a8188a', 'request_id': 'req-6348d580-8fe9-48f9-ad4d-33d770ad8d5a'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:34.854347 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-6348d580-8fe9-48f9-ad4d-33d770ad8d5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3b67e5946a14d1595c7e17760a8188a', 'request_id': 'req-6348d580-8fe9-48f9-ad4d-33d770ad8d5a'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:34.866539 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-6348d580-8fe9-48f9-ad4d-33d770ad8d5a admin admin] The token cache is being invalidate because project c3b67e5946a14d1595c7e17760a8188a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79994) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:29:34.866836 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-6348d580-8fe9-48f9-ad4d-33d770ad8d5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:34.867493 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-6348d580-8fe9-48f9-ad4d-33d770ad8d5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:34.869783 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1432/2846] 10.222.0.70 () {58 vars in 1232 bytes} [Tue May 10 19:29:34 2022] DELETE /identity/v3/projects/c3b67e5946a14d1595c7e17760a8188a => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:29:34.873655 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd359adb-0c16-4c4f-a4c3-2c9d17a96a66 service neutron] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:34.883049 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd359adb-0c16-4c4f-a4c3-2c9d17a96a66 service neutron] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:34.939413 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc05258-e5e9-4bd4-881f-9c2bbecb8ec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:34.940446 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc05258-e5e9-4bd4-881f-9c2bbecb8ec5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:34.940875 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc05258-e5e9-4bd4-881f-9c2bbecb8ec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:34.941249 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc05258-e5e9-4bd4-881f-9c2bbecb8ec5 admin admin] PATH_INFO: `/v3/users/55250c78266248a1ba939bd5d0972722` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:34.942545 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc05258-e5e9-4bd4-881f-9c2bbecb8ec5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=55250c78266248a1ba939bd5d0972722)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:34.944826 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc05258-e5e9-4bd4-881f-9c2bbecb8ec5 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:34.996968 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-8fc05258-e5e9-4bd4-881f-9c2bbecb8ec5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55250c78266248a1ba939bd5d0972722'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:35.009146 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-8fc05258-e5e9-4bd4-881f-9c2bbecb8ec5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55250c78266248a1ba939bd5d0972722'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:35.015985 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-8fc05258-e5e9-4bd4-881f-9c2bbecb8ec5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55250c78266248a1ba939bd5d0972722'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:35.016732 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-8fc05258-e5e9-4bd4-881f-9c2bbecb8ec5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55250c78266248a1ba939bd5d0972722'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:35.024004 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-8fc05258-e5e9-4bd4-881f-9c2bbecb8ec5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55250c78266248a1ba939bd5d0972722'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:35.030559 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1415/2847] 10.222.0.70 () {58 vars in 1223 bytes} [Tue May 10 19:29:34 2022] DELETE /identity/v3/users/55250c78266248a1ba939bd5d0972722 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:29:35.315682 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6348d580-8fe9-48f9-ad4d-33d770ad8d5a admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:35.317268 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-6348d580-8fe9-48f9-ad4d-33d770ad8d5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:29:35.330970 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6348d580-8fe9-48f9-ad4d-33d770ad8d5a admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:35.387503 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893db2aa-317f-4921-b531-bfd0b0376549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:35.388361 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893db2aa-317f-4921-b531-bfd0b0376549 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:35.388673 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893db2aa-317f-4921-b531-bfd0b0376549 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:35.388946 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893db2aa-317f-4921-b531-bfd0b0376549 admin admin] PATH_INFO: `/v3/projects/ea458785fa2247a29c7983083d52b599` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:35.390176 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893db2aa-317f-4921-b531-bfd0b0376549 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea458785fa2247a29c7983083d52b599)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:35.392062 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893db2aa-317f-4921-b531-bfd0b0376549 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:35.435344 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-893db2aa-317f-4921-b531-bfd0b0376549 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea458785fa2247a29c7983083d52b599', 'request_id': 'req-893db2aa-317f-4921-b531-bfd0b0376549'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:35.440440 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-893db2aa-317f-4921-b531-bfd0b0376549 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea458785fa2247a29c7983083d52b599', 'request_id': 'req-893db2aa-317f-4921-b531-bfd0b0376549'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:35.448195 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-893db2aa-317f-4921-b531-bfd0b0376549 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea458785fa2247a29c7983083d52b599', 'request_id': 'req-893db2aa-317f-4921-b531-bfd0b0376549'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:35.458638 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-893db2aa-317f-4921-b531-bfd0b0376549 admin admin] The token cache is being invalidate because project ea458785fa2247a29c7983083d52b599 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79994) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:29:35.458918 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-893db2aa-317f-4921-b531-bfd0b0376549 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:35.459532 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-893db2aa-317f-4921-b531-bfd0b0376549 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:35.461067 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1433/2848] 10.222.0.70 () {58 vars in 1232 bytes} [Tue May 10 19:29:35 2022] DELETE /identity/v3/projects/ea458785fa2247a29c7983083d52b599 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:29:35.467540 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f2b7f0-8039-4a7a-9002-8b2238db537b None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:35.468030 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f2b7f0-8039-4a7a-9002-8b2238db537b None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:35.468129 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f2b7f0-8039-4a7a-9002-8b2238db537b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:35.486318 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-68f2b7f0-8039-4a7a-9002-8b2238db537b None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:29:35.487499 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-68f2b7f0-8039-4a7a-9002-8b2238db537b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:29:35.545123 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1416/2849] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:29:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:29:35.553679 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17557723-fd86-4bed-891f-c2b70aafb4a1 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:35.553972 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17557723-fd86-4bed-891f-c2b70aafb4a1 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:35.554258 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17557723-fd86-4bed-891f-c2b70aafb4a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:35.572464 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-17557723-fd86-4bed-891f-c2b70aafb4a1 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:29:35.573582 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-17557723-fd86-4bed-891f-c2b70aafb4a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:29:35.581370 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1434/2850] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:29:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:29:35.585335 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f2b7f0-8039-4a7a-9002-8b2238db537b None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:35.595223 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f2b7f0-8039-4a7a-9002-8b2238db537b None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:35.599702 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe7ec66-d65d-461e-8f60-9d2b0c170abc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:35.600348 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe7ec66-d65d-461e-8f60-9d2b0c170abc admin admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:35.600661 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe7ec66-d65d-461e-8f60-9d2b0c170abc admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:35.600936 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe7ec66-d65d-461e-8f60-9d2b0c170abc admin admin] PATH_INFO: `/v3/domains` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:35.601652 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe7ec66-d65d-461e-8f60-9d2b0c170abc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79993) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:29:35.601985 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe7ec66-d65d-461e-8f60-9d2b0c170abc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:35.604181 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe7ec66-d65d-461e-8f60-9d2b0c170abc admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:35.615459 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1417/2851] 10.222.0.70 () {58 vars in 1152 bytes} [Tue May 10 19:29:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:29:35.620001 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17557723-fd86-4bed-891f-c2b70aafb4a1 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:35.629038 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17557723-fd86-4bed-891f-c2b70aafb4a1 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:35.634262 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50598966-7158-40ac-86d6-46ceba9c01f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:35.634908 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50598966-7158-40ac-86d6-46ceba9c01f6 admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:35.635192 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50598966-7158-40ac-86d6-46ceba9c01f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:35.635472 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50598966-7158-40ac-86d6-46ceba9c01f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:35.636166 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50598966-7158-40ac-86d6-46ceba9c01f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:35.638090 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50598966-7158-40ac-86d6-46ceba9c01f6 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:35.662086 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1435/2852] 10.222.0.70 () {60 vars in 1152 bytes} [Tue May 10 19:29:35 2022] POST /identity/v3/projects => generated 371 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:29:35.666701 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe7ec66-d65d-461e-8f60-9d2b0c170abc admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:35.676580 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe7ec66-d65d-461e-8f60-9d2b0c170abc admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:35.734360 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9750f06-df35-4c95-b77b-add2052f82c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:35.735023 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9750f06-df35-4c95-b77b-add2052f82c8 admin admin] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:35.735308 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9750f06-df35-4c95-b77b-add2052f82c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:35.735584 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9750f06-df35-4c95-b77b-add2052f82c8 admin admin] PATH_INFO: `/v3/users` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:35.736262 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9750f06-df35-4c95-b77b-add2052f82c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:35.738233 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9750f06-df35-4c95-b77b-add2052f82c8 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:35.757774 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1418/2853] 10.222.0.70 () {60 vars in 1143 bytes} [Tue May 10 19:29:35 2022] POST /identity/v3/users => generated 286 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:29:35.761809 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50598966-7158-40ac-86d6-46ceba9c01f6 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:35.771818 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50598966-7158-40ac-86d6-46ceba9c01f6 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:35.776685 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef24f0e1-c06c-47ca-907b-a06efc74d29f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:35.777349 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef24f0e1-c06c-47ca-907b-a06efc74d29f admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:35.777633 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef24f0e1-c06c-47ca-907b-a06efc74d29f admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:35.777910 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef24f0e1-c06c-47ca-907b-a06efc74d29f admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:35.778637 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef24f0e1-c06c-47ca-907b-a06efc74d29f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:35.780226 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef24f0e1-c06c-47ca-907b-a06efc74d29f admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:35.792026 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1436/2854] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:29:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:29:35.795782 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9750f06-df35-4c95-b77b-add2052f82c8 admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:35.805962 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9750f06-df35-4c95-b77b-add2052f82c8 admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:35.810548 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dcdde7-0713-47a3-93f8-f401cb51f03e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:35.811191 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dcdde7-0713-47a3-93f8-f401cb51f03e admin admin] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:35.811477 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dcdde7-0713-47a3-93f8-f401cb51f03e admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:35.811755 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dcdde7-0713-47a3-93f8-f401cb51f03e admin admin] PATH_INFO: `/v3/roles` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:35.812506 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dcdde7-0713-47a3-93f8-f401cb51f03e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:35.814091 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dcdde7-0713-47a3-93f8-f401cb51f03e admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:35.824645 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1419/2855] 10.222.0.70 () {58 vars in 1121 bytes} [Tue May 10 19:29:35 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 19:29:35.828309 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef24f0e1-c06c-47ca-907b-a06efc74d29f admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:35.837904 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef24f0e1-c06c-47ca-907b-a06efc74d29f admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:35.842495 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3c1514-59e2-4e4c-a547-ee735a965dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:35.843366 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3c1514-59e2-4e4c-a547-ee735a965dc7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:35.843650 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3c1514-59e2-4e4c-a547-ee735a965dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:35.843930 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3c1514-59e2-4e4c-a547-ee735a965dc7 admin admin] PATH_INFO: `/v3/projects/370d7066a3154b8b976d4b50f721920b/users/b8881992970e4e96bfe5c3aa99babdee/roles/5c07cf5bfbd3427db18428aa50420962` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:35.858666 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3c1514-59e2-4e4c-a547-ee735a965dc7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=370d7066a3154b8b976d4b50f721920b, user_id=b8881992970e4e96bfe5c3aa99babdee, role_id=5c07cf5bfbd3427db18428aa50420962)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:35.861390 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3c1514-59e2-4e4c-a547-ee735a965dc7 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:35.874525 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1437/2856] 10.222.0.70 () {60 vars in 1482 bytes} [Tue May 10 19:29:35 2022] PUT /identity/v3/projects/370d7066a3154b8b976d4b50f721920b/users/b8881992970e4e96bfe5c3aa99babdee/roles/5c07cf5bfbd3427db18428aa50420962 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 19:29:35.885656 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bbf53f-045f-4837-9108-bf68afd4199a None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:35.885947 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bbf53f-045f-4837-9108-bf68afd4199a None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:35.886228 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bbf53f-045f-4837-9108-bf68afd4199a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:35.910913 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-54bbf53f-045f-4837-9108-bf68afd4199a None None] MFA Rules not processed for user `b8881992970e4e96bfe5c3aa99babdee`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:29:35.912092 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-54bbf53f-045f-4837-9108-bf68afd4199a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:29:35.981761 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1420/2857] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:29:35 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:29:35.993503 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3c1514-59e2-4e4c-a547-ee735a965dc7 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:35.995310 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-5c3c1514-59e2-4e4c-a547-ee735a965dc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:29:36.049761 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3c1514-59e2-4e4c-a547-ee735a965dc7 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:36.053448 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1637d1d-f9c0-4f0f-a3c2-f15d82c3923c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15df2a8967aa43299c10e365f4200d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:36.054081 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1637d1d-f9c0-4f0f-a3c2-f15d82c3923c service cinder] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:36.054365 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1637d1d-f9c0-4f0f-a3c2-f15d82c3923c service cinder] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:36.054641 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1637d1d-f9c0-4f0f-a3c2-f15d82c3923c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:36.062691 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1637d1d-f9c0-4f0f-a3c2-f15d82c3923c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:36.064100 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1637d1d-f9c0-4f0f-a3c2-f15d82c3923c service cinder] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:36.072983 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1438/2858] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:29:35 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:29:36.092103 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bbf53f-045f-4837-9108-bf68afd4199a None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:36.152198 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bbf53f-045f-4837-9108-bf68afd4199a None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:36.157097 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6241902e-6df7-4d57-b8dc-91167ea2345e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:36.157962 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6241902e-6df7-4d57-b8dc-91167ea2345e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:36.158241 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6241902e-6df7-4d57-b8dc-91167ea2345e admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:36.158593 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6241902e-6df7-4d57-b8dc-91167ea2345e admin admin] PATH_INFO: `/v3/users/b8881992970e4e96bfe5c3aa99babdee` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:36.159687 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6241902e-6df7-4d57-b8dc-91167ea2345e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8881992970e4e96bfe5c3aa99babdee)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:36.161626 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6241902e-6df7-4d57-b8dc-91167ea2345e admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:36.206271 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-6241902e-6df7-4d57-b8dc-91167ea2345e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8881992970e4e96bfe5c3aa99babdee'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:36.218072 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-6241902e-6df7-4d57-b8dc-91167ea2345e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8881992970e4e96bfe5c3aa99babdee'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:36.224551 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-6241902e-6df7-4d57-b8dc-91167ea2345e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8881992970e4e96bfe5c3aa99babdee'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:36.225233 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-6241902e-6df7-4d57-b8dc-91167ea2345e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8881992970e4e96bfe5c3aa99babdee'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:36.231852 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-6241902e-6df7-4d57-b8dc-91167ea2345e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8881992970e4e96bfe5c3aa99babdee'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:36.237665 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1421/2859] 10.222.0.70 () {58 vars in 1223 bytes} [Tue May 10 19:29:36 2022] DELETE /identity/v3/users/b8881992970e4e96bfe5c3aa99babdee => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:29:36.242174 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757c3924-308a-46eb-ae1a-7540c8382e82 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:36.242491 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757c3924-308a-46eb-ae1a-7540c8382e82 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:36.242762 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757c3924-308a-46eb-ae1a-7540c8382e82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:36.258909 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-757c3924-308a-46eb-ae1a-7540c8382e82 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:29:36.260072 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-757c3924-308a-46eb-ae1a-7540c8382e82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:29:36.315104 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1439/2860] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:29:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:29:36.325026 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6241902e-6df7-4d57-b8dc-91167ea2345e admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:36.326414 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-6241902e-6df7-4d57-b8dc-91167ea2345e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:29:36.381940 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6241902e-6df7-4d57-b8dc-91167ea2345e admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:36.385510 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baceae1a-5c23-492c-bce1-ab7c9e7b005f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f1dc79540b48c0866478cc48cd8205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:36.386145 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baceae1a-5c23-492c-bce1-ab7c9e7b005f service neutron] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:36.386429 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baceae1a-5c23-492c-bce1-ab7c9e7b005f service neutron] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:36.386705 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baceae1a-5c23-492c-bce1-ab7c9e7b005f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:36.395650 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baceae1a-5c23-492c-bce1-ab7c9e7b005f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:36.397116 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baceae1a-5c23-492c-bce1-ab7c9e7b005f service neutron] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:36.406711 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1422/2861] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:29:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:29:36.665082 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757c3924-308a-46eb-ae1a-7540c8382e82 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:36.666482 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-757c3924-308a-46eb-ae1a-7540c8382e82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:29:36.680045 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757c3924-308a-46eb-ae1a-7540c8382e82 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:36.684720 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e8f034-7fec-4f8e-b180-7c2b74bd9a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:36.685585 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e8f034-7fec-4f8e-b180-7c2b74bd9a96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:36.686275 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e8f034-7fec-4f8e-b180-7c2b74bd9a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:36.686574 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e8f034-7fec-4f8e-b180-7c2b74bd9a96 admin admin] PATH_INFO: `/v3/projects/370d7066a3154b8b976d4b50f721920b` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:36.687923 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e8f034-7fec-4f8e-b180-7c2b74bd9a96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=370d7066a3154b8b976d4b50f721920b)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:36.690223 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e8f034-7fec-4f8e-b180-7c2b74bd9a96 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:36.736146 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-62e8f034-7fec-4f8e-b180-7c2b74bd9a96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '370d7066a3154b8b976d4b50f721920b', 'request_id': 'req-62e8f034-7fec-4f8e-b180-7c2b74bd9a96'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:36.741468 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-62e8f034-7fec-4f8e-b180-7c2b74bd9a96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '370d7066a3154b8b976d4b50f721920b', 'request_id': 'req-62e8f034-7fec-4f8e-b180-7c2b74bd9a96'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:36.748449 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-62e8f034-7fec-4f8e-b180-7c2b74bd9a96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '370d7066a3154b8b976d4b50f721920b', 'request_id': 'req-62e8f034-7fec-4f8e-b180-7c2b74bd9a96'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:36.759496 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-62e8f034-7fec-4f8e-b180-7c2b74bd9a96 admin admin] The token cache is being invalidate because project 370d7066a3154b8b976d4b50f721920b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79994) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:29:36.759792 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-62e8f034-7fec-4f8e-b180-7c2b74bd9a96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:36.760492 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-62e8f034-7fec-4f8e-b180-7c2b74bd9a96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:36.762056 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1440/2862] 10.222.0.70 () {58 vars in 1232 bytes} [Tue May 10 19:29:36 2022] DELETE /identity/v3/projects/370d7066a3154b8b976d4b50f721920b => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:29:40.054958 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b89f78f-a97c-450f-956a-c98fcafc6a29 None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:40.055951 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b89f78f-a97c-450f-956a-c98fcafc6a29 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:40.056077 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b89f78f-a97c-450f-956a-c98fcafc6a29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:40.073320 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-2b89f78f-a97c-450f-956a-c98fcafc6a29 None None] MFA Rules not processed for user `f2fbc31d945b4a61beb3fd9a28657583`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:29:40.074510 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-2b89f78f-a97c-450f-956a-c98fcafc6a29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:29:40.126788 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1423/2863] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:29:40 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:29:40.701613 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e8f034-7fec-4f8e-b180-7c2b74bd9a96 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:40.703087 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-62e8f034-7fec-4f8e-b180-7c2b74bd9a96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:29:40.767400 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e8f034-7fec-4f8e-b180-7c2b74bd9a96 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:40.772035 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbc9793-a6ab-4eb0-abb3-8cb241c1fbe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:40.773068 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbc9793-a6ab-4eb0-abb3-8cb241c1fbe4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:40.773347 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbc9793-a6ab-4eb0-abb3-8cb241c1fbe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:40.773619 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbc9793-a6ab-4eb0-abb3-8cb241c1fbe4 admin admin] PATH_INFO: `/v3/users/d68b3efa34434c59b8799106f0b4e79c` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:40.775386 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbc9793-a6ab-4eb0-abb3-8cb241c1fbe4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d68b3efa34434c59b8799106f0b4e79c)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:40.777334 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbc9793-a6ab-4eb0-abb3-8cb241c1fbe4 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:40.824782 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-ddbc9793-a6ab-4eb0-abb3-8cb241c1fbe4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd68b3efa34434c59b8799106f0b4e79c'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:40.839961 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-ddbc9793-a6ab-4eb0-abb3-8cb241c1fbe4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd68b3efa34434c59b8799106f0b4e79c'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:40.840979 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-ddbc9793-a6ab-4eb0-abb3-8cb241c1fbe4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd68b3efa34434c59b8799106f0b4e79c'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:40.849173 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-ddbc9793-a6ab-4eb0-abb3-8cb241c1fbe4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd68b3efa34434c59b8799106f0b4e79c'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:40.857778 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-ddbc9793-a6ab-4eb0-abb3-8cb241c1fbe4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd68b3efa34434c59b8799106f0b4e79c'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:40.864455 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1441/2864] 10.222.0.70 () {58 vars in 1223 bytes} [Tue May 10 19:29:40 2022] DELETE /identity/v3/users/d68b3efa34434c59b8799106f0b4e79c => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:29:40.868896 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ebf1dc-3532-40e0-a67a-9ea923d72688 None None] REQUEST_METHOD: `POST` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:40.869395 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ebf1dc-3532-40e0-a67a-9ea923d72688 None None] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:40.869773 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ebf1dc-3532-40e0-a67a-9ea923d72688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:40.890164 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.auth.core [None req-52ebf1dc-3532-40e0-a67a-9ea923d72688 None None] MFA Rules not processed for user `4cc9b8973fb54520a299cde16c0ec076`. Rule list: `[]` (Enabled: `True`). {{(pid=79993) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:29:40.891600 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-52ebf1dc-3532-40e0-a67a-9ea923d72688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:29:40.953435 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1424/2865] 10.222.0.70 () {58 vars in 957 bytes} [Tue May 10 19:29:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:29:40.962983 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbc9793-a6ab-4eb0-abb3-8cb241c1fbe4 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:40.964498 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-ddbc9793-a6ab-4eb0-abb3-8cb241c1fbe4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:29:41.029630 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbc9793-a6ab-4eb0-abb3-8cb241c1fbe4 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:41.033813 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c47db6-0118-4c51-a496-fb9b23f5b6fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f1dc79540b48c0866478cc48cd8205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:41.034469 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c47db6-0118-4c51-a496-fb9b23f5b6fb service neutron] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:41.034750 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c47db6-0118-4c51-a496-fb9b23f5b6fb service neutron] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:41.035044 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c47db6-0118-4c51-a496-fb9b23f5b6fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:41.044302 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c47db6-0118-4c51-a496-fb9b23f5b6fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:41.045906 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c47db6-0118-4c51-a496-fb9b23f5b6fb service neutron] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:41.055561 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1442/2866] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:29:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:29:41.334669 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ebf1dc-3532-40e0-a67a-9ea923d72688 None None] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:41.336102 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-52ebf1dc-3532-40e0-a67a-9ea923d72688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:29:41.347855 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ebf1dc-3532-40e0-a67a-9ea923d72688 None None] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:41.352409 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb693807-dd5b-4079-872f-96e80b3b5ef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:41.353291 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb693807-dd5b-4079-872f-96e80b3b5ef1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:41.353579 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb693807-dd5b-4079-872f-96e80b3b5ef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:41.353859 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb693807-dd5b-4079-872f-96e80b3b5ef1 admin admin] PATH_INFO: `/v3/projects/a0f16702b4804d5db5dc0ad7484ce217` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:41.355026 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb693807-dd5b-4079-872f-96e80b3b5ef1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0f16702b4804d5db5dc0ad7484ce217)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:41.358407 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb693807-dd5b-4079-872f-96e80b3b5ef1 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:41.405516 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-eb693807-dd5b-4079-872f-96e80b3b5ef1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0f16702b4804d5db5dc0ad7484ce217', 'request_id': 'req-eb693807-dd5b-4079-872f-96e80b3b5ef1'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:41.410849 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-eb693807-dd5b-4079-872f-96e80b3b5ef1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0f16702b4804d5db5dc0ad7484ce217', 'request_id': 'req-eb693807-dd5b-4079-872f-96e80b3b5ef1'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:41.418766 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-eb693807-dd5b-4079-872f-96e80b3b5ef1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0f16702b4804d5db5dc0ad7484ce217', 'request_id': 'req-eb693807-dd5b-4079-872f-96e80b3b5ef1'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:41.431575 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-eb693807-dd5b-4079-872f-96e80b3b5ef1 admin admin] The token cache is being invalidate because project a0f16702b4804d5db5dc0ad7484ce217 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79993) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:29:41.431829 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-eb693807-dd5b-4079-872f-96e80b3b5ef1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:41.432852 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-eb693807-dd5b-4079-872f-96e80b3b5ef1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:41.434058 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1425/2867] 10.222.0.70 () {58 vars in 1232 bytes} [Tue May 10 19:29:41 2022] DELETE /identity/v3/projects/a0f16702b4804d5db5dc0ad7484ce217 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:29:41.437918 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c47db6-0118-4c51-a496-fb9b23f5b6fb service neutron] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:41.448235 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c47db6-0118-4c51-a496-fb9b23f5b6fb service neutron] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:41.501346 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acdf57d-960d-41ea-96d1-1d950368d4a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:41.502207 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acdf57d-960d-41ea-96d1-1d950368d4a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:41.502492 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acdf57d-960d-41ea-96d1-1d950368d4a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:41.502764 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acdf57d-960d-41ea-96d1-1d950368d4a0 admin admin] PATH_INFO: `/v3/users/d7c877979e8447d29e3810a383bcf2fc` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:41.503943 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acdf57d-960d-41ea-96d1-1d950368d4a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7c877979e8447d29e3810a383bcf2fc)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:41.505881 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acdf57d-960d-41ea-96d1-1d950368d4a0 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:41.549351 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-9acdf57d-960d-41ea-96d1-1d950368d4a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7c877979e8447d29e3810a383bcf2fc'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:41.560892 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-9acdf57d-960d-41ea-96d1-1d950368d4a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7c877979e8447d29e3810a383bcf2fc'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:41.561540 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-9acdf57d-960d-41ea-96d1-1d950368d4a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7c877979e8447d29e3810a383bcf2fc'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:41.568387 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-9acdf57d-960d-41ea-96d1-1d950368d4a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7c877979e8447d29e3810a383bcf2fc'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:41.575600 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-9acdf57d-960d-41ea-96d1-1d950368d4a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7c877979e8447d29e3810a383bcf2fc'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:41.581259 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1443/2868] 10.222.0.70 () {58 vars in 1223 bytes} [Tue May 10 19:29:41 2022] DELETE /identity/v3/users/d7c877979e8447d29e3810a383bcf2fc => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:29:41.872119 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb693807-dd5b-4079-872f-96e80b3b5ef1 admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:41.874230 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-eb693807-dd5b-4079-872f-96e80b3b5ef1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:29:41.888849 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb693807-dd5b-4079-872f-96e80b3b5ef1 admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:41.964388 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a6c452-4a9c-498e-98de-52ecbbea3e83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:41.965425 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a6c452-4a9c-498e-98de-52ecbbea3e83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:41.965816 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a6c452-4a9c-498e-98de-52ecbbea3e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:41.966198 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a6c452-4a9c-498e-98de-52ecbbea3e83 admin admin] PATH_INFO: `/v3/projects/b4c6953fe2e74de4b37965a3ede8da9c` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:41.967686 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a6c452-4a9c-498e-98de-52ecbbea3e83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4c6953fe2e74de4b37965a3ede8da9c)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:41.969973 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a6c452-4a9c-498e-98de-52ecbbea3e83 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:42.022714 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-30a6c452-4a9c-498e-98de-52ecbbea3e83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4c6953fe2e74de4b37965a3ede8da9c', 'request_id': 'req-30a6c452-4a9c-498e-98de-52ecbbea3e83'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:42.028733 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-30a6c452-4a9c-498e-98de-52ecbbea3e83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4c6953fe2e74de4b37965a3ede8da9c', 'request_id': 'req-30a6c452-4a9c-498e-98de-52ecbbea3e83'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:42.040827 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-30a6c452-4a9c-498e-98de-52ecbbea3e83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4c6953fe2e74de4b37965a3ede8da9c', 'request_id': 'req-30a6c452-4a9c-498e-98de-52ecbbea3e83'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:42.052372 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-30a6c452-4a9c-498e-98de-52ecbbea3e83 admin admin] The token cache is being invalidate because project b4c6953fe2e74de4b37965a3ede8da9c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79993) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:29:42.052693 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-30a6c452-4a9c-498e-98de-52ecbbea3e83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:42.053414 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-30a6c452-4a9c-498e-98de-52ecbbea3e83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:42.055070 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1426/2869] 10.222.0.70 () {58 vars in 1232 bytes} [Tue May 10 19:29:41 2022] DELETE /identity/v3/projects/b4c6953fe2e74de4b37965a3ede8da9c => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:29:42.059195 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acdf57d-960d-41ea-96d1-1d950368d4a0 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:42.060727 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-9acdf57d-960d-41ea-96d1-1d950368d4a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:29:42.073553 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acdf57d-960d-41ea-96d1-1d950368d4a0 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:42.129863 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615d3821-5b33-4cca-b66e-3ac9a5c2f3a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:42.130749 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615d3821-5b33-4cca-b66e-3ac9a5c2f3a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:42.131050 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615d3821-5b33-4cca-b66e-3ac9a5c2f3a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:42.131307 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615d3821-5b33-4cca-b66e-3ac9a5c2f3a5 admin admin] PATH_INFO: `/v3/users/0528ad4d80aa4dc095a932c9208c65e5` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:42.132529 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615d3821-5b33-4cca-b66e-3ac9a5c2f3a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0528ad4d80aa4dc095a932c9208c65e5)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:42.134451 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615d3821-5b33-4cca-b66e-3ac9a5c2f3a5 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:42.181108 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-615d3821-5b33-4cca-b66e-3ac9a5c2f3a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0528ad4d80aa4dc095a932c9208c65e5'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:42.193572 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-615d3821-5b33-4cca-b66e-3ac9a5c2f3a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0528ad4d80aa4dc095a932c9208c65e5'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:42.194281 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-615d3821-5b33-4cca-b66e-3ac9a5c2f3a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0528ad4d80aa4dc095a932c9208c65e5'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:42.201644 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-615d3821-5b33-4cca-b66e-3ac9a5c2f3a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0528ad4d80aa4dc095a932c9208c65e5'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:42.208333 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-615d3821-5b33-4cca-b66e-3ac9a5c2f3a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0528ad4d80aa4dc095a932c9208c65e5'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:42.215178 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1444/2870] 10.222.0.70 () {58 vars in 1223 bytes} [Tue May 10 19:29:42 2022] DELETE /identity/v3/users/0528ad4d80aa4dc095a932c9208c65e5 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 19:29:42.640689 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a6c452-4a9c-498e-98de-52ecbbea3e83 admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:42.642365 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-30a6c452-4a9c-498e-98de-52ecbbea3e83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:29:42.663143 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a6c452-4a9c-498e-98de-52ecbbea3e83 admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:42.738516 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a6eb22-b515-4086-a1db-e6caa045a33c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:42.739435 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a6eb22-b515-4086-a1db-e6caa045a33c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:42.739760 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a6eb22-b515-4086-a1db-e6caa045a33c admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:42.740055 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a6eb22-b515-4086-a1db-e6caa045a33c admin admin] PATH_INFO: `/v3/projects/c6949da13f064eaca7d1266c02679771` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:42.741360 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a6eb22-b515-4086-a1db-e6caa045a33c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6949da13f064eaca7d1266c02679771)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:42.743978 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a6eb22-b515-4086-a1db-e6caa045a33c admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:42.797281 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-a3a6eb22-b515-4086-a1db-e6caa045a33c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6949da13f064eaca7d1266c02679771', 'request_id': 'req-a3a6eb22-b515-4086-a1db-e6caa045a33c'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:42.803312 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-a3a6eb22-b515-4086-a1db-e6caa045a33c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6949da13f064eaca7d1266c02679771', 'request_id': 'req-a3a6eb22-b515-4086-a1db-e6caa045a33c'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:42.811342 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-a3a6eb22-b515-4086-a1db-e6caa045a33c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6949da13f064eaca7d1266c02679771', 'request_id': 'req-a3a6eb22-b515-4086-a1db-e6caa045a33c'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:42.823258 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-a3a6eb22-b515-4086-a1db-e6caa045a33c admin admin] The token cache is being invalidate because project c6949da13f064eaca7d1266c02679771 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79993) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:29:42.823579 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-a3a6eb22-b515-4086-a1db-e6caa045a33c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:42.824209 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-a3a6eb22-b515-4086-a1db-e6caa045a33c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:29:42.826029 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1427/2871] 10.222.0.70 () {58 vars in 1232 bytes} [Tue May 10 19:29:42 2022] DELETE /identity/v3/projects/c6949da13f064eaca7d1266c02679771 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:29:57.356212 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615d3821-5b33-4cca-b66e-3ac9a5c2f3a5 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:29:57.357713 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-615d3821-5b33-4cca-b66e-3ac9a5c2f3a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:29:57.412569 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615d3821-5b33-4cca-b66e-3ac9a5c2f3a5 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:29:57.457129 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9834d3f0-a4a6-4e3c-8e1d-5c14bdd13ebd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f1dc79540b48c0866478cc48cd8205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:29:57.457764 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9834d3f0-a4a6-4e3c-8e1d-5c14bdd13ebd service neutron] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:29:57.458039 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9834d3f0-a4a6-4e3c-8e1d-5c14bdd13ebd service neutron] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:29:57.458308 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9834d3f0-a4a6-4e3c-8e1d-5c14bdd13ebd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:29:57.460035 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-9834d3f0-a4a6-4e3c-8e1d-5c14bdd13ebd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:29:57.517436 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9834d3f0-a4a6-4e3c-8e1d-5c14bdd13ebd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:29:57.518839 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9834d3f0-a4a6-4e3c-8e1d-5c14bdd13ebd service neutron] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:29:57.528650 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1445/2872] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:29:57 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:30:42.409738 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a6eb22-b515-4086-a1db-e6caa045a33c admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:30:42.412458 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-a3a6eb22-b515-4086-a1db-e6caa045a33c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:30:42.426959 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a6eb22-b515-4086-a1db-e6caa045a33c admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:30:42.430796 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edeb721b-9596-41ae-8bea-4eef2bca9fd8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f1dc79540b48c0866478cc48cd8205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:30:42.431447 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeb721b-9596-41ae-8bea-4eef2bca9fd8 service neutron] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:30:42.431737 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeb721b-9596-41ae-8bea-4eef2bca9fd8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:30:42.432013 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeb721b-9596-41ae-8bea-4eef2bca9fd8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:30:42.434518 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-edeb721b-9596-41ae-8bea-4eef2bca9fd8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:30:42.498537 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edeb721b-9596-41ae-8bea-4eef2bca9fd8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:30:42.499910 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edeb721b-9596-41ae-8bea-4eef2bca9fd8 service neutron] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:30:42.509650 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1428/2873] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:30:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:30:48.939483 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9834d3f0-a4a6-4e3c-8e1d-5c14bdd13ebd service neutron] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:30:48.941099 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-9834d3f0-a4a6-4e3c-8e1d-5c14bdd13ebd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:30:48.958380 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9834d3f0-a4a6-4e3c-8e1d-5c14bdd13ebd service neutron] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:30:48.965432 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8fea20-b06f-49dd-86db-57217867133b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:30:48.966311 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8fea20-b06f-49dd-86db-57217867133b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:30:48.966940 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8fea20-b06f-49dd-86db-57217867133b admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:30:48.967216 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8fea20-b06f-49dd-86db-57217867133b admin admin] PATH_INFO: `/v3/users/cdb08a49fd924e4c9f9cae5e7a6e44b0` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:30:48.968395 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8fea20-b06f-49dd-86db-57217867133b admin admin] RBAC: Authorizing `identity:delete_user(user_id=cdb08a49fd924e4c9f9cae5e7a6e44b0)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:30:48.970335 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8fea20-b06f-49dd-86db-57217867133b admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:30:49.015927 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-2c8fea20-b06f-49dd-86db-57217867133b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cdb08a49fd924e4c9f9cae5e7a6e44b0'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:30:49.027101 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-2c8fea20-b06f-49dd-86db-57217867133b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cdb08a49fd924e4c9f9cae5e7a6e44b0'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:30:49.027781 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-2c8fea20-b06f-49dd-86db-57217867133b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cdb08a49fd924e4c9f9cae5e7a6e44b0'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:30:49.034563 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-2c8fea20-b06f-49dd-86db-57217867133b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cdb08a49fd924e4c9f9cae5e7a6e44b0'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:30:49.042212 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-2c8fea20-b06f-49dd-86db-57217867133b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cdb08a49fd924e4c9f9cae5e7a6e44b0'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:30:49.048653 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1446/2874] 10.222.0.70 () {58 vars in 1223 bytes} [Tue May 10 19:30:48 2022] DELETE /identity/v3/users/cdb08a49fd924e4c9f9cae5e7a6e44b0 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:30:49.216864 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edeb721b-9596-41ae-8bea-4eef2bca9fd8 service neutron] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:30:49.226721 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edeb721b-9596-41ae-8bea-4eef2bca9fd8 service neutron] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:30:49.281708 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44033b3d-0a5e-4737-acf6-7313b33beb08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:30:49.282569 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44033b3d-0a5e-4737-acf6-7313b33beb08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:30:49.282849 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44033b3d-0a5e-4737-acf6-7313b33beb08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:30:49.283125 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44033b3d-0a5e-4737-acf6-7313b33beb08 admin admin] PATH_INFO: `/v3/projects/5c6ebef4c7f34f3dac195244855d9292` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:30:49.284275 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44033b3d-0a5e-4737-acf6-7313b33beb08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c6ebef4c7f34f3dac195244855d9292)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:30:49.286216 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44033b3d-0a5e-4737-acf6-7313b33beb08 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:30:49.329984 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-44033b3d-0a5e-4737-acf6-7313b33beb08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c6ebef4c7f34f3dac195244855d9292', 'request_id': 'req-44033b3d-0a5e-4737-acf6-7313b33beb08'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:30:49.335154 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-44033b3d-0a5e-4737-acf6-7313b33beb08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c6ebef4c7f34f3dac195244855d9292', 'request_id': 'req-44033b3d-0a5e-4737-acf6-7313b33beb08'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:30:49.341422 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-44033b3d-0a5e-4737-acf6-7313b33beb08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c6ebef4c7f34f3dac195244855d9292', 'request_id': 'req-44033b3d-0a5e-4737-acf6-7313b33beb08'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:30:49.351753 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-44033b3d-0a5e-4737-acf6-7313b33beb08 admin admin] The token cache is being invalidate because project 5c6ebef4c7f34f3dac195244855d9292 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79993) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:30:49.352037 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-44033b3d-0a5e-4737-acf6-7313b33beb08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:30:49.352691 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-44033b3d-0a5e-4737-acf6-7313b33beb08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:30:49.354195 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1429/2875] 10.222.0.70 () {58 vars in 1232 bytes} [Tue May 10 19:30:49 2022] DELETE /identity/v3/projects/5c6ebef4c7f34f3dac195244855d9292 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:30:49.358793 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8fea20-b06f-49dd-86db-57217867133b admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:30:49.360178 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-2c8fea20-b06f-49dd-86db-57217867133b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:30:49.373930 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8fea20-b06f-49dd-86db-57217867133b admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:30:49.428149 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1b11c8-3c39-4b87-b3f0-8f063045f265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:30:49.428973 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1b11c8-3c39-4b87-b3f0-8f063045f265 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:30:49.429259 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1b11c8-3c39-4b87-b3f0-8f063045f265 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:30:49.429533 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1b11c8-3c39-4b87-b3f0-8f063045f265 admin admin] PATH_INFO: `/v3/users/01cbe0ba646f410bbd310c4e4d406ba4` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:30:49.430709 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1b11c8-3c39-4b87-b3f0-8f063045f265 admin admin] RBAC: Authorizing `identity:delete_user(user_id=01cbe0ba646f410bbd310c4e4d406ba4)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:30:49.432653 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1b11c8-3c39-4b87-b3f0-8f063045f265 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:30:49.477412 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-6a1b11c8-3c39-4b87-b3f0-8f063045f265 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01cbe0ba646f410bbd310c4e4d406ba4'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:30:49.488522 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-6a1b11c8-3c39-4b87-b3f0-8f063045f265 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01cbe0ba646f410bbd310c4e4d406ba4'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:30:49.489168 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-6a1b11c8-3c39-4b87-b3f0-8f063045f265 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01cbe0ba646f410bbd310c4e4d406ba4'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:30:49.496579 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-6a1b11c8-3c39-4b87-b3f0-8f063045f265 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01cbe0ba646f410bbd310c4e4d406ba4'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:30:49.506654 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-6a1b11c8-3c39-4b87-b3f0-8f063045f265 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01cbe0ba646f410bbd310c4e4d406ba4'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:30:49.514077 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1447/2876] 10.222.0.70 () {58 vars in 1223 bytes} [Tue May 10 19:30:49 2022] DELETE /identity/v3/users/01cbe0ba646f410bbd310c4e4d406ba4 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:30:49.687641 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44033b3d-0a5e-4737-acf6-7313b33beb08 admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:30:49.689255 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-44033b3d-0a5e-4737-acf6-7313b33beb08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:30:49.703809 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44033b3d-0a5e-4737-acf6-7313b33beb08 admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:30:49.758610 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d980ea4c-42cb-4c3a-aded-7c0fae14c474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:30:49.759472 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d980ea4c-42cb-4c3a-aded-7c0fae14c474 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:30:49.759755 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d980ea4c-42cb-4c3a-aded-7c0fae14c474 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:30:49.760028 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d980ea4c-42cb-4c3a-aded-7c0fae14c474 admin admin] PATH_INFO: `/v3/projects/435f7af7ef4343358131698c12518566` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:30:49.761984 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d980ea4c-42cb-4c3a-aded-7c0fae14c474 admin admin] RBAC: Authorizing `identity:delete_project(project_id=435f7af7ef4343358131698c12518566)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:30:49.763890 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d980ea4c-42cb-4c3a-aded-7c0fae14c474 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:30:49.814366 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-d980ea4c-42cb-4c3a-aded-7c0fae14c474 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '435f7af7ef4343358131698c12518566', 'request_id': 'req-d980ea4c-42cb-4c3a-aded-7c0fae14c474'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:30:49.819838 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-d980ea4c-42cb-4c3a-aded-7c0fae14c474 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '435f7af7ef4343358131698c12518566', 'request_id': 'req-d980ea4c-42cb-4c3a-aded-7c0fae14c474'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:30:49.826934 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-d980ea4c-42cb-4c3a-aded-7c0fae14c474 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '435f7af7ef4343358131698c12518566', 'request_id': 'req-d980ea4c-42cb-4c3a-aded-7c0fae14c474'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:30:49.837886 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-d980ea4c-42cb-4c3a-aded-7c0fae14c474 admin admin] The token cache is being invalidate because project 435f7af7ef4343358131698c12518566 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79993) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:30:49.838174 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-d980ea4c-42cb-4c3a-aded-7c0fae14c474 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:30:49.838809 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-d980ea4c-42cb-4c3a-aded-7c0fae14c474 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:30:49.843400 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1430/2877] 10.222.0.70 () {58 vars in 1232 bytes} [Tue May 10 19:30:49 2022] DELETE /identity/v3/projects/435f7af7ef4343358131698c12518566 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:31:38.991705 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1b11c8-3c39-4b87-b3f0-8f063045f265 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:31:38.993156 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-6a1b11c8-3c39-4b87-b3f0-8f063045f265 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:31:39.073038 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1b11c8-3c39-4b87-b3f0-8f063045f265 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:31:39.149476 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb61c1cc-2958-4b51-9c2f-6e6b000b4b0a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9f310a468ec4058b3c95356ea60ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:31:39.150130 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb61c1cc-2958-4b51-9c2f-6e6b000b4b0a service nova] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:31:39.150417 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb61c1cc-2958-4b51-9c2f-6e6b000b4b0a service nova] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:31:39.150694 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb61c1cc-2958-4b51-9c2f-6e6b000b4b0a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:31:39.152593 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-fb61c1cc-2958-4b51-9c2f-6e6b000b4b0a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:31:39.164692 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb61c1cc-2958-4b51-9c2f-6e6b000b4b0a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:31:39.169518 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb61c1cc-2958-4b51-9c2f-6e6b000b4b0a service nova] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:31:39.171442 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d980ea4c-42cb-4c3a-aded-7c0fae14c474 admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:31:39.173601 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-d980ea4c-42cb-4c3a-aded-7c0fae14c474 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:31:39.181471 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1448/2878] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:31:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:31:39.233729 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d980ea4c-42cb-4c3a-aded-7c0fae14c474 admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:31:39.237899 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cbe9ce-247d-465f-8759-17062ff574de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f1dc79540b48c0866478cc48cd8205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:31:39.238561 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cbe9ce-247d-465f-8759-17062ff574de service neutron] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:31:39.238839 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cbe9ce-247d-465f-8759-17062ff574de service neutron] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:31:39.239115 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cbe9ce-247d-465f-8759-17062ff574de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:31:39.240983 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-86cbe9ce-247d-465f-8759-17062ff574de service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:31:39.255124 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cbe9ce-247d-465f-8759-17062ff574de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:31:39.256674 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cbe9ce-247d-465f-8759-17062ff574de service neutron] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:31:39.267897 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1431/2879] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:31:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:31:40.124543 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb61c1cc-2958-4b51-9c2f-6e6b000b4b0a service nova] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:31:40.126487 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-fb61c1cc-2958-4b51-9c2f-6e6b000b4b0a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:31:40.137961 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb61c1cc-2958-4b51-9c2f-6e6b000b4b0a service nova] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:31:40.141538 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4603e3e-790a-4925-adaa-462ae4493aff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f1dc79540b48c0866478cc48cd8205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:31:40.142169 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4603e3e-790a-4925-adaa-462ae4493aff service neutron] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:31:40.142446 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4603e3e-790a-4925-adaa-462ae4493aff service neutron] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:31:40.142842 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4603e3e-790a-4925-adaa-462ae4493aff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:31:40.144642 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-c4603e3e-790a-4925-adaa-462ae4493aff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:31:40.153883 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4603e3e-790a-4925-adaa-462ae4493aff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:31:40.155287 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4603e3e-790a-4925-adaa-462ae4493aff service neutron] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:31:40.163251 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1449/2880] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:31:40 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:31:40.442510 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cbe9ce-247d-465f-8759-17062ff574de service neutron] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:31:40.451488 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cbe9ce-247d-465f-8759-17062ff574de service neutron] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:31:40.455121 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cec8d74-364f-47e8-b921-87f708dd0914 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f1dc79540b48c0866478cc48cd8205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:31:40.455755 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cec8d74-364f-47e8-b921-87f708dd0914 service neutron] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:31:40.456041 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cec8d74-364f-47e8-b921-87f708dd0914 service neutron] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:31:40.456319 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cec8d74-364f-47e8-b921-87f708dd0914 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:31:40.458156 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-0cec8d74-364f-47e8-b921-87f708dd0914 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:31:40.471574 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cec8d74-364f-47e8-b921-87f708dd0914 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:31:40.473040 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cec8d74-364f-47e8-b921-87f708dd0914 service neutron] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:31:40.483669 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1432/2881] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:31:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:31:51.238016 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4603e3e-790a-4925-adaa-462ae4493aff service neutron] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:31:51.246638 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4603e3e-790a-4925-adaa-462ae4493aff service neutron] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:31:51.250962 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0d0761-3bfa-42a0-91be-6a60dc19c3c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f1dc79540b48c0866478cc48cd8205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:31:51.251633 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0d0761-3bfa-42a0-91be-6a60dc19c3c2 service neutron] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:31:51.251923 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0d0761-3bfa-42a0-91be-6a60dc19c3c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:31:51.252196 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0d0761-3bfa-42a0-91be-6a60dc19c3c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:31:51.253951 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-6f0d0761-3bfa-42a0-91be-6a60dc19c3c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:31:51.315308 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0d0761-3bfa-42a0-91be-6a60dc19c3c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:31:51.316781 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0d0761-3bfa-42a0-91be-6a60dc19c3c2 service neutron] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:31:51.326508 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1450/2882] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:31:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:31:57.709711 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cec8d74-364f-47e8-b921-87f708dd0914 service neutron] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:31:57.711952 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-0cec8d74-364f-47e8-b921-87f708dd0914 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:31:57.728800 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cec8d74-364f-47e8-b921-87f708dd0914 service neutron] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:31:57.733400 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a2f185-7664-4ce5-8113-1982bdd5e959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:31:57.734224 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a2f185-7664-4ce5-8113-1982bdd5e959 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:31:57.734505 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a2f185-7664-4ce5-8113-1982bdd5e959 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:31:57.734780 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a2f185-7664-4ce5-8113-1982bdd5e959 admin admin] PATH_INFO: `/v3/users/f2fbc31d945b4a61beb3fd9a28657583` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:31:57.735976 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a2f185-7664-4ce5-8113-1982bdd5e959 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2fbc31d945b4a61beb3fd9a28657583)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:31:57.738432 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a2f185-7664-4ce5-8113-1982bdd5e959 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:31:57.789304 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-c3a2f185-7664-4ce5-8113-1982bdd5e959 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2fbc31d945b4a61beb3fd9a28657583'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:31:57.800688 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-c3a2f185-7664-4ce5-8113-1982bdd5e959 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2fbc31d945b4a61beb3fd9a28657583'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:31:57.807227 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-c3a2f185-7664-4ce5-8113-1982bdd5e959 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2fbc31d945b4a61beb3fd9a28657583'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:31:57.807914 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-c3a2f185-7664-4ce5-8113-1982bdd5e959 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2fbc31d945b4a61beb3fd9a28657583'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:31:57.815181 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-c3a2f185-7664-4ce5-8113-1982bdd5e959 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2fbc31d945b4a61beb3fd9a28657583'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:31:57.821322 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1433/2883] 10.222.0.70 () {58 vars in 1223 bytes} [Tue May 10 19:31:57 2022] DELETE /identity/v3/users/f2fbc31d945b4a61beb3fd9a28657583 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:31:57.992154 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0d0761-3bfa-42a0-91be-6a60dc19c3c2 service neutron] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:31:58.006322 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0d0761-3bfa-42a0-91be-6a60dc19c3c2 service neutron] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:31:58.067683 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1313c4-6451-4fde-8e53-96e62619b4c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:31:58.068451 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1313c4-6451-4fde-8e53-96e62619b4c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:31:58.068753 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1313c4-6451-4fde-8e53-96e62619b4c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:31:58.068989 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1313c4-6451-4fde-8e53-96e62619b4c5 admin admin] PATH_INFO: `/v3/projects/7bff45e4fe4f43fcbd241831c989710f` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:31:58.070399 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1313c4-6451-4fde-8e53-96e62619b4c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7bff45e4fe4f43fcbd241831c989710f)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:31:58.072594 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1313c4-6451-4fde-8e53-96e62619b4c5 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:31:58.119562 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-7c1313c4-6451-4fde-8e53-96e62619b4c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7bff45e4fe4f43fcbd241831c989710f', 'request_id': 'req-7c1313c4-6451-4fde-8e53-96e62619b4c5'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:31:58.124724 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-7c1313c4-6451-4fde-8e53-96e62619b4c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7bff45e4fe4f43fcbd241831c989710f', 'request_id': 'req-7c1313c4-6451-4fde-8e53-96e62619b4c5'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:31:58.133101 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-7c1313c4-6451-4fde-8e53-96e62619b4c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7bff45e4fe4f43fcbd241831c989710f', 'request_id': 'req-7c1313c4-6451-4fde-8e53-96e62619b4c5'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:31:58.143971 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-7c1313c4-6451-4fde-8e53-96e62619b4c5 admin admin] The token cache is being invalidate because project 7bff45e4fe4f43fcbd241831c989710f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79994) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:31:58.144257 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-7c1313c4-6451-4fde-8e53-96e62619b4c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:31:58.144917 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-7c1313c4-6451-4fde-8e53-96e62619b4c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:31:58.146670 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1451/2884] 10.222.0.70 () {58 vars in 1232 bytes} [Tue May 10 19:31:57 2022] DELETE /identity/v3/projects/7bff45e4fe4f43fcbd241831c989710f => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:31:58.150660 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a2f185-7664-4ce5-8113-1982bdd5e959 admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:31:58.152029 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-c3a2f185-7664-4ce5-8113-1982bdd5e959 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:31:58.165552 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a2f185-7664-4ce5-8113-1982bdd5e959 admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:31:58.225286 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c53992-ff2c-4f89-b996-37200d1ec9f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:31:58.226157 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c53992-ff2c-4f89-b996-37200d1ec9f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:31:58.226437 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c53992-ff2c-4f89-b996-37200d1ec9f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:31:58.226710 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c53992-ff2c-4f89-b996-37200d1ec9f4 admin admin] PATH_INFO: `/v3/users/9334f5411276473883307c63b4c528df` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:31:58.227872 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c53992-ff2c-4f89-b996-37200d1ec9f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9334f5411276473883307c63b4c528df)` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:31:58.229821 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c53992-ff2c-4f89-b996-37200d1ec9f4 admin admin] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:31:58.273367 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-27c53992-ff2c-4f89-b996-37200d1ec9f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9334f5411276473883307c63b4c528df'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:31:58.284922 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-27c53992-ff2c-4f89-b996-37200d1ec9f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9334f5411276473883307c63b4c528df'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:31:58.291441 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-27c53992-ff2c-4f89-b996-37200d1ec9f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9334f5411276473883307c63b4c528df'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:31:58.292119 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-27c53992-ff2c-4f89-b996-37200d1ec9f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9334f5411276473883307c63b4c528df'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:31:58.301089 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.notifications [None req-27c53992-ff2c-4f89-b996-37200d1ec9f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9334f5411276473883307c63b4c528df'} {{(pid=79993) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:31:58.307395 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1434/2885] 10.222.0.70 () {58 vars in 1223 bytes} [Tue May 10 19:31:58 2022] DELETE /identity/v3/users/9334f5411276473883307c63b4c528df => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:31:58.477095 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1313c4-6451-4fde-8e53-96e62619b4c5 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:31:58.478929 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-7c1313c4-6451-4fde-8e53-96e62619b4c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:31:58.493184 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1313c4-6451-4fde-8e53-96e62619b4c5 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:31:58.548226 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84275061-4140-480d-8117-994b70b57009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc9b8973fb54520a299cde16c0ec076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c5828bc7be44a6adb3e9898a8f18d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:31:58.549223 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84275061-4140-480d-8117-994b70b57009 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:31:58.549505 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84275061-4140-480d-8117-994b70b57009 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:31:58.549773 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84275061-4140-480d-8117-994b70b57009 admin admin] PATH_INFO: `/v3/projects/622b819918b2449982484d324d648f5f` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:31:58.550936 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84275061-4140-480d-8117-994b70b57009 admin admin] RBAC: Authorizing `identity:delete_project(project_id=622b819918b2449982484d324d648f5f)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:31:58.552876 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84275061-4140-480d-8117-994b70b57009 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:31:58.598119 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-84275061-4140-480d-8117-994b70b57009 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '622b819918b2449982484d324d648f5f', 'request_id': 'req-84275061-4140-480d-8117-994b70b57009'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:31:58.603496 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-84275061-4140-480d-8117-994b70b57009 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '622b819918b2449982484d324d648f5f', 'request_id': 'req-84275061-4140-480d-8117-994b70b57009'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:31:58.610108 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-84275061-4140-480d-8117-994b70b57009 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '622b819918b2449982484d324d648f5f', 'request_id': 'req-84275061-4140-480d-8117-994b70b57009'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:31:58.620776 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-84275061-4140-480d-8117-994b70b57009 admin admin] The token cache is being invalidate because project 622b819918b2449982484d324d648f5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79994) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:31:58.621059 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-84275061-4140-480d-8117-994b70b57009 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:31:58.621679 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-84275061-4140-480d-8117-994b70b57009 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:31:58.623229 dv-cinder-784815-13-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1452/2886] 10.222.0.70 () {58 vars in 1232 bytes} [Tue May 10 19:31:58 2022] DELETE /identity/v3/projects/622b819918b2449982484d324d648f5f => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:34:01.196225 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c53992-ff2c-4f89-b996-37200d1ec9f4 admin admin] Authenticating user token {{(pid=79993) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:34:01.197797 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-27c53992-ff2c-4f89-b996-37200d1ec9f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:34:01.328996 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c53992-ff2c-4f89-b996-37200d1ec9f4 admin admin] Validating token access rules against request {{(pid=79993) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:34:01.386612 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24523f8f-e30e-45ff-add0-1f4430dbe499 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b95d3824f34cfcada6915ee57a7e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ee9ec5b515440fe9b39aedf3e339c79', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79993) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:34:01.387259 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24523f8f-e30e-45ff-add0-1f4430dbe499 service placement] REQUEST_METHOD: `GET` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:34:01.387568 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24523f8f-e30e-45ff-add0-1f4430dbe499 service placement] SCRIPT_NAME: `/identity` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:34:01.387844 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24523f8f-e30e-45ff-add0-1f4430dbe499 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79993) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:34:01.389617 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.fernet_utils [None req-24523f8f-e30e-45ff-add0-1f4430dbe499 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79993) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:34:01.400355 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24523f8f-e30e-45ff-add0-1f4430dbe499 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:34:01.401966 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24523f8f-e30e-45ff-add0-1f4430dbe499 service placement] RBAC: Authorization granted {{(pid=79993) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:34:01.412064 dv-cinder-784815-13-iscsi devstack@keystone.service[79993]: [pid: 79993|app: 0|req: 1435/2887] 10.222.0.70 () {60 vars in 1365 bytes} [Tue May 10 19:34:01 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)